Jun 08 12:09:24.821253 ip-10-0-136-216 systemd[1]: Starting Kubernetes Kubelet... Jun 08 12:09:25.224163 ip-10-0-136-216 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:09:25.224163 ip-10-0-136-216 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 12:09:25.224163 ip-10-0-136-216 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:09:25.224163 ip-10-0-136-216 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 12:09:25.224163 ip-10-0-136-216 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:09:25.224851 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.224222 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 12:09:25.229940 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229913 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:25.229940 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229936 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:25.229940 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229940 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:25.229940 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229944 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:25.229940 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229947 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229950 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229954 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229956 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229960 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229963 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229965 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229968 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229985 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229988 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229991 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229993 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229996 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.229998 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230001 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230005 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230009 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230012 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230015 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:25.230169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230017 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230020 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230022 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230025 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230028 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230030 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230033 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230038 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230041 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230044 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230047 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230049 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230051 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230054 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230056 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230059 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230062 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230064 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230067 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230069 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:25.230666 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230072 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230075 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230077 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230079 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230082 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230085 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230087 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230090 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230093 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230095 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230098 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230100 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230103 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230105 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230108 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230110 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230113 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230115 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230118 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230120 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:25.231176 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230124 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230128 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230132 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230135 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230139 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230143 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230146 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230149 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230152 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230155 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230157 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230160 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230163 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230165 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230168 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230170 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230173 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230176 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230179 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230181 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:25.231652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230186 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230189 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230192 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230194 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230197 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230199 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230202 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230204 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230207 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230209 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230212 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230214 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230217 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230220 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230222 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230226 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230926 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230933 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230936 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230938 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:25.232150 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230941 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230944 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230947 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230949 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230952 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230955 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230957 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230960 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230962 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230965 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230968 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230987 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230992 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230996 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.230999 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231002 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231005 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231008 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231011 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231014 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:25.232685 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231017 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231020 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231022 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231025 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231028 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231031 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231033 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231036 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231039 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231041 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231044 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231047 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231049 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231052 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231054 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231057 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231060 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231063 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231065 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231067 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:25.233189 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231070 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231073 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231075 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231078 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231081 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231084 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231087 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231089 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231092 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231094 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231097 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231099 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231101 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231104 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231107 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231110 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231112 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231115 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231118 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231120 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:25.233673 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231123 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231125 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231127 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231130 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231132 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231135 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231137 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231140 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231143 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231145 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231148 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231152 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231156 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231159 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231162 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231166 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231169 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231172 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231175 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:25.234186 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231179 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231182 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231185 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231188 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231191 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231194 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231197 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231200 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231203 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231206 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231208 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231211 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231213 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231216 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231218 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231221 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231627 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231632 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231635 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:25.234651 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231638 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231640 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231643 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231645 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231648 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231651 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231653 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231656 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231659 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231662 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231665 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231668 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231670 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231673 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231676 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231679 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231681 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231684 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231686 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231689 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:25.235169 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231692 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231695 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231697 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231700 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231703 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231705 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231708 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231710 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231712 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231715 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231717 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231720 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231722 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231725 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231727 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231730 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231732 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231734 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231737 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:25.235652 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231740 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231742 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231745 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231749 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231752 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231755 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231758 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231766 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231772 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231776 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231779 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231782 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231785 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231788 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231791 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231793 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231796 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231799 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:25.236127 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231801 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231804 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231806 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231809 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231815 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231818 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231821 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231823 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231826 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231829 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231831 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231833 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231836 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231838 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231841 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231843 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231846 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231848 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231851 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231853 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:25.236568 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231855 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231858 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231862 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231865 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231868 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231870 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231873 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231876 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231878 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231881 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231884 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231886 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231889 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231891 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231894 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231896 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231899 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231901 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.231903 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.231994 2584 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 12:09:25.237059 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232012 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232022 2584 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232026 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232030 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232034 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232038 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232042 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232045 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232048 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232051 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232054 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232057 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232060 2584 flags.go:64] FLAG: --cgroup-root="" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232063 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232067 2584 flags.go:64] FLAG: --client-ca-file="" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232072 2584 flags.go:64] FLAG: --cloud-provider="external" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232075 2584 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232079 2584 flags.go:64] FLAG: --cluster-domain="" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232082 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232085 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232088 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232092 2584 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232096 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 12:09:25.237546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232099 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232102 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232105 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232109 2584 flags.go:64] FLAG: --contention-profiling="false" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232111 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232114 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232117 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232120 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232124 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232127 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232130 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232133 2584 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232135 2584 flags.go:64] FLAG: --enable-server="true" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232138 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232142 2584 flags.go:64] FLAG: --event-burst="100" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232145 2584 flags.go:64] FLAG: --event-qps="50" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232148 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232151 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232154 2584 flags.go:64] FLAG: --eviction-hard="" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232158 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232163 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232166 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232169 2584 flags.go:64] FLAG: --eviction-soft="" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232173 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232176 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 12:09:25.238104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232179 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232182 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232185 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232187 2584 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232190 2584 flags.go:64] FLAG: --feature-gates="" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232194 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232197 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232199 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232202 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232205 2584 flags.go:64] FLAG: --healthz-port="10248" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232208 2584 flags.go:64] FLAG: --help="false" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232211 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232214 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232217 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232220 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232223 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232226 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232229 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232232 2584 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232235 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232238 2584 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232241 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232244 2584 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232246 2584 flags.go:64] FLAG: --kube-reserved="" Jun 08 12:09:25.238763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232249 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232252 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232254 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232259 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232262 2584 flags.go:64] FLAG: --lock-file="" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232265 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232269 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232272 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232277 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232280 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232283 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232286 2584 flags.go:64] FLAG: --logging-format="text" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232288 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232292 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232294 2584 flags.go:64] FLAG: --manifest-url="" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232297 2584 flags.go:64] FLAG: --manifest-url-header="" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232301 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232304 2584 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232308 2584 flags.go:64] FLAG: --max-pods="110" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232311 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232314 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232316 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232319 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232322 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232325 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 12:09:25.239393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232327 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232335 2584 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232338 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232341 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232344 2584 flags.go:64] FLAG: --pod-cidr="" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232347 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232352 2584 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232355 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232358 2584 flags.go:64] FLAG: --pods-per-core="0" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232360 2584 flags.go:64] FLAG: --port="10250" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232365 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232368 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cec8a53842b5fe61" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232371 2584 flags.go:64] FLAG: --qos-reserved="" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232374 2584 flags.go:64] FLAG: --read-only-port="10255" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232378 2584 flags.go:64] FLAG: --register-node="true" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232381 2584 flags.go:64] FLAG: --register-with-taints="" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232385 2584 flags.go:64] FLAG: --registry-burst="10" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232392 2584 flags.go:64] FLAG: --registry-qps="5" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232395 2584 flags.go:64] FLAG: --reserved-cpus="" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232398 2584 flags.go:64] FLAG: --reserved-memory="" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232401 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232404 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232407 2584 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232410 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232413 2584 flags.go:64] FLAG: --runonce="false" Jun 08 12:09:25.240024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232415 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232418 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232421 2584 flags.go:64] FLAG: --seccomp-default="false" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232424 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232427 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232430 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232433 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232436 2584 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232438 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232441 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232444 2584 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232447 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232450 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232452 2584 flags.go:64] FLAG: --system-cgroups="" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232455 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232461 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232463 2584 flags.go:64] FLAG: --tls-cert-file="" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232467 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232472 2584 flags.go:64] FLAG: --tls-min-version="" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232474 2584 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232477 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232481 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232484 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232487 2584 flags.go:64] FLAG: --v="2" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232491 2584 flags.go:64] FLAG: --version="false" Jun 08 12:09:25.240657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232495 2584 flags.go:64] FLAG: --vmodule="" Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232499 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.232502 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232631 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232636 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232639 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232641 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232644 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232647 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232649 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232652 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232655 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232657 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232659 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232662 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232665 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232667 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232670 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232672 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:25.241292 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232675 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232677 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232680 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232683 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232686 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232691 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232694 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232696 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232699 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232702 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232705 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232707 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232710 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232713 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232716 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232719 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232721 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232724 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232726 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232729 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:25.241752 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232731 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232733 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232736 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232738 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232742 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232745 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232749 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232752 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232754 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232757 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232760 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232762 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232765 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232767 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232770 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232772 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232775 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232779 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232781 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232784 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:25.242270 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232786 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232791 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232793 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232796 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232798 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232801 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232803 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232806 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232809 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232811 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232815 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232818 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232821 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232824 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232827 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232830 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232832 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232835 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232838 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:25.242763 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232840 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232843 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232845 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232847 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232850 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232853 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232855 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232857 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232860 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232862 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232866 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232868 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232871 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232873 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232877 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232880 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232882 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232885 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232887 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232890 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:25.243235 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232892 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232895 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232898 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.232900 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.233732 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.240809 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.240827 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.240846 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.240852 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240919 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240926 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240929 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240932 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240936 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:25.243737 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240939 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240942 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240945 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240948 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240951 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240953 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240956 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240959 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240961 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240964 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240966 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240969 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240990 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240993 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240996 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.240998 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241001 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241004 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241007 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:25.244121 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241010 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241013 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241016 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241019 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241022 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241025 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241028 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241031 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241033 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241036 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241039 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241041 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241044 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241046 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241049 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241052 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241054 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241057 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241060 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241062 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:25.244624 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241065 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241067 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241070 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241073 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241076 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241078 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241082 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241086 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241089 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241093 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241096 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241100 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241102 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241106 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241110 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241112 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241115 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241118 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241120 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:25.245156 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241123 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241126 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241128 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241131 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241134 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241136 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241139 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241142 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241144 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241147 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241150 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241152 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241155 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241158 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241160 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241163 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241165 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241169 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241171 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241174 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:25.245662 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241178 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241181 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241184 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241187 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241189 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241193 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241196 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241199 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241202 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241205 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241207 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241210 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241212 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241215 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241218 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:25.246170 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241220 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.241225 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241356 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241360 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241363 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241366 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241369 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241372 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241374 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241377 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241379 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241382 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241386 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241389 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:25.246545 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241393 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241396 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241399 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241401 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241404 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241406 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241409 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241411 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241414 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241417 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241419 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241422 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241424 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241427 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241429 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241432 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241434 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241437 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241440 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241443 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:25.246905 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241447 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241451 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241453 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241456 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241458 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241461 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241463 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241465 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241468 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241470 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241473 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241475 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241478 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241480 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241482 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241485 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241487 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241490 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241492 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241495 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:25.247408 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241498 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241501 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241504 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241506 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241510 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241512 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241515 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241517 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241520 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241522 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241525 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241527 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241529 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241533 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241535 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241537 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241540 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241542 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241544 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241547 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:25.247911 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241549 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241552 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241554 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241557 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241559 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241561 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241564 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241566 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241569 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241571 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241573 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241576 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241579 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241582 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241584 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241588 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241592 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241595 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241597 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:25.248443 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241600 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241602 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241605 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241608 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241610 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241612 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241615 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:25.241617 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.241622 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.241735 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.245010 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.246512 2584 server.go:1019] "Starting client certificate rotation" Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.246613 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:09:25.248933 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.246648 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:09:25.250254 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.249010 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:09:25.253989 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.253830 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:09:25.266071 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.266049 2584 log.go:25] "Validated CRI v1 runtime API" Jun 08 12:09:25.268357 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.268343 2584 log.go:25] "Validated CRI v1 image API" Jun 08 12:09:25.269246 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.269221 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 12:09:25.271627 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.271606 2584 fs.go:135] Filesystem UUIDs: map[610e783f-acb6-450b-b0a3-2a41d678157b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 93d669b0-b4e3-4fc6-a7f2-867cbb118f30:/dev/nvme0n1p3] Jun 08 12:09:25.271689 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.271626 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 12:09:25.277444 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.277330 2584 manager.go:216] Machine: {Timestamp:2026-06-08 12:09:25.275998064 +0000 UTC m=+0.337123356 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101132 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec295982b50b600b6c92f434a9e0bce1 SystemUUID:ec295982-b50b-600b-6c92-f434a9e0bce1 BootID:547f0ecc-85c8-47e6-afd3-ccb68064179c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cf:83:97:91:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cf:83:97:91:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:1c:1f:c0:96:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 12:09:25.277444 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.277438 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 12:09:25.277556 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.277520 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 12:09:25.278443 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.278427 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:09:25.280358 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.280329 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 12:09:25.280498 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.280362 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-216.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 12:09:25.281048 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.281037 2584 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 12:09:25.281085 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.281051 2584 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 12:09:25.281085 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.281058 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:09:25.281984 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.281960 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:09:25.282648 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.282638 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 12:09:25.285254 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.285241 2584 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:09:25.285373 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.285364 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 12:09:25.285403 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.285397 2584 kubelet.go:486] "Attempting to sync node with API server" Jun 08 12:09:25.285429 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.285408 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 12:09:25.285429 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.285422 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 12:09:25.285488 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.285433 2584 kubelet.go:398] "Adding apiserver pod source" Jun 08 12:09:25.285488 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.285442 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 12:09:25.285823 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.285812 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:09:25.288922 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.285832 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:09:25.288922 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.287946 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 12:09:25.289417 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.289404 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 12:09:25.289454 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.289434 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 12:09:25.289958 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.289948 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 12:09:25.290009 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.289964 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 12:09:25.290009 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.289990 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 12:09:25.290009 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.289998 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 12:09:25.290009 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.290008 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 12:09:25.290111 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.290015 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 12:09:25.290111 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.290110 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 12:09:25.290164 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.290117 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 12:09:25.290164 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.290127 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 12:09:25.290164 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.290133 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 12:09:25.290164 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.290149 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 12:09:25.290164 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.290159 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 12:09:25.290938 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.290926 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 12:09:25.290967 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.290942 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 12:09:25.294476 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.294463 2584 server.go:1268] "Started kubelet" Jun 08 12:09:25.294641 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.294552 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 12:09:25.294713 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.294583 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 12:09:25.294764 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.294721 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 12:09:25.295469 ip-10-0-136-216 systemd[1]: Started Kubernetes Kubelet. Jun 08 12:09:25.299338 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.295995 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 12:09:25.299560 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.299537 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 12:09:25.299651 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.299587 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 12:09:25.299744 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.299722 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-216.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 12:09:25.300748 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.300726 2584 server.go:310] "Adding debug handlers to kubelet server" Jun 08 12:09:25.302366 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.302347 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 12:09:25.305663 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.305644 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 12:09:25.305749 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.305662 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 12:09:25.306049 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.305825 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-216.ec2.internal\" not found" Jun 08 12:09:25.306286 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306264 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 12:09:25.306358 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306258 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 12:09:25.306358 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306290 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 12:09:25.306491 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306444 2584 factory.go:55] Registering systemd factory Jun 08 12:09:25.306491 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306459 2584 factory.go:223] Registration of the systemd container factory successfully Jun 08 12:09:25.306491 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306463 2584 reconstruct.go:97] "Volume reconstruction finished" Jun 08 12:09:25.306491 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306472 2584 reconciler.go:29] "Reconciler: start to sync state" Jun 08 12:09:25.306684 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306667 2584 factory.go:153] Registering CRI-O factory Jun 08 12:09:25.306747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306687 2584 factory.go:223] Registration of the crio container factory successfully Jun 08 12:09:25.306747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306740 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 12:09:25.306842 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306761 2584 factory.go:103] Registering Raw factory Jun 08 12:09:25.306842 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.306771 2584 manager.go:1196] Started watching for new ooms in manager Jun 08 12:09:25.306842 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.305481 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-216.ec2.internal.18b719d183901d2b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-216.ec2.internal,UID:ip-10-0-136-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-216.ec2.internal,},FirstTimestamp:2026-06-08 12:09:25.294439723 +0000 UTC m=+0.355564887,LastTimestamp:2026-06-08 12:09:25.294439723 +0000 UTC m=+0.355564887,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-216.ec2.internal,}" Jun 08 12:09:25.307175 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.307160 2584 manager.go:349] Starting recovery of all containers Jun 08 12:09:25.311919 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.311889 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 12:09:25.311919 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.311905 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 12:09:25.319721 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.319703 2584 manager.go:354] Recovery completed Jun 08 12:09:25.323700 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.323688 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:25.325562 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.325541 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:25.325640 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.325581 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:25.325640 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.325598 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:25.325749 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.325736 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-989v7" Jun 08 12:09:25.326202 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.326191 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 12:09:25.326255 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.326202 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 12:09:25.326255 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.326218 2584 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:09:25.326366 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.326351 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:25.326970 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.326954 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:25.327046 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.327012 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:25.327046 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.327023 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:25.327265 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.327253 2584 policy_none.go:49] "None policy: Start" Jun 08 12:09:25.327295 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.327272 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 12:09:25.327295 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.327285 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 12:09:25.327543 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.327480 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-216.ec2.internal.18b719d1856afb5e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-216.ec2.internal,UID:ip-10-0-136-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-216.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-216.ec2.internal,},FirstTimestamp:2026-06-08 12:09:25.32556067 +0000 UTC m=+0.386685838,LastTimestamp:2026-06-08 12:09:25.32556067 +0000 UTC m=+0.386685838,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-216.ec2.internal,}" Jun 08 12:09:25.328157 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.328143 2584 policy_none.go:47] "Start" Jun 08 12:09:25.334228 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.334212 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-989v7" Jun 08 12:09:25.337933 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.337806 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-216.ec2.internal.18b719d1856b6758 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-216.ec2.internal,UID:ip-10-0-136-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-216.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-216.ec2.internal,},FirstTimestamp:2026-06-08 12:09:25.325588312 +0000 UTC m=+0.386713478,LastTimestamp:2026-06-08 12:09:25.325588312 +0000 UTC m=+0.386713478,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-216.ec2.internal,}" Jun 08 12:09:25.370698 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.370679 2584 manager.go:337] "Starting Device Plugin manager" Jun 08 12:09:25.374032 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.370712 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 12:09:25.374032 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.370722 2584 server.go:87] "Starting device plugin registration server" Jun 08 12:09:25.374032 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.370956 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 12:09:25.374032 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.370966 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 12:09:25.374032 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.371057 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 12:09:25.374032 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.371139 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 12:09:25.374032 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.371148 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 12:09:25.374032 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.371721 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 12:09:25.374032 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.371774 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-216.ec2.internal\" not found" Jun 08 12:09:25.374032 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.373540 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 12:09:25.374911 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.374894 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 12:09:25.374957 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.374929 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 12:09:25.374957 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.374953 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 12:09:25.375094 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.375010 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 12:09:25.377470 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.377451 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:25.471475 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.471442 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:25.473355 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.473332 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:25.473445 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.473370 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:25.473445 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.473382 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:25.473445 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.473408 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.475522 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.475480 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-216.ec2.internal"] Jun 08 12:09:25.475566 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.475542 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:25.476355 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.476337 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:25.476421 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.476370 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:25.476421 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.476387 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:25.477649 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.477636 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:25.477814 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.477799 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.477888 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.477832 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:25.478377 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.478358 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:25.478377 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.478368 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:25.478377 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.478382 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:25.478551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.478388 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:25.478551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.478392 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:25.478551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.478398 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:25.479556 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.479543 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.479597 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.479566 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:25.480214 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.480195 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:25.480331 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.480222 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:25.480331 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.480235 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:25.484701 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.484444 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.484701 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.484467 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-216.ec2.internal\": node \"ip-10-0-136-216.ec2.internal\" not found" Jun 08 12:09:25.501513 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.501489 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-216.ec2.internal\" not found" node="ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.505900 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.505875 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-216.ec2.internal\" not found" node="ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.507887 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.507870 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f3e47c058cd4c962a3b249e2ee78a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal\" (UID: \"f8f3e47c058cd4c962a3b249e2ee78a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.507994 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.507900 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b691406e1e053ba364f9fbf30fa94f31-config\") pod \"kube-apiserver-proxy-ip-10-0-136-216.ec2.internal\" (UID: \"b691406e1e053ba364f9fbf30fa94f31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.507994 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.507926 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8f3e47c058cd4c962a3b249e2ee78a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal\" (UID: \"f8f3e47c058cd4c962a3b249e2ee78a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.513552 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.513534 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-216.ec2.internal\" not found" Jun 08 12:09:25.608104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.608074 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8f3e47c058cd4c962a3b249e2ee78a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal\" (UID: \"f8f3e47c058cd4c962a3b249e2ee78a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.608104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.608105 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f3e47c058cd4c962a3b249e2ee78a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal\" (UID: \"f8f3e47c058cd4c962a3b249e2ee78a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.608274 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.608121 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b691406e1e053ba364f9fbf30fa94f31-config\") pod \"kube-apiserver-proxy-ip-10-0-136-216.ec2.internal\" (UID: \"b691406e1e053ba364f9fbf30fa94f31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.608274 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.608179 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b691406e1e053ba364f9fbf30fa94f31-config\") pod \"kube-apiserver-proxy-ip-10-0-136-216.ec2.internal\" (UID: \"b691406e1e053ba364f9fbf30fa94f31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.608274 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.608193 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f3e47c058cd4c962a3b249e2ee78a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal\" (UID: \"f8f3e47c058cd4c962a3b249e2ee78a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.608274 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.608193 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8f3e47c058cd4c962a3b249e2ee78a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal\" (UID: \"f8f3e47c058cd4c962a3b249e2ee78a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.614214 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.614183 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-216.ec2.internal\" not found" Jun 08 12:09:25.714708 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.714681 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-216.ec2.internal\" not found" Jun 08 12:09:25.805242 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.805175 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.809701 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:25.809682 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-216.ec2.internal" Jun 08 12:09:25.815436 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.815402 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-216.ec2.internal\" not found" Jun 08 12:09:25.916012 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:25.915954 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-216.ec2.internal\" not found" Jun 08 12:09:26.016581 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.016545 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-216.ec2.internal\" not found" Jun 08 12:09:26.117127 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.117040 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-216.ec2.internal\" not found" Jun 08 12:09:26.131673 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.131651 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:26.206831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.206798 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" Jun 08 12:09:26.220669 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.220646 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:09:26.222456 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.222442 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-216.ec2.internal" Jun 08 12:09:26.232558 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.232535 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:09:26.245679 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.245649 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 12:09:26.245787 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.245769 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 12:09:26.245833 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.245813 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 12:09:26.285990 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.285949 2584 apiserver.go:52] "Watching apiserver" Jun 08 12:09:26.301778 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.301751 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 12:09:26.302891 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.302868 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw","openshift-image-registry/node-ca-sftwv","openshift-multus/multus-k5lj7","openshift-multus/network-metrics-daemon-vdsvw","openshift-network-diagnostics/network-check-target-chx9n","openshift-ovn-kubernetes/ovnkube-node-kt29v","kube-system/global-pull-secret-syncer-kz97q","openshift-cluster-node-tuning-operator/tuned-7gmmc","openshift-dns/node-resolver-hv8xt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal","openshift-multus/multus-additional-cni-plugins-kbzz9","openshift-network-operator/iptables-alerter-m64c9","kube-system/konnectivity-agent-pncd7","kube-system/kube-apiserver-proxy-ip-10-0-136-216.ec2.internal"] Jun 08 12:09:26.304089 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.304062 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:26.304168 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.304135 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:26.304867 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.304849 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:26.305847 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.305829 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 12:09:26.305847 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.305839 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.308249 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.307731 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nj8ng\"" Jun 08 12:09:26.308336 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.308314 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 12:09:26.308478 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.308449 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 12:09:26.309864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.308646 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 12:09:26.309864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.308693 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 12:09:26.309864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.308774 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-brnhl\"" Jun 08 12:09:26.309864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.308875 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 12:09:26.309864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.309049 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 12:09:26.309864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.309067 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:26.309864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.309188 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:26.309864 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.309363 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:26.309864 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.309392 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:26.310507 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.310472 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-hostroot\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.310700 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.310678 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-run-multus-certs\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.310799 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.310721 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qcbd\" (UniqueName: \"kubernetes.io/projected/69b18e3e-e679-4903-968a-ccaa1a6e893e-kube-api-access-4qcbd\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.310799 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.310757 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-cnibin\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.310902 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.310802 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-os-release\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.310902 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.310886 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-socket-dir-parent\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311216 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311199 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-run-netns\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311276 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311238 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-var-lib-cni-bin\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311276 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311266 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55h7s\" (UniqueName: \"kubernetes.io/projected/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-kube-api-access-55h7s\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:26.311374 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311294 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1b88c71-84c8-4caa-b7ae-0911683f1008-agent-certs\") pod \"konnectivity-agent-pncd7\" (UID: \"a1b88c71-84c8-4caa-b7ae-0911683f1008\") " pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:26.311374 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311319 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1b88c71-84c8-4caa-b7ae-0911683f1008-konnectivity-ca\") pod \"konnectivity-agent-pncd7\" (UID: \"a1b88c71-84c8-4caa-b7ae-0911683f1008\") " pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:26.311374 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311342 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-cni-dir\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311374 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311350 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.311374 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311369 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-run-k8s-cni-cncf-io\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311606 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311398 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-conf-dir\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311606 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311420 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-daemon-config\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311606 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311441 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:26.311606 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311464 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc2566b6-1a94-4bd2-bea1-10852ae45061-kubelet-config\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:26.311606 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311490 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-system-cni-dir\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311606 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311512 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69b18e3e-e679-4903-968a-ccaa1a6e893e-cni-binary-copy\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311606 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311537 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-var-lib-cni-multus\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311606 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311563 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-var-lib-kubelet\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311606 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311585 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-etc-kubernetes\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.311913 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311623 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc2566b6-1a94-4bd2-bea1-10852ae45061-dbus\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:26.311913 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.311647 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:26.312539 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.312517 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hv8xt" Jun 08 12:09:26.313110 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.313092 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 12:09:26.313554 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.313534 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 12:09:26.313639 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.313556 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 12:09:26.313639 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.313542 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5dj5v\"" Jun 08 12:09:26.313639 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.313594 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.314300 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.314278 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 12:09:26.314300 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.314292 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 12:09:26.314497 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.314343 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 12:09:26.314497 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.314348 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-74gqk\"" Jun 08 12:09:26.314622 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.314605 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sftwv" Jun 08 12:09:26.314692 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.314614 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 12:09:26.315037 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.315024 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 12:09:26.315567 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.315530 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tcv6g\"" Jun 08 12:09:26.315668 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.315603 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 12:09:26.315773 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.315719 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.316131 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.316109 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 12:09:26.316234 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.316119 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 12:09:26.316714 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.316701 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 12:09:26.317075 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.317059 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.317294 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.317210 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2xlng\"" Jun 08 12:09:26.317294 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.317254 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 12:09:26.317565 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.317549 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 12:09:26.318097 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.318080 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 12:09:26.318097 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.318095 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-glr2l\"" Jun 08 12:09:26.318229 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.318080 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:09:26.318229 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.318119 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:09:26.318420 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.318402 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m64c9" Jun 08 12:09:26.319035 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.318964 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7bz8k\"" Jun 08 12:09:26.319181 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.319165 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 12:09:26.319246 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.319233 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 12:09:26.320380 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.320361 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 12:09:26.320628 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.320614 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9srp2\"" Jun 08 12:09:26.320762 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.320745 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:09:26.320926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.320890 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 12:09:26.336646 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.336603 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 12:04:25 +0000 UTC" deadline="2027-11-05 17:59:44.695135737 +0000 UTC" Jun 08 12:09:26.336646 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.336643 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12365h50m18.358496615s" Jun 08 12:09:26.341378 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.341356 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbr5z" Jun 08 12:09:26.351233 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.351211 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbr5z" Jun 08 12:09:26.407175 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.407153 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 12:09:26.412631 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412604 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-cni-dir\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.412631 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412631 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-node-log\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.412814 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412651 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-cni-bin\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.412814 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412673 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-ovnkube-config\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.412814 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412704 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-cni-dir\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.412814 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412721 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6knkl\" (UniqueName: \"kubernetes.io/projected/ee2b4d11-85ce-48f3-aaf4-2bf19efeb291-kube-api-access-6knkl\") pod \"node-resolver-hv8xt\" (UID: \"ee2b4d11-85ce-48f3-aaf4-2bf19efeb291\") " pod="openshift-dns/node-resolver-hv8xt" Jun 08 12:09:26.412814 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412754 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-var-lib-kubelet\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.412814 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412777 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc2566b6-1a94-4bd2-bea1-10852ae45061-dbus\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:26.412814 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412795 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.412814 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412810 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/07032d7f-d6b8-4655-bbf6-4bcec05ab66b-serviceca\") pod \"node-ca-sftwv\" (UID: \"07032d7f-d6b8-4655-bbf6-4bcec05ab66b\") " pod="openshift-image-registry/node-ca-sftwv" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412828 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ksjk\" (UniqueName: \"kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk\") pod \"network-check-target-chx9n\" (UID: \"f22d64d7-163e-4ada-9869-d53b62eaca3f\") " pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412832 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-var-lib-kubelet\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412852 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-run-multus-certs\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412891 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-run-multus-certs\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412903 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qcbd\" (UniqueName: \"kubernetes.io/projected/69b18e3e-e679-4903-968a-ccaa1a6e893e-kube-api-access-4qcbd\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412934 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc2566b6-1a94-4bd2-bea1-10852ae45061-dbus\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412945 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-device-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.412970 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-sysctl-conf\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413010 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413029 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-var-lib-cni-bin\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413049 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55h7s\" (UniqueName: \"kubernetes.io/projected/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-kube-api-access-55h7s\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413091 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-run\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413119 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-system-cni-dir\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413143 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-var-lib-openvswitch\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413165 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-var-lib-cni-bin\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413169 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-run-k8s-cni-cncf-io\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.413204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413202 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-run-k8s-cni-cncf-io\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413207 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-conf-dir\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413246 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413282 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07032d7f-d6b8-4655-bbf6-4bcec05ab66b-host\") pod \"node-ca-sftwv\" (UID: \"07032d7f-d6b8-4655-bbf6-4bcec05ab66b\") " pod="openshift-image-registry/node-ca-sftwv" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413300 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vln8c\" (UniqueName: \"kubernetes.io/projected/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-kube-api-access-vln8c\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413312 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-conf-dir\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413347 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-run-systemd\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413380 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-env-overrides\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.413391 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413411 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-ovnkube-script-lib\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413465 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-var-lib-cni-multus\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.413485 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret podName:dc2566b6-1a94-4bd2-bea1-10852ae45061 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:26.913458468 +0000 UTC m=+1.974583636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret") pod "global-pull-secret-syncer-kz97q" (UID: "dc2566b6-1a94-4bd2-bea1-10852ae45061") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413519 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-var-lib-cni-multus\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413545 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-etc-kubernetes\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413566 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-kubelet\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413593 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-etc-kubernetes\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413598 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-registration-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.414010 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413624 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-sysctl-d\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413644 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-sys\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413688 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-slash\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413738 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-etc-openvswitch\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413762 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zrcc\" (UniqueName: \"kubernetes.io/projected/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-kube-api-access-4zrcc\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413785 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee2b4d11-85ce-48f3-aaf4-2bf19efeb291-tmp-dir\") pod \"node-resolver-hv8xt\" (UID: \"ee2b4d11-85ce-48f3-aaf4-2bf19efeb291\") " pod="openshift-dns/node-resolver-hv8xt" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413824 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-os-release\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413848 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-cnibin\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413871 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/079697c1-565d-4f5a-a03f-c52588d0f1e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413893 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-log-socket\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413901 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-os-release\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413915 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1b88c71-84c8-4caa-b7ae-0911683f1008-agent-certs\") pod \"konnectivity-agent-pncd7\" (UID: \"a1b88c71-84c8-4caa-b7ae-0911683f1008\") " pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413940 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1b88c71-84c8-4caa-b7ae-0911683f1008-konnectivity-ca\") pod \"konnectivity-agent-pncd7\" (UID: \"a1b88c71-84c8-4caa-b7ae-0911683f1008\") " pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.413963 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-daemon-config\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414019 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-lib-modules\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414045 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg69l\" (UniqueName: \"kubernetes.io/projected/079697c1-565d-4f5a-a03f-c52588d0f1e8-kube-api-access-hg69l\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414067 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-systemd-units\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.414837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414088 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-system-cni-dir\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414111 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69b18e3e-e679-4903-968a-ccaa1a6e893e-cni-binary-copy\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414136 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-modprobe-d\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414167 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/079697c1-565d-4f5a-a03f-c52588d0f1e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414191 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-run-ovn\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414233 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414245 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414269 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-sys-fs\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414291 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl24c\" (UniqueName: \"kubernetes.io/projected/07032d7f-d6b8-4655-bbf6-4bcec05ab66b-kube-api-access-kl24c\") pod \"node-ca-sftwv\" (UID: \"07032d7f-d6b8-4655-bbf6-4bcec05ab66b\") " pod="openshift-image-registry/node-ca-sftwv" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414315 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/079697c1-565d-4f5a-a03f-c52588d0f1e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414338 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-run-netns\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414362 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-ovn-node-metrics-cert\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414397 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-run-netns\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414420 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-var-lib-kubelet\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414442 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-tuned\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414480 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414507 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:26.415745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414506 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1b88c71-84c8-4caa-b7ae-0911683f1008-konnectivity-ca\") pod \"konnectivity-agent-pncd7\" (UID: \"a1b88c71-84c8-4caa-b7ae-0911683f1008\") " pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414531 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc2566b6-1a94-4bd2-bea1-10852ae45061-kubelet-config\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414559 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjc6c\" (UniqueName: \"kubernetes.io/projected/881fee84-8266-473e-aeb0-47997bb6b2df-kube-api-access-zjc6c\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414596 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-systemd\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414623 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqknl\" (UniqueName: \"kubernetes.io/projected/e4d31a2f-c538-486c-9c34-f46dde14f171-kube-api-access-wqknl\") pod \"iptables-alerter-m64c9\" (UID: \"e4d31a2f-c538-486c-9c34-f46dde14f171\") " pod="openshift-network-operator/iptables-alerter-m64c9" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414646 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-run-openvswitch\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414676 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-cni-netd\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414792 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-host-run-netns\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414821 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-sysconfig\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414844 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-host\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414885 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4d31a2f-c538-486c-9c34-f46dde14f171-host-slash\") pod \"iptables-alerter-m64c9\" (UID: \"e4d31a2f-c538-486c-9c34-f46dde14f171\") " pod="openshift-network-operator/iptables-alerter-m64c9" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414906 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee2b4d11-85ce-48f3-aaf4-2bf19efeb291-hosts-file\") pod \"node-resolver-hv8xt\" (UID: \"ee2b4d11-85ce-48f3-aaf4-2bf19efeb291\") " pod="openshift-dns/node-resolver-hv8xt" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.414935 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-hostroot\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415020 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-kubernetes\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415047 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-tmp\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415072 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4d31a2f-c538-486c-9c34-f46dde14f171-iptables-alerter-script\") pod \"iptables-alerter-m64c9\" (UID: \"e4d31a2f-c538-486c-9c34-f46dde14f171\") " pod="openshift-network-operator/iptables-alerter-m64c9" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415090 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-system-cni-dir\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.416266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415097 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415123 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-cnibin\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415149 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-socket-dir-parent\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415174 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-socket-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.415302 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415306 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-os-release\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415187 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc2566b6-1a94-4bd2-bea1-10852ae45061-kubelet-config\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415223 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-hostroot\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.415353 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs podName:ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b nodeName:}" failed. No retries permitted until 2026-06-08 12:09:26.915337366 +0000 UTC m=+1.976462516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs") pod "network-metrics-daemon-vdsvw" (UID: "ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415399 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-socket-dir-parent\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415443 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69b18e3e-e679-4903-968a-ccaa1a6e893e-cnibin\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415510 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69b18e3e-e679-4903-968a-ccaa1a6e893e-multus-daemon-config\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.416747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.415512 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69b18e3e-e679-4903-968a-ccaa1a6e893e-cni-binary-copy\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.417359 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.417344 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1b88c71-84c8-4caa-b7ae-0911683f1008-agent-certs\") pod \"konnectivity-agent-pncd7\" (UID: \"a1b88c71-84c8-4caa-b7ae-0911683f1008\") " pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:26.421623 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.421605 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55h7s\" (UniqueName: \"kubernetes.io/projected/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-kube-api-access-55h7s\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:26.421924 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.421907 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qcbd\" (UniqueName: \"kubernetes.io/projected/69b18e3e-e679-4903-968a-ccaa1a6e893e-kube-api-access-4qcbd\") pod \"multus-k5lj7\" (UID: \"69b18e3e-e679-4903-968a-ccaa1a6e893e\") " pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.461394 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:26.461349 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb691406e1e053ba364f9fbf30fa94f31.slice/crio-73ac53cacf36e10105c47d2f86e5acc273010997ef842bf7e8cb92090b071990 WatchSource:0}: Error finding container 73ac53cacf36e10105c47d2f86e5acc273010997ef842bf7e8cb92090b071990: Status 404 returned error can't find the container with id 73ac53cacf36e10105c47d2f86e5acc273010997ef842bf7e8cb92090b071990 Jun 08 12:09:26.461614 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:26.461591 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f3e47c058cd4c962a3b249e2ee78a5.slice/crio-b59ed853b842b76a339441376ee668bf3e7af041b74c0c3de6805742d9d38f31 WatchSource:0}: Error finding container b59ed853b842b76a339441376ee668bf3e7af041b74c0c3de6805742d9d38f31: Status 404 returned error can't find the container with id b59ed853b842b76a339441376ee668bf3e7af041b74c0c3de6805742d9d38f31 Jun 08 12:09:26.465783 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.465645 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:26.466337 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.466322 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:09:26.516442 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516412 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-ovnkube-config\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.516442 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516448 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6knkl\" (UniqueName: \"kubernetes.io/projected/ee2b4d11-85ce-48f3-aaf4-2bf19efeb291-kube-api-access-6knkl\") pod \"node-resolver-hv8xt\" (UID: \"ee2b4d11-85ce-48f3-aaf4-2bf19efeb291\") " pod="openshift-dns/node-resolver-hv8xt" Jun 08 12:09:26.516669 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516474 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.516669 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516550 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.516669 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516598 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/07032d7f-d6b8-4655-bbf6-4bcec05ab66b-serviceca\") pod \"node-ca-sftwv\" (UID: \"07032d7f-d6b8-4655-bbf6-4bcec05ab66b\") " pod="openshift-image-registry/node-ca-sftwv" Jun 08 12:09:26.516669 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516632 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ksjk\" (UniqueName: \"kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk\") pod \"network-check-target-chx9n\" (UID: \"f22d64d7-163e-4ada-9869-d53b62eaca3f\") " pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:26.516669 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516653 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-device-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.516926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516702 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-device-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.516926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516755 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-sysctl-conf\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.516926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516783 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.516926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516810 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-run\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.516926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516832 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-system-cni-dir\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.516926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516856 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.516926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516873 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-var-lib-openvswitch\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.516926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516894 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-sysctl-conf\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.516926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516903 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-system-cni-dir\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.516926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516906 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-run\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.516926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516936 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07032d7f-d6b8-4655-bbf6-4bcec05ab66b-host\") pod \"node-ca-sftwv\" (UID: \"07032d7f-d6b8-4655-bbf6-4bcec05ab66b\") " pod="openshift-image-registry/node-ca-sftwv" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516954 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln8c\" (UniqueName: \"kubernetes.io/projected/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-kube-api-access-vln8c\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516939 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-var-lib-openvswitch\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516967 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07032d7f-d6b8-4655-bbf6-4bcec05ab66b-host\") pod \"node-ca-sftwv\" (UID: \"07032d7f-d6b8-4655-bbf6-4bcec05ab66b\") " pod="openshift-image-registry/node-ca-sftwv" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.516994 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-run-systemd\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517025 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-run-systemd\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517029 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-env-overrides\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517055 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-ovnkube-script-lib\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517073 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-ovnkube-config\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517080 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/07032d7f-d6b8-4655-bbf6-4bcec05ab66b-serviceca\") pod \"node-ca-sftwv\" (UID: \"07032d7f-d6b8-4655-bbf6-4bcec05ab66b\") " pod="openshift-image-registry/node-ca-sftwv" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517081 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-kubelet\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517117 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-kubelet\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517142 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-registration-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517161 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-sysctl-d\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517176 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-sys\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517195 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-slash\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517217 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-etc-openvswitch\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517236 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zrcc\" (UniqueName: \"kubernetes.io/projected/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-kube-api-access-4zrcc\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.517541 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517253 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-etc-openvswitch\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517255 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-slash\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517255 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee2b4d11-85ce-48f3-aaf4-2bf19efeb291-tmp-dir\") pod \"node-resolver-hv8xt\" (UID: \"ee2b4d11-85ce-48f3-aaf4-2bf19efeb291\") " pod="openshift-dns/node-resolver-hv8xt" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517298 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-cnibin\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517313 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-sysctl-d\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517256 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-registration-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/079697c1-565d-4f5a-a03f-c52588d0f1e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517361 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-log-socket\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517375 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-cnibin\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517390 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-lib-modules\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517417 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg69l\" (UniqueName: \"kubernetes.io/projected/079697c1-565d-4f5a-a03f-c52588d0f1e8-kube-api-access-hg69l\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517422 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-log-socket\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517439 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-env-overrides\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517443 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-systemd-units\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517479 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-systemd-units\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517483 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-modprobe-d\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517513 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/079697c1-565d-4f5a-a03f-c52588d0f1e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.518362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517520 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-lib-modules\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517536 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee2b4d11-85ce-48f3-aaf4-2bf19efeb291-tmp-dir\") pod \"node-resolver-hv8xt\" (UID: \"ee2b4d11-85ce-48f3-aaf4-2bf19efeb291\") " pod="openshift-dns/node-resolver-hv8xt" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517549 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-run-ovn\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517578 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517552 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-modprobe-d\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517602 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-sys-fs\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517606 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-run-ovn\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517612 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-ovnkube-script-lib\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517626 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl24c\" (UniqueName: \"kubernetes.io/projected/07032d7f-d6b8-4655-bbf6-4bcec05ab66b-kube-api-access-kl24c\") pod \"node-ca-sftwv\" (UID: \"07032d7f-d6b8-4655-bbf6-4bcec05ab66b\") " pod="openshift-image-registry/node-ca-sftwv" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517638 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517655 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-sys-fs\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517664 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/079697c1-565d-4f5a-a03f-c52588d0f1e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517713 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-run-netns\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517739 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-ovn-node-metrics-cert\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517767 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-run-netns\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517768 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-var-lib-kubelet\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517839 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-var-lib-kubelet\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.519066 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517845 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-tuned\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517852 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/079697c1-565d-4f5a-a03f-c52588d0f1e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517870 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517891 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-sys\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517909 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjc6c\" (UniqueName: \"kubernetes.io/projected/881fee84-8266-473e-aeb0-47997bb6b2df-kube-api-access-zjc6c\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517935 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-systemd\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517942 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/079697c1-565d-4f5a-a03f-c52588d0f1e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.517957 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqknl\" (UniqueName: \"kubernetes.io/projected/e4d31a2f-c538-486c-9c34-f46dde14f171-kube-api-access-wqknl\") pod \"iptables-alerter-m64c9\" (UID: \"e4d31a2f-c538-486c-9c34-f46dde14f171\") " pod="openshift-network-operator/iptables-alerter-m64c9" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518001 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-run-openvswitch\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518242 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-cni-netd\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518262 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-sysconfig\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518276 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-host\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518293 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4d31a2f-c538-486c-9c34-f46dde14f171-host-slash\") pod \"iptables-alerter-m64c9\" (UID: \"e4d31a2f-c538-486c-9c34-f46dde14f171\") " pod="openshift-network-operator/iptables-alerter-m64c9" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518312 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee2b4d11-85ce-48f3-aaf4-2bf19efeb291-hosts-file\") pod \"node-resolver-hv8xt\" (UID: \"ee2b4d11-85ce-48f3-aaf4-2bf19efeb291\") " pod="openshift-dns/node-resolver-hv8xt" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518015 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-systemd\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518111 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518183 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/079697c1-565d-4f5a-a03f-c52588d0f1e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.519528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518345 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-cni-netd\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518353 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-sysconfig\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518149 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-run-openvswitch\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518334 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-kubernetes\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518389 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-host\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518386 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-kubernetes\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518412 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-tmp\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518438 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4d31a2f-c538-486c-9c34-f46dde14f171-iptables-alerter-script\") pod \"iptables-alerter-m64c9\" (UID: \"e4d31a2f-c538-486c-9c34-f46dde14f171\") " pod="openshift-network-operator/iptables-alerter-m64c9" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518446 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee2b4d11-85ce-48f3-aaf4-2bf19efeb291-hosts-file\") pod \"node-resolver-hv8xt\" (UID: \"ee2b4d11-85ce-48f3-aaf4-2bf19efeb291\") " pod="openshift-dns/node-resolver-hv8xt" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518415 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4d31a2f-c538-486c-9c34-f46dde14f171-host-slash\") pod \"iptables-alerter-m64c9\" (UID: \"e4d31a2f-c538-486c-9c34-f46dde14f171\") " pod="openshift-network-operator/iptables-alerter-m64c9" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518464 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518501 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-socket-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518543 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518575 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-os-release\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518605 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-node-log\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518642 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-cni-bin\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518698 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/079697c1-565d-4f5a-a03f-c52588d0f1e8-os-release\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.520002 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518713 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-host-cni-bin\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.520557 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518752 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-node-log\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.520557 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.518695 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/881fee84-8266-473e-aeb0-47997bb6b2df-socket-dir\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.520557 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.519127 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4d31a2f-c538-486c-9c34-f46dde14f171-iptables-alerter-script\") pod \"iptables-alerter-m64c9\" (UID: \"e4d31a2f-c538-486c-9c34-f46dde14f171\") " pod="openshift-network-operator/iptables-alerter-m64c9" Jun 08 12:09:26.520557 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.520501 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-tmp\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.520711 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.520582 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-etc-tuned\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.520711 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.520628 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-ovn-node-metrics-cert\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.523023 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.523002 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:26.523023 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.523025 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:26.523180 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.523039 2584 projected.go:196] Error preparing data for projected volume kube-api-access-4ksjk for pod openshift-network-diagnostics/network-check-target-chx9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:26.523180 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.523096 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk podName:f22d64d7-163e-4ada-9869-d53b62eaca3f nodeName:}" failed. No retries permitted until 2026-06-08 12:09:27.023077715 +0000 UTC m=+2.084202889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4ksjk" (UniqueName: "kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk") pod "network-check-target-chx9n" (UID: "f22d64d7-163e-4ada-9869-d53b62eaca3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:26.525781 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.525751 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg69l\" (UniqueName: \"kubernetes.io/projected/079697c1-565d-4f5a-a03f-c52588d0f1e8-kube-api-access-hg69l\") pod \"multus-additional-cni-plugins-kbzz9\" (UID: \"079697c1-565d-4f5a-a03f-c52588d0f1e8\") " pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.526540 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.526239 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqknl\" (UniqueName: \"kubernetes.io/projected/e4d31a2f-c538-486c-9c34-f46dde14f171-kube-api-access-wqknl\") pod \"iptables-alerter-m64c9\" (UID: \"e4d31a2f-c538-486c-9c34-f46dde14f171\") " pod="openshift-network-operator/iptables-alerter-m64c9" Jun 08 12:09:26.526540 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.526288 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6knkl\" (UniqueName: \"kubernetes.io/projected/ee2b4d11-85ce-48f3-aaf4-2bf19efeb291-kube-api-access-6knkl\") pod \"node-resolver-hv8xt\" (UID: \"ee2b4d11-85ce-48f3-aaf4-2bf19efeb291\") " pod="openshift-dns/node-resolver-hv8xt" Jun 08 12:09:26.526540 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.526501 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl24c\" (UniqueName: \"kubernetes.io/projected/07032d7f-d6b8-4655-bbf6-4bcec05ab66b-kube-api-access-kl24c\") pod \"node-ca-sftwv\" (UID: \"07032d7f-d6b8-4655-bbf6-4bcec05ab66b\") " pod="openshift-image-registry/node-ca-sftwv" Jun 08 12:09:26.526860 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.526840 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjc6c\" (UniqueName: \"kubernetes.io/projected/881fee84-8266-473e-aeb0-47997bb6b2df-kube-api-access-zjc6c\") pod \"aws-ebs-csi-driver-node-8wccw\" (UID: \"881fee84-8266-473e-aeb0-47997bb6b2df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.527124 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.527103 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zrcc\" (UniqueName: \"kubernetes.io/projected/24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b-kube-api-access-4zrcc\") pod \"ovnkube-node-kt29v\" (UID: \"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.527180 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.527110 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vln8c\" (UniqueName: \"kubernetes.io/projected/fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37-kube-api-access-vln8c\") pod \"tuned-7gmmc\" (UID: \"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37\") " pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.642340 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.642261 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:26.651251 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:26.651226 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b88c71_84c8_4caa_b7ae_0911683f1008.slice/crio-e0fbc0f0a93af4b0059b2beb837b4ab7d75ef5af31a5858e58de076d1acd01b5 WatchSource:0}: Error finding container e0fbc0f0a93af4b0059b2beb837b4ab7d75ef5af31a5858e58de076d1acd01b5: Status 404 returned error can't find the container with id e0fbc0f0a93af4b0059b2beb837b4ab7d75ef5af31a5858e58de076d1acd01b5 Jun 08 12:09:26.659319 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.659299 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k5lj7" Jun 08 12:09:26.666729 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:26.666700 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b18e3e_e679_4903_968a_ccaa1a6e893e.slice/crio-5576cf554a737c80101bc4830efd48a56d4d474d2ce318ef5204300e89bc4d81 WatchSource:0}: Error finding container 5576cf554a737c80101bc4830efd48a56d4d474d2ce318ef5204300e89bc4d81: Status 404 returned error can't find the container with id 5576cf554a737c80101bc4830efd48a56d4d474d2ce318ef5204300e89bc4d81 Jun 08 12:09:26.680311 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.680272 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:26.694001 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.693962 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hv8xt" Jun 08 12:09:26.700773 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:26.700746 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2b4d11_85ce_48f3_aaf4_2bf19efeb291.slice/crio-333a5d2193f3802ec964b0b12aa3302a0f5f9a6a36dc85bb9b6809ac9cfc1446 WatchSource:0}: Error finding container 333a5d2193f3802ec964b0b12aa3302a0f5f9a6a36dc85bb9b6809ac9cfc1446: Status 404 returned error can't find the container with id 333a5d2193f3802ec964b0b12aa3302a0f5f9a6a36dc85bb9b6809ac9cfc1446 Jun 08 12:09:26.711619 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.711596 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" Jun 08 12:09:26.718901 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:26.718874 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881fee84_8266_473e_aeb0_47997bb6b2df.slice/crio-b991cb242015156e10262af3227a6747c9a97ed06563c1d0eda5ceec2b07384c WatchSource:0}: Error finding container b991cb242015156e10262af3227a6747c9a97ed06563c1d0eda5ceec2b07384c: Status 404 returned error can't find the container with id b991cb242015156e10262af3227a6747c9a97ed06563c1d0eda5ceec2b07384c Jun 08 12:09:26.732115 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.732094 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sftwv" Jun 08 12:09:26.739401 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:26.739383 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07032d7f_d6b8_4655_bbf6_4bcec05ab66b.slice/crio-668fbb8fc2208267f08d977fce0d584f2b0bb9b35954c78de82cb763a414a5a7 WatchSource:0}: Error finding container 668fbb8fc2208267f08d977fce0d584f2b0bb9b35954c78de82cb763a414a5a7: Status 404 returned error can't find the container with id 668fbb8fc2208267f08d977fce0d584f2b0bb9b35954c78de82cb763a414a5a7 Jun 08 12:09:26.745392 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.745372 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" Jun 08 12:09:26.751704 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:26.751681 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac0d1ad_0eb3_47a3_a3db_53e78dbdcd37.slice/crio-7d86ed6ad17add7439511a869206dcce0d8c8bcc578d1c7bec64e49eecf8f027 WatchSource:0}: Error finding container 7d86ed6ad17add7439511a869206dcce0d8c8bcc578d1c7bec64e49eecf8f027: Status 404 returned error can't find the container with id 7d86ed6ad17add7439511a869206dcce0d8c8bcc578d1c7bec64e49eecf8f027 Jun 08 12:09:26.768317 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.768295 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" Jun 08 12:09:26.774381 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.774365 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m64c9" Jun 08 12:09:26.776830 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:26.776807 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079697c1_565d_4f5a_a03f_c52588d0f1e8.slice/crio-28a92a88be379869f4dace4f07408fd366103c67babfcd6765dcd8bf0ad6f59c WatchSource:0}: Error finding container 28a92a88be379869f4dace4f07408fd366103c67babfcd6765dcd8bf0ad6f59c: Status 404 returned error can't find the container with id 28a92a88be379869f4dace4f07408fd366103c67babfcd6765dcd8bf0ad6f59c Jun 08 12:09:26.781274 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:09:26.781253 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d31a2f_c538_486c_9c34_f46dde14f171.slice/crio-b82edbfa0bdf5d6c15c62bfe40993a6a0d4e146d348a48b0083f3eff79157951 WatchSource:0}: Error finding container b82edbfa0bdf5d6c15c62bfe40993a6a0d4e146d348a48b0083f3eff79157951: Status 404 returned error can't find the container with id b82edbfa0bdf5d6c15c62bfe40993a6a0d4e146d348a48b0083f3eff79157951 Jun 08 12:09:26.874685 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.874652 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:26.920752 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.920645 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:26.920752 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:26.920699 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:26.920921 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.920827 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:26.920921 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.920880 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret podName:dc2566b6-1a94-4bd2-bea1-10852ae45061 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:27.92086687 +0000 UTC m=+2.981992015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret") pod "global-pull-secret-syncer-kz97q" (UID: "dc2566b6-1a94-4bd2-bea1-10852ae45061") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:26.920921 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.920827 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:26.921058 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:26.920954 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs podName:ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b nodeName:}" failed. No retries permitted until 2026-06-08 12:09:27.920927017 +0000 UTC m=+2.982052162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs") pod "network-metrics-daemon-vdsvw" (UID: "ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:27.122584 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.122520 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ksjk\" (UniqueName: \"kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk\") pod \"network-check-target-chx9n\" (UID: \"f22d64d7-163e-4ada-9869-d53b62eaca3f\") " pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:27.122756 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:27.122730 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:27.122802 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:27.122761 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:27.122802 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:27.122776 2584 projected.go:196] Error preparing data for projected volume kube-api-access-4ksjk for pod openshift-network-diagnostics/network-check-target-chx9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:27.122870 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:27.122853 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk podName:f22d64d7-163e-4ada-9869-d53b62eaca3f nodeName:}" failed. No retries permitted until 2026-06-08 12:09:28.122833274 +0000 UTC m=+3.183958438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ksjk" (UniqueName: "kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk") pod "network-check-target-chx9n" (UID: "f22d64d7-163e-4ada-9869-d53b62eaca3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:27.353360 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.353209 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:04:26 +0000 UTC" deadline="2027-12-06 07:50:02.879583706 +0000 UTC" Jun 08 12:09:27.353360 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.353268 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13099h40m35.526319322s" Jun 08 12:09:27.377336 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.377308 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:27.377520 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:27.377440 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:27.383123 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.382802 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-216.ec2.internal" event={"ID":"b691406e1e053ba364f9fbf30fa94f31","Type":"ContainerStarted","Data":"73ac53cacf36e10105c47d2f86e5acc273010997ef842bf7e8cb92090b071990"} Jun 08 12:09:27.385337 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.385218 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m64c9" event={"ID":"e4d31a2f-c538-486c-9c34-f46dde14f171","Type":"ContainerStarted","Data":"b82edbfa0bdf5d6c15c62bfe40993a6a0d4e146d348a48b0083f3eff79157951"} Jun 08 12:09:27.388215 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.388112 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" event={"ID":"079697c1-565d-4f5a-a03f-c52588d0f1e8","Type":"ContainerStarted","Data":"28a92a88be379869f4dace4f07408fd366103c67babfcd6765dcd8bf0ad6f59c"} Jun 08 12:09:27.390556 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.390497 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" event={"ID":"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37","Type":"ContainerStarted","Data":"7d86ed6ad17add7439511a869206dcce0d8c8bcc578d1c7bec64e49eecf8f027"} Jun 08 12:09:27.392213 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.392173 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sftwv" event={"ID":"07032d7f-d6b8-4655-bbf6-4bcec05ab66b","Type":"ContainerStarted","Data":"668fbb8fc2208267f08d977fce0d584f2b0bb9b35954c78de82cb763a414a5a7"} Jun 08 12:09:27.393927 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.393904 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" event={"ID":"881fee84-8266-473e-aeb0-47997bb6b2df","Type":"ContainerStarted","Data":"b991cb242015156e10262af3227a6747c9a97ed06563c1d0eda5ceec2b07384c"} Jun 08 12:09:27.400848 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.400821 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" event={"ID":"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b","Type":"ContainerStarted","Data":"907e6db1cd7f2d18b49b2e4d28b2e74140be0e78954d102ed859b4971989a2eb"} Jun 08 12:09:27.408254 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.408228 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k5lj7" event={"ID":"69b18e3e-e679-4903-968a-ccaa1a6e893e","Type":"ContainerStarted","Data":"5576cf554a737c80101bc4830efd48a56d4d474d2ce318ef5204300e89bc4d81"} Jun 08 12:09:27.413245 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.413149 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" event={"ID":"f8f3e47c058cd4c962a3b249e2ee78a5","Type":"ContainerStarted","Data":"b59ed853b842b76a339441376ee668bf3e7af041b74c0c3de6805742d9d38f31"} Jun 08 12:09:27.416151 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.416068 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hv8xt" event={"ID":"ee2b4d11-85ce-48f3-aaf4-2bf19efeb291","Type":"ContainerStarted","Data":"333a5d2193f3802ec964b0b12aa3302a0f5f9a6a36dc85bb9b6809ac9cfc1446"} Jun 08 12:09:27.422126 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.422090 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pncd7" event={"ID":"a1b88c71-84c8-4caa-b7ae-0911683f1008","Type":"ContainerStarted","Data":"e0fbc0f0a93af4b0059b2beb837b4ab7d75ef5af31a5858e58de076d1acd01b5"} Jun 08 12:09:27.806469 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.806343 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:27.928932 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.928890 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:27.929121 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:27.928993 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:27.929121 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:27.929079 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:27.929244 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:27.929111 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:27.929244 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:27.929157 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs podName:ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b nodeName:}" failed. No retries permitted until 2026-06-08 12:09:29.929135022 +0000 UTC m=+4.990260171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs") pod "network-metrics-daemon-vdsvw" (UID: "ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:27.929244 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:27.929217 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret podName:dc2566b6-1a94-4bd2-bea1-10852ae45061 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:29.929179021 +0000 UTC m=+4.990304182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret") pod "global-pull-secret-syncer-kz97q" (UID: "dc2566b6-1a94-4bd2-bea1-10852ae45061") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:28.131515 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:28.131429 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ksjk\" (UniqueName: \"kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk\") pod \"network-check-target-chx9n\" (UID: \"f22d64d7-163e-4ada-9869-d53b62eaca3f\") " pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:28.131691 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:28.131629 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:28.131691 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:28.131651 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:28.131691 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:28.131665 2584 projected.go:196] Error preparing data for projected volume kube-api-access-4ksjk for pod openshift-network-diagnostics/network-check-target-chx9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:28.131847 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:28.131724 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk podName:f22d64d7-163e-4ada-9869-d53b62eaca3f nodeName:}" failed. No retries permitted until 2026-06-08 12:09:30.131705122 +0000 UTC m=+5.192830291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ksjk" (UniqueName: "kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk") pod "network-check-target-chx9n" (UID: "f22d64d7-163e-4ada-9869-d53b62eaca3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:28.354473 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:28.354427 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:04:26 +0000 UTC" deadline="2028-03-06 02:26:22.339045044 +0000 UTC" Jun 08 12:09:28.354473 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:28.354467 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15278h16m53.984582771s" Jun 08 12:09:28.376168 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:28.376137 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:28.376369 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:28.376262 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:28.376550 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:28.376522 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:28.376668 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:28.376639 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:29.243554 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:29.243523 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:29.386781 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:29.386749 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:29.387182 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:29.387002 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:29.952515 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:29.952479 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:29.952745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:29.952560 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:29.952745 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:29.952728 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:29.952861 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:29.952793 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs podName:ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b nodeName:}" failed. No retries permitted until 2026-06-08 12:09:33.95277183 +0000 UTC m=+9.013896992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs") pod "network-metrics-daemon-vdsvw" (UID: "ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:29.953199 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:29.953181 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:29.953285 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:29.953232 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret podName:dc2566b6-1a94-4bd2-bea1-10852ae45061 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:33.953217929 +0000 UTC m=+9.014343082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret") pod "global-pull-secret-syncer-kz97q" (UID: "dc2566b6-1a94-4bd2-bea1-10852ae45061") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:30.153899 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:30.153864 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ksjk\" (UniqueName: \"kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk\") pod \"network-check-target-chx9n\" (UID: \"f22d64d7-163e-4ada-9869-d53b62eaca3f\") " pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:30.154097 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:30.154044 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:30.154097 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:30.154070 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:30.154097 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:30.154082 2584 projected.go:196] Error preparing data for projected volume kube-api-access-4ksjk for pod openshift-network-diagnostics/network-check-target-chx9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:30.154255 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:30.154136 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk podName:f22d64d7-163e-4ada-9869-d53b62eaca3f nodeName:}" failed. No retries permitted until 2026-06-08 12:09:34.154120781 +0000 UTC m=+9.215245930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ksjk" (UniqueName: "kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk") pod "network-check-target-chx9n" (UID: "f22d64d7-163e-4ada-9869-d53b62eaca3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:30.376176 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:30.376097 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:30.376336 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:30.376220 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:30.376633 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:30.376613 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:30.376739 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:30.376715 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:31.375744 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:31.375709 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:31.376125 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:31.375819 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:32.375345 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:32.375310 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:32.375570 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:32.375356 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:32.375570 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:32.375450 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:32.375686 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:32.375569 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:33.378670 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:33.378645 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:33.379068 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:33.378769 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:33.986883 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:33.986839 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:33.987100 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:33.986918 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:33.987100 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:33.987076 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:33.987223 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:33.987133 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs podName:ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b nodeName:}" failed. No retries permitted until 2026-06-08 12:09:41.987116675 +0000 UTC m=+17.048241820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs") pod "network-metrics-daemon-vdsvw" (UID: "ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:33.987580 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:33.987556 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:33.987695 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:33.987610 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret podName:dc2566b6-1a94-4bd2-bea1-10852ae45061 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:41.987595652 +0000 UTC m=+17.048720801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret") pod "global-pull-secret-syncer-kz97q" (UID: "dc2566b6-1a94-4bd2-bea1-10852ae45061") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:34.188823 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:34.188230 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ksjk\" (UniqueName: \"kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk\") pod \"network-check-target-chx9n\" (UID: \"f22d64d7-163e-4ada-9869-d53b62eaca3f\") " pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:34.188823 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:34.188395 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:34.188823 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:34.188414 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:34.188823 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:34.188426 2584 projected.go:196] Error preparing data for projected volume kube-api-access-4ksjk for pod openshift-network-diagnostics/network-check-target-chx9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:34.188823 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:34.188478 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk podName:f22d64d7-163e-4ada-9869-d53b62eaca3f nodeName:}" failed. No retries permitted until 2026-06-08 12:09:42.188465899 +0000 UTC m=+17.249591044 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ksjk" (UniqueName: "kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk") pod "network-check-target-chx9n" (UID: "f22d64d7-163e-4ada-9869-d53b62eaca3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:34.375562 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:34.375474 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:34.375700 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:34.375475 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:34.375700 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:34.375622 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:34.375700 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:34.375672 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:35.375967 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:35.375933 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:35.376431 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:35.376088 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:36.376190 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:36.376158 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:36.376190 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:36.376182 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:36.376684 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:36.376285 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:36.376684 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:36.376409 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:37.378496 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:37.378466 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:37.378999 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:37.378586 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:38.376128 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:38.376090 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:38.376307 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:38.376090 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:38.376307 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:38.376197 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:38.376405 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:38.376307 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:39.375856 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:39.375815 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:39.376353 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:39.375957 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:40.375370 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:40.375332 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:40.375548 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:40.375470 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:40.375548 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:40.375508 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:40.375665 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:40.375596 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:41.376054 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:41.376021 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:41.376439 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:41.376161 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:42.049263 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:42.049222 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:42.049484 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:42.049292 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:42.049484 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:42.049375 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:42.049484 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:42.049414 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:42.049484 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:42.049457 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret podName:dc2566b6-1a94-4bd2-bea1-10852ae45061 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:58.049437689 +0000 UTC m=+33.110562837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret") pod "global-pull-secret-syncer-kz97q" (UID: "dc2566b6-1a94-4bd2-bea1-10852ae45061") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:42.049484 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:42.049477 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs podName:ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b nodeName:}" failed. No retries permitted until 2026-06-08 12:09:58.049466989 +0000 UTC m=+33.110592134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs") pod "network-metrics-daemon-vdsvw" (UID: "ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:42.251050 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:42.251006 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ksjk\" (UniqueName: \"kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk\") pod \"network-check-target-chx9n\" (UID: \"f22d64d7-163e-4ada-9869-d53b62eaca3f\") " pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:42.251235 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:42.251205 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:42.251235 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:42.251227 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:42.251348 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:42.251241 2584 projected.go:196] Error preparing data for projected volume kube-api-access-4ksjk for pod openshift-network-diagnostics/network-check-target-chx9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:42.251348 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:42.251309 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk podName:f22d64d7-163e-4ada-9869-d53b62eaca3f nodeName:}" failed. No retries permitted until 2026-06-08 12:09:58.251288877 +0000 UTC m=+33.312414041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ksjk" (UniqueName: "kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk") pod "network-check-target-chx9n" (UID: "f22d64d7-163e-4ada-9869-d53b62eaca3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:42.375810 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:42.375737 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:42.376005 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:42.375738 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:42.376005 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:42.375861 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:42.376005 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:42.375927 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:43.375253 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:43.375210 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:43.375452 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:43.375351 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:44.375404 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:44.375367 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:44.375879 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:44.375414 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:44.375879 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:44.375519 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:44.375879 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:44.375643 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:45.376672 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:45.376642 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:45.377154 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:45.376759 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:46.375329 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:46.375287 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:46.375329 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:46.375321 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:46.375562 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:46.375437 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:46.375619 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:46.375563 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:47.375871 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:47.375727 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:47.376184 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:47.375961 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:47.474907 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:47.474824 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" event={"ID":"fac0d1ad-0eb3-47a3-a3db-53e78dbdcd37","Type":"ContainerStarted","Data":"b3b9f8344aa73092d0ddeb787009a1aabc886d501c4877a8ca3246092695ce48"} Jun 08 12:09:47.476383 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:47.476353 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k5lj7" event={"ID":"69b18e3e-e679-4903-968a-ccaa1a6e893e","Type":"ContainerStarted","Data":"b288462d1406afeb6ff5db49209e12f21ef8e4043da194a9d0ea790e5a694f6b"} Jun 08 12:09:47.477771 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:47.477753 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-216.ec2.internal" event={"ID":"b691406e1e053ba364f9fbf30fa94f31","Type":"ContainerStarted","Data":"9e4dd648373bdfe0d205159a8b275956c2e2251c8d19a15daf021c61311b739e"} Jun 08 12:09:47.492380 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:47.492339 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7gmmc" podStartSLOduration=2.076273815 podStartE2EDuration="22.492326428s" totalImagesPullingTime="20.416052613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:47.492018955 +0000 UTC m=+22.553144121" watchObservedRunningTime="2026-06-08 12:09:47.492326428 +0000 UTC m=+22.553451594" Jun 08 12:09:47.504850 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:47.504815 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-216.ec2.internal" podStartSLOduration=21.504804786 podStartE2EDuration="21.504804786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:47.504253689 +0000 UTC m=+22.565378855" watchObservedRunningTime="2026-06-08 12:09:47.504804786 +0000 UTC m=+22.565929952" Jun 08 12:09:47.523018 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:47.522963 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k5lj7" podStartSLOduration=2.020521893 podStartE2EDuration="22.522950408s" totalImagesPullingTime="20.502428515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:47.522900101 +0000 UTC m=+22.584025267" watchObservedRunningTime="2026-06-08 12:09:47.522950408 +0000 UTC m=+22.584075574" Jun 08 12:09:48.375783 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.375595 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:48.375895 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.375628 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:48.375895 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:48.375874 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:48.376482 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:48.375938 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:48.486893 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.486855 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pncd7" event={"ID":"a1b88c71-84c8-4caa-b7ae-0911683f1008","Type":"ContainerStarted","Data":"d9db5c4f712f66f54751585a6cf09d4a74583543fa2bc269252da29491622c09"} Jun 08 12:09:48.488459 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.488431 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" event={"ID":"079697c1-565d-4f5a-a03f-c52588d0f1e8","Type":"ContainerStarted","Data":"7bf942f4ca8a2a41098be68cc2fb57bce53993c8856f5b16f511e568a8decd68"} Jun 08 12:09:48.495563 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.495439 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:09:48.495869 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.495844 2584 generic.go:356] "Generic (PLEG): container finished" podID="24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b" containerID="e03b7cea694a30c9833f513ebfdb05e03b4e9ad6448390e60e262517975d316b" exitCode=1 Jun 08 12:09:48.495939 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.495923 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" event={"ID":"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b","Type":"ContainerStarted","Data":"37db37642b333b1969a7ab57ade01950f58bfb4b84f8c9e057bf626dcabac4fd"} Jun 08 12:09:48.496044 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.496016 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" event={"ID":"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b","Type":"ContainerStarted","Data":"92d0e9cce93226a344a2c2264fd29368051c642d6b51268692bb1f8cec38782d"} Jun 08 12:09:48.496112 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.496070 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" event={"ID":"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b","Type":"ContainerStarted","Data":"db93862f31d477c7cf7e597db26cf1bf67805c9c508003f04eb279ecfd47e6d7"} Jun 08 12:09:48.496152 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.496117 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" event={"ID":"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b","Type":"ContainerStarted","Data":"752fa600fd06ef844f20b871ee1e061f30b12f4487a08b953c764437e1225a3f"} Jun 08 12:09:48.496201 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.496164 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" event={"ID":"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b","Type":"ContainerDied","Data":"e03b7cea694a30c9833f513ebfdb05e03b4e9ad6448390e60e262517975d316b"} Jun 08 12:09:48.496245 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.496217 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" event={"ID":"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b","Type":"ContainerStarted","Data":"98416bf63696d41d694edd1f034aa728fc9b69ef6d99864e4cdd6e286d7d5bcf"} Jun 08 12:09:48.527050 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:48.527007 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hv8xt" podStartSLOduration=7.791826679 podStartE2EDuration="23.526992414s" totalImagesPullingTime="15.735165735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:48.526296266 +0000 UTC m=+23.587421434" watchObservedRunningTime="2026-06-08 12:09:48.526992414 +0000 UTC m=+23.588117571" Jun 08 12:09:49.375946 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.375909 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:49.376481 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:49.376066 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:49.502204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.502171 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sftwv" event={"ID":"07032d7f-d6b8-4655-bbf6-4bcec05ab66b","Type":"ContainerStarted","Data":"8041351cf09b03dd5f4210d2493e681ac2498f7ceda5ec7a9ed6d8ff66364980"} Jun 08 12:09:49.503579 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.503551 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" event={"ID":"881fee84-8266-473e-aeb0-47997bb6b2df","Type":"ContainerStarted","Data":"8c10bf2fce016db29713e317602a9be7145b22b0fca968b880a5926ced8618bc"} Jun 08 12:09:49.504878 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.504855 2584 generic.go:356] "Generic (PLEG): container finished" podID="f8f3e47c058cd4c962a3b249e2ee78a5" containerID="bb611dce0ae52709dcaf2af59eba3430305bc0fd56b89787ef2ac1cb70a9f94f" exitCode=0 Jun 08 12:09:49.504961 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.504914 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" event={"ID":"f8f3e47c058cd4c962a3b249e2ee78a5","Type":"ContainerDied","Data":"bb611dce0ae52709dcaf2af59eba3430305bc0fd56b89787ef2ac1cb70a9f94f"} Jun 08 12:09:49.506359 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.506335 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hv8xt" event={"ID":"ee2b4d11-85ce-48f3-aaf4-2bf19efeb291","Type":"ContainerStarted","Data":"14a397b9d0d4a7ae911a45bfe2674f432d00c14af90b5dc33426fdf6f12bfcc4"} Jun 08 12:09:49.507696 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.507675 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m64c9" event={"ID":"e4d31a2f-c538-486c-9c34-f46dde14f171","Type":"ContainerStarted","Data":"bd428a60cf4c5fb90f851b1be16ca394cb417b88913113b774c2e10bddc21f3d"} Jun 08 12:09:49.508886 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.508860 2584 generic.go:356] "Generic (PLEG): container finished" podID="079697c1-565d-4f5a-a03f-c52588d0f1e8" containerID="7bf942f4ca8a2a41098be68cc2fb57bce53993c8856f5b16f511e568a8decd68" exitCode=0 Jun 08 12:09:49.508992 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.508938 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" event={"ID":"079697c1-565d-4f5a-a03f-c52588d0f1e8","Type":"ContainerDied","Data":"7bf942f4ca8a2a41098be68cc2fb57bce53993c8856f5b16f511e568a8decd68"} Jun 08 12:09:49.522479 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.522437 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sftwv" podStartSLOduration=4.315186443 podStartE2EDuration="24.522422778s" totalImagesPullingTime="20.207236335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:49.522204864 +0000 UTC m=+24.583330030" watchObservedRunningTime="2026-06-08 12:09:49.522422778 +0000 UTC m=+24.583547946" Jun 08 12:09:49.538345 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.538300 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m64c9" podStartSLOduration=4.149564617 podStartE2EDuration="24.538285459s" totalImagesPullingTime="20.388720842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:49.537905166 +0000 UTC m=+24.599030334" watchObservedRunningTime="2026-06-08 12:09:49.538285459 +0000 UTC m=+24.599410625" Jun 08 12:09:49.603205 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.603161 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pncd7" podStartSLOduration=4.086442242 podStartE2EDuration="24.603144896s" totalImagesPullingTime="20.516702654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:49.603008762 +0000 UTC m=+24.664133929" watchObservedRunningTime="2026-06-08 12:09:49.603144896 +0000 UTC m=+24.664270063" Jun 08 12:09:49.814492 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.814341 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 12:09:49.969053 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:49.968958 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:50.375146 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:50.375111 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:50.375461 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:50.375256 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:50.375461 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:50.375310 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:50.375461 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:50.375433 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:50.390380 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:50.390258 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T12:09:49.814486498Z","UUID":"9dae70d0-8805-47f3-ad22-2021dc9e125e","Handler":null,"Name":"","Endpoint":""} Jun 08 12:09:50.392144 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:50.392123 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 12:09:50.392270 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:50.392165 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 12:09:50.513761 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:50.513725 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" event={"ID":"881fee84-8266-473e-aeb0-47997bb6b2df","Type":"ContainerStarted","Data":"1232d45bb62611f731b9de24d1d4d662f2d6af84dee4f188542dbcc55c0d3e38"} Jun 08 12:09:50.515587 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:50.515559 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" event={"ID":"f8f3e47c058cd4c962a3b249e2ee78a5","Type":"ContainerStarted","Data":"470aa4b281b86eecb4e92c159b223282ccb2af87836b894ad047755c33c2626f"} Jun 08 12:09:50.530338 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:50.530292 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-216.ec2.internal" podStartSLOduration=24.530256897 podStartE2EDuration="24.530256897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:50.529772778 +0000 UTC m=+25.590897944" watchObservedRunningTime="2026-06-08 12:09:50.530256897 +0000 UTC m=+25.591382064" Jun 08 12:09:51.375624 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:51.375588 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:51.375811 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:51.375721 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:51.520619 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:51.520536 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" event={"ID":"881fee84-8266-473e-aeb0-47997bb6b2df","Type":"ContainerStarted","Data":"57208cfaff0cb9e6042792b8aef082f9bbbb9f966ea9399f7df93758d42997a2"} Jun 08 12:09:51.524211 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:51.524188 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:09:51.524836 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:51.524810 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" event={"ID":"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b","Type":"ContainerStarted","Data":"ee857f607eca4d7f269b081c8f258dc386273d3048e9c7cc3a974eecb12c69ec"} Jun 08 12:09:51.540797 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:51.540736 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wccw" podStartSLOduration=3.804579852 podStartE2EDuration="26.540718392s" totalImagesPullingTime="22.73613854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:51.540299879 +0000 UTC m=+26.601425047" watchObservedRunningTime="2026-06-08 12:09:51.540718392 +0000 UTC m=+26.601843561" Jun 08 12:09:52.375937 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:52.375903 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:52.376138 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:52.375915 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:52.376138 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:52.376022 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:52.376138 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:52.376121 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:53.303119 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:53.302846 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:53.303724 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:53.303546 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:53.375866 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:53.375834 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:53.376025 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:53.375956 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:53.536419 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:53.536389 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:09:53.536839 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:53.536805 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" event={"ID":"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b","Type":"ContainerStarted","Data":"80504472f7e5a459e400b3fe8c1ef10189d5b7ee983e86814d2bf079c400553c"} Jun 08 12:09:53.537535 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:53.537517 2584 scope.go:117] "RemoveContainer" containerID="e03b7cea694a30c9833f513ebfdb05e03b4e9ad6448390e60e262517975d316b" Jun 08 12:09:53.537645 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:53.537631 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pncd7" Jun 08 12:09:54.375194 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:54.375159 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:54.375194 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:54.375203 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:54.375663 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:54.375296 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:54.375663 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:54.375443 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:54.913106 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:54.913034 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-chx9n"] Jun 08 12:09:54.913250 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:54.913183 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:54.913318 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:54.913272 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:54.915790 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:54.915766 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kz97q"] Jun 08 12:09:54.915909 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:54.915850 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:54.915955 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:54.915933 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:54.918585 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:54.918561 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdsvw"] Jun 08 12:09:54.918692 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:54.918671 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:54.918795 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:54.918774 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:55.543612 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:55.543370 2584 generic.go:356] "Generic (PLEG): container finished" podID="079697c1-565d-4f5a-a03f-c52588d0f1e8" containerID="190fc22fd564a084cf41b6980f68b50c5ebc406c70fddc68e6e4ed0faa46bbe5" exitCode=0 Jun 08 12:09:55.544017 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:55.543452 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" event={"ID":"079697c1-565d-4f5a-a03f-c52588d0f1e8","Type":"ContainerDied","Data":"190fc22fd564a084cf41b6980f68b50c5ebc406c70fddc68e6e4ed0faa46bbe5"} Jun 08 12:09:55.549400 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:55.549378 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:09:55.549864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:55.549838 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" event={"ID":"24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b","Type":"ContainerStarted","Data":"6f9b072d8bd0b6e3c00d1a6fc0ffd272922894b14d125bf1fe2b10290e134b22"} Jun 08 12:09:55.550163 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:55.550142 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:55.550247 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:55.550206 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:55.550284 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:55.550246 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:55.566504 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:55.566466 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:55.566651 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:55.566634 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:09:55.595118 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:55.595002 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" podStartSLOduration=9.694751529 podStartE2EDuration="30.594963822s" totalImagesPullingTime="20.900212293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:55.594212802 +0000 UTC m=+30.655337968" watchObservedRunningTime="2026-06-08 12:09:55.594963822 +0000 UTC m=+30.656088991" Jun 08 12:09:56.375692 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:56.375216 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:56.375692 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:56.375231 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:56.375692 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:56.375232 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:56.375692 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:56.375337 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:56.375692 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:56.375438 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:56.375692 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:56.375530 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:57.556327 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:57.556289 2584 generic.go:356] "Generic (PLEG): container finished" podID="079697c1-565d-4f5a-a03f-c52588d0f1e8" containerID="534038baf998e96961ae02e9a59081f8d91af39998f276585e3fbc1aedeaa9db" exitCode=0 Jun 08 12:09:57.557189 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:57.556382 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" event={"ID":"079697c1-565d-4f5a-a03f-c52588d0f1e8","Type":"ContainerDied","Data":"534038baf998e96961ae02e9a59081f8d91af39998f276585e3fbc1aedeaa9db"} Jun 08 12:09:57.567793 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:57.567759 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" podUID="24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b" containerName="ovnkube-controller" probeResult="failure" output="" Jun 08 12:09:58.065665 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:58.065638 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:58.065760 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:58.065698 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:58.065835 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:58.065782 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:58.065835 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:58.065798 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:58.065900 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:58.065868 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs podName:ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b nodeName:}" failed. No retries permitted until 2026-06-08 12:10:30.065845115 +0000 UTC m=+65.126970264 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs") pod "network-metrics-daemon-vdsvw" (UID: "ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:58.065900 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:58.065884 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret podName:dc2566b6-1a94-4bd2-bea1-10852ae45061 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:30.065876146 +0000 UTC m=+65.127001294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret") pod "global-pull-secret-syncer-kz97q" (UID: "dc2566b6-1a94-4bd2-bea1-10852ae45061") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:58.267427 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:58.267376 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ksjk\" (UniqueName: \"kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk\") pod \"network-check-target-chx9n\" (UID: \"f22d64d7-163e-4ada-9869-d53b62eaca3f\") " pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:58.267600 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:58.267536 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:58.267600 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:58.267557 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:58.267600 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:58.267567 2584 projected.go:196] Error preparing data for projected volume kube-api-access-4ksjk for pod openshift-network-diagnostics/network-check-target-chx9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:58.267693 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:58.267617 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk podName:f22d64d7-163e-4ada-9869-d53b62eaca3f nodeName:}" failed. No retries permitted until 2026-06-08 12:10:30.267603284 +0000 UTC m=+65.328728430 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ksjk" (UniqueName: "kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk") pod "network-check-target-chx9n" (UID: "f22d64d7-163e-4ada-9869-d53b62eaca3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:58.375694 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:58.375580 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:09:58.375694 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:58.375619 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:09:58.375694 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:58.375634 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:09:58.375993 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:58.375716 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx9n" podUID="f22d64d7-163e-4ada-9869-d53b62eaca3f" Jun 08 12:09:58.375993 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:58.375817 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz97q" podUID="dc2566b6-1a94-4bd2-bea1-10852ae45061" Jun 08 12:09:58.375993 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:09:58.375902 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:09:58.561204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:58.561172 2584 generic.go:356] "Generic (PLEG): container finished" podID="079697c1-565d-4f5a-a03f-c52588d0f1e8" containerID="6e14e3db5c5dbc4832796f650ebd0a882082f3c03b1d874cb7290648d332b117" exitCode=0 Jun 08 12:09:58.561545 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:09:58.561212 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" event={"ID":"079697c1-565d-4f5a-a03f-c52588d0f1e8","Type":"ContainerDied","Data":"6e14e3db5c5dbc4832796f650ebd0a882082f3c03b1d874cb7290648d332b117"} Jun 08 12:10:00.267241 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.266970 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-216.ec2.internal" event="NodeReady" Jun 08 12:10:00.267671 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.267283 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 12:10:00.305019 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.304991 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b7fd6b98f-zjgzz"] Jun 08 12:10:00.306741 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.306722 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.309348 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.309091 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 12:10:00.309348 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.309122 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 12:10:00.309348 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.309125 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-txkmd\"" Jun 08 12:10:00.309348 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.309126 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 12:10:00.314088 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.314068 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 12:10:00.320749 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.320725 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b7fd6b98f-zjgzz"] Jun 08 12:10:00.324186 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.324164 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-99vw4"] Jun 08 12:10:00.325853 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.325838 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-99vw4" Jun 08 12:10:00.327064 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.327041 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gfh8r"] Jun 08 12:10:00.328036 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.328018 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8wpjq\"" Jun 08 12:10:00.328900 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.328656 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 12:10:00.328900 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.328672 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 12:10:00.328900 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.328661 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.328900 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.328806 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 12:10:00.330786 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.330764 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 12:10:00.331032 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.331013 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8rrt4\"" Jun 08 12:10:00.331839 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.331779 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 12:10:00.337308 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.337286 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-99vw4"] Jun 08 12:10:00.342860 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.342832 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gfh8r"] Jun 08 12:10:00.375663 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.375638 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:10:00.376530 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.376088 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:10:00.376642 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.376538 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:10:00.377859 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.377839 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 12:10:00.377968 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.377839 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nvw7c\"" Jun 08 12:10:00.378212 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.378196 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:10:00.378280 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.378239 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 12:10:00.378488 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.378467 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:10:00.378557 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.378541 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h8l7g\"" Jun 08 12:10:00.382277 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.382258 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75ea9270-5ce5-4e3e-b123-b1d099383c10-ca-trust-extracted\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.382380 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.382301 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-trusted-ca\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.382380 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.382365 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-bound-sa-token\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.382494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.382404 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.382494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.382427 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-installation-pull-secrets\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.382494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.382456 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-image-registry-private-configuration\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.382494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.382480 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gg74\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-kube-api-access-6gg74\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.382718 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.382499 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-certificates\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.483233 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483196 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75ea9270-5ce5-4e3e-b123-b1d099383c10-ca-trust-extracted\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.483390 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483255 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9lkm\" (UniqueName: \"kubernetes.io/projected/e83de341-8e6e-47ff-b99a-859fe33c83e6-kube-api-access-q9lkm\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.483390 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483289 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-trusted-ca\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.483390 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483317 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e83de341-8e6e-47ff-b99a-859fe33c83e6-config-volume\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.483390 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483341 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.483552 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483395 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e83de341-8e6e-47ff-b99a-859fe33c83e6-tmp-dir\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.483552 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483478 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-bound-sa-token\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.483552 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483512 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/305be2de-71c9-4673-870e-b0c19976f8db-cert\") pod \"ingress-canary-99vw4\" (UID: \"305be2de-71c9-4673-870e-b0c19976f8db\") " pod="openshift-ingress-canary/ingress-canary-99vw4" Jun 08 12:10:00.483552 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483540 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.483730 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483590 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-installation-pull-secrets\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.483730 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483628 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mlcl\" (UniqueName: \"kubernetes.io/projected/305be2de-71c9-4673-870e-b0c19976f8db-kube-api-access-2mlcl\") pod \"ingress-canary-99vw4\" (UID: \"305be2de-71c9-4673-870e-b0c19976f8db\") " pod="openshift-ingress-canary/ingress-canary-99vw4" Jun 08 12:10:00.483730 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:00.483645 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:10:00.483730 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:00.483660 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7fd6b98f-zjgzz: secret "image-registry-tls" not found Jun 08 12:10:00.483730 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483671 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75ea9270-5ce5-4e3e-b123-b1d099383c10-ca-trust-extracted\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.483730 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483678 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-image-registry-private-configuration\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.483730 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483706 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gg74\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-kube-api-access-6gg74\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.483730 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:00.483729 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls podName:75ea9270-5ce5-4e3e-b123-b1d099383c10 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:00.98370836 +0000 UTC m=+36.044833517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls") pod "image-registry-b7fd6b98f-zjgzz" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10") : secret "image-registry-tls" not found Jun 08 12:10:00.484274 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.483801 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-certificates\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.484309 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.484268 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-trusted-ca\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.484309 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.484279 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-certificates\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.487671 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.487650 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-image-registry-private-configuration\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.487775 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.487703 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-installation-pull-secrets\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.491523 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.491499 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-bound-sa-token\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.491631 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.491607 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gg74\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-kube-api-access-6gg74\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.584470 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.584437 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/305be2de-71c9-4673-870e-b0c19976f8db-cert\") pod \"ingress-canary-99vw4\" (UID: \"305be2de-71c9-4673-870e-b0c19976f8db\") " pod="openshift-ingress-canary/ingress-canary-99vw4" Jun 08 12:10:00.584650 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.584484 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mlcl\" (UniqueName: \"kubernetes.io/projected/305be2de-71c9-4673-870e-b0c19976f8db-kube-api-access-2mlcl\") pod \"ingress-canary-99vw4\" (UID: \"305be2de-71c9-4673-870e-b0c19976f8db\") " pod="openshift-ingress-canary/ingress-canary-99vw4" Jun 08 12:10:00.584732 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.584676 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9lkm\" (UniqueName: \"kubernetes.io/projected/e83de341-8e6e-47ff-b99a-859fe33c83e6-kube-api-access-q9lkm\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.584792 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.584739 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e83de341-8e6e-47ff-b99a-859fe33c83e6-config-volume\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.584792 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.584769 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.584894 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.584797 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e83de341-8e6e-47ff-b99a-859fe33c83e6-tmp-dir\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.584945 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:00.584890 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:00.585020 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:00.585001 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls podName:e83de341-8e6e-47ff-b99a-859fe33c83e6 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:01.084959344 +0000 UTC m=+36.146084493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls") pod "dns-default-gfh8r" (UID: "e83de341-8e6e-47ff-b99a-859fe33c83e6") : secret "dns-default-metrics-tls" not found Jun 08 12:10:00.585213 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.585181 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e83de341-8e6e-47ff-b99a-859fe33c83e6-tmp-dir\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.585429 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.585405 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e83de341-8e6e-47ff-b99a-859fe33c83e6-config-volume\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.587419 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.587397 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/305be2de-71c9-4673-870e-b0c19976f8db-cert\") pod \"ingress-canary-99vw4\" (UID: \"305be2de-71c9-4673-870e-b0c19976f8db\") " pod="openshift-ingress-canary/ingress-canary-99vw4" Jun 08 12:10:00.592923 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.592892 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9lkm\" (UniqueName: \"kubernetes.io/projected/e83de341-8e6e-47ff-b99a-859fe33c83e6-kube-api-access-q9lkm\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:00.593509 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.593490 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mlcl\" (UniqueName: \"kubernetes.io/projected/305be2de-71c9-4673-870e-b0c19976f8db-kube-api-access-2mlcl\") pod \"ingress-canary-99vw4\" (UID: \"305be2de-71c9-4673-870e-b0c19976f8db\") " pod="openshift-ingress-canary/ingress-canary-99vw4" Jun 08 12:10:00.637519 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.637485 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-99vw4" Jun 08 12:10:00.793677 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.793644 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-99vw4"] Jun 08 12:10:00.798300 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:10:00.798267 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305be2de_71c9_4673_870e_b0c19976f8db.slice/crio-88bf8b1fcc2068b7b1961abf3ba7d9f3502c34d916372d8e8b9567d6a89a29ab WatchSource:0}: Error finding container 88bf8b1fcc2068b7b1961abf3ba7d9f3502c34d916372d8e8b9567d6a89a29ab: Status 404 returned error can't find the container with id 88bf8b1fcc2068b7b1961abf3ba7d9f3502c34d916372d8e8b9567d6a89a29ab Jun 08 12:10:00.988429 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:00.988338 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:00.988612 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:00.988514 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:10:00.988612 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:00.988544 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7fd6b98f-zjgzz: secret "image-registry-tls" not found Jun 08 12:10:00.988719 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:00.988625 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls podName:75ea9270-5ce5-4e3e-b123-b1d099383c10 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:01.9886039 +0000 UTC m=+37.049729065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls") pod "image-registry-b7fd6b98f-zjgzz" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10") : secret "image-registry-tls" not found Jun 08 12:10:01.089720 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:01.089686 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:01.089871 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:01.089827 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:01.089923 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:01.089888 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls podName:e83de341-8e6e-47ff-b99a-859fe33c83e6 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:02.089871467 +0000 UTC m=+37.150996614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls") pod "dns-default-gfh8r" (UID: "e83de341-8e6e-47ff-b99a-859fe33c83e6") : secret "dns-default-metrics-tls" not found Jun 08 12:10:01.572137 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:01.572091 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-99vw4" event={"ID":"305be2de-71c9-4673-870e-b0c19976f8db","Type":"ContainerStarted","Data":"88bf8b1fcc2068b7b1961abf3ba7d9f3502c34d916372d8e8b9567d6a89a29ab"} Jun 08 12:10:01.996405 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:01.996362 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:01.996619 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:01.996539 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:10:01.996619 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:01.996559 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7fd6b98f-zjgzz: secret "image-registry-tls" not found Jun 08 12:10:01.996735 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:01.996629 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls podName:75ea9270-5ce5-4e3e-b123-b1d099383c10 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:03.996608489 +0000 UTC m=+39.057733637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls") pod "image-registry-b7fd6b98f-zjgzz" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10") : secret "image-registry-tls" not found Jun 08 12:10:02.097159 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:02.097114 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:02.097342 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:02.097296 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:02.097388 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:02.097358 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls podName:e83de341-8e6e-47ff-b99a-859fe33c83e6 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:04.097341172 +0000 UTC m=+39.158466320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls") pod "dns-default-gfh8r" (UID: "e83de341-8e6e-47ff-b99a-859fe33c83e6") : secret "dns-default-metrics-tls" not found Jun 08 12:10:04.016025 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:04.015883 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:04.016581 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:04.016142 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:10:04.016581 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:04.016166 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7fd6b98f-zjgzz: secret "image-registry-tls" not found Jun 08 12:10:04.016581 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:04.016245 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls podName:75ea9270-5ce5-4e3e-b123-b1d099383c10 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:08.016223944 +0000 UTC m=+43.077349093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls") pod "image-registry-b7fd6b98f-zjgzz" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10") : secret "image-registry-tls" not found Jun 08 12:10:04.117067 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:04.117028 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:04.117224 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:04.117169 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:04.117263 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:04.117238 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls podName:e83de341-8e6e-47ff-b99a-859fe33c83e6 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:08.117224055 +0000 UTC m=+43.178349202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls") pod "dns-default-gfh8r" (UID: "e83de341-8e6e-47ff-b99a-859fe33c83e6") : secret "dns-default-metrics-tls" not found Jun 08 12:10:04.582568 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:04.582471 2584 generic.go:356] "Generic (PLEG): container finished" podID="079697c1-565d-4f5a-a03f-c52588d0f1e8" containerID="c1cea17229477eab64fd02573563f1184f983d4d9f07e5b47eb71cf49ad1f019" exitCode=0 Jun 08 12:10:04.582568 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:04.582555 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" event={"ID":"079697c1-565d-4f5a-a03f-c52588d0f1e8","Type":"ContainerDied","Data":"c1cea17229477eab64fd02573563f1184f983d4d9f07e5b47eb71cf49ad1f019"} Jun 08 12:10:04.583924 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:04.583902 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-99vw4" event={"ID":"305be2de-71c9-4673-870e-b0c19976f8db","Type":"ContainerStarted","Data":"6b397fddca5db3e197bb10d526ecd07d75df3f5eac9fcc80e4244adcd1db7e46"} Jun 08 12:10:04.623126 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:04.623085 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-99vw4" podStartSLOduration=1.679246749 podStartE2EDuration="4.623069942s" totalImagesPullingTime="2.943823193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:04.622377364 +0000 UTC m=+39.683502530" watchObservedRunningTime="2026-06-08 12:10:04.623069942 +0000 UTC m=+39.684195091" Jun 08 12:10:05.589674 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.589640 2584 generic.go:356] "Generic (PLEG): container finished" podID="079697c1-565d-4f5a-a03f-c52588d0f1e8" containerID="65bc1dcf35ecab8852bc7a038267e64e8638c1ac3ff70f8d8ef9f34673268f71" exitCode=0 Jun 08 12:10:05.590260 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.589698 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" event={"ID":"079697c1-565d-4f5a-a03f-c52588d0f1e8","Type":"ContainerDied","Data":"65bc1dcf35ecab8852bc7a038267e64e8638c1ac3ff70f8d8ef9f34673268f71"} Jun 08 12:10:05.900958 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.900866 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7"] Jun 08 12:10:05.920361 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.920333 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:05.925266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.921577 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7"] Jun 08 12:10:05.925266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.924746 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 08 12:10:05.925266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.924826 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 08 12:10:05.925266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.925045 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 08 12:10:05.925266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.925122 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 08 12:10:05.925266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.925175 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 12:10:05.925663 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.925353 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 12:10:05.925663 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:05.925378 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 12:10:06.034230 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.034188 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-ca\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.034230 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.034227 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9affbc9a-8d07-476f-b258-35f631d639f7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.034460 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.034265 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.034460 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.034325 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.034460 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.034385 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-hub\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.034460 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.034404 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ztk6\" (UniqueName: \"kubernetes.io/projected/9affbc9a-8d07-476f-b258-35f631d639f7-kube-api-access-8ztk6\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.135077 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.135042 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-hub\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.135077 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.135081 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ztk6\" (UniqueName: \"kubernetes.io/projected/9affbc9a-8d07-476f-b258-35f631d639f7-kube-api-access-8ztk6\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.135314 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.135116 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-ca\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.135314 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.135131 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9affbc9a-8d07-476f-b258-35f631d639f7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.135314 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.135174 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.135314 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.135216 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.135943 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.135915 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9affbc9a-8d07-476f-b258-35f631d639f7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.139049 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.139026 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.139049 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.139040 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.139180 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.139049 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-hub\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.139180 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.139030 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9affbc9a-8d07-476f-b258-35f631d639f7-ca\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.142670 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.142650 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ztk6\" (UniqueName: \"kubernetes.io/projected/9affbc9a-8d07-476f-b258-35f631d639f7-kube-api-access-8ztk6\") pod \"cluster-proxy-proxy-agent-788f74cb48-cd9f7\" (UID: \"9affbc9a-8d07-476f-b258-35f631d639f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.245883 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.245787 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:10:06.410825 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.410791 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7"] Jun 08 12:10:06.413840 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:10:06.413805 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9affbc9a_8d07_476f_b258_35f631d639f7.slice/crio-54de1ba652e88612633345e789944d650f0c462c688993f9c3336bbeb9561fc4 WatchSource:0}: Error finding container 54de1ba652e88612633345e789944d650f0c462c688993f9c3336bbeb9561fc4: Status 404 returned error can't find the container with id 54de1ba652e88612633345e789944d650f0c462c688993f9c3336bbeb9561fc4 Jun 08 12:10:06.592909 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.592874 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" event={"ID":"9affbc9a-8d07-476f-b258-35f631d639f7","Type":"ContainerStarted","Data":"54de1ba652e88612633345e789944d650f0c462c688993f9c3336bbeb9561fc4"} Jun 08 12:10:06.596202 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.596177 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" event={"ID":"079697c1-565d-4f5a-a03f-c52588d0f1e8","Type":"ContainerStarted","Data":"a5390591948718ed183014603d8cd2b61471bbb87c4cb8fbc241b8175545961d"} Jun 08 12:10:06.624655 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:06.624603 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kbzz9" podStartSLOduration=9.404681699 podStartE2EDuration="41.624584171s" totalImagesPullingTime="32.219902472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:06.623177512 +0000 UTC m=+41.684302680" watchObservedRunningTime="2026-06-08 12:10:06.624584171 +0000 UTC m=+41.685709339" Jun 08 12:10:08.052499 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:08.052460 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:08.052969 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:08.052630 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:10:08.052969 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:08.052647 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7fd6b98f-zjgzz: secret "image-registry-tls" not found Jun 08 12:10:08.052969 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:08.052705 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls podName:75ea9270-5ce5-4e3e-b123-b1d099383c10 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:16.052689722 +0000 UTC m=+51.113814870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls") pod "image-registry-b7fd6b98f-zjgzz" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10") : secret "image-registry-tls" not found Jun 08 12:10:08.153317 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:08.153281 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:08.153965 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:08.153520 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:08.153965 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:08.153598 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls podName:e83de341-8e6e-47ff-b99a-859fe33c83e6 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:16.15357833 +0000 UTC m=+51.214703486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls") pod "dns-default-gfh8r" (UID: "e83de341-8e6e-47ff-b99a-859fe33c83e6") : secret "dns-default-metrics-tls" not found Jun 08 12:10:10.608660 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:10.608627 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" event={"ID":"9affbc9a-8d07-476f-b258-35f631d639f7","Type":"ContainerStarted","Data":"fbb4d99433a5d53cacb42268ed1f1899fd819ae7235213cc81c93f4241889400"} Jun 08 12:10:11.612717 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:11.612673 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" event={"ID":"9affbc9a-8d07-476f-b258-35f631d639f7","Type":"ContainerStarted","Data":"37fc12938a7932c5581acd218ef360ae258b9c2a610ff45677332cb4e6207286"} Jun 08 12:10:11.612717 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:11.612714 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" event={"ID":"9affbc9a-8d07-476f-b258-35f631d639f7","Type":"ContainerStarted","Data":"451a6bc2a72ab79c502bccb5f620c98b7a9d1beb19d07e8baed58253718c40cb"} Jun 08 12:10:11.636735 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:11.636684 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" podStartSLOduration=2.564595148 podStartE2EDuration="6.636669805s" totalImagesPullingTime="4.072074657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:11.635540471 +0000 UTC m=+46.696665648" watchObservedRunningTime="2026-06-08 12:10:11.636669805 +0000 UTC m=+46.697794971" Jun 08 12:10:16.111732 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:16.111691 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:16.112208 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:16.111871 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:10:16.112208 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:16.111895 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7fd6b98f-zjgzz: secret "image-registry-tls" not found Jun 08 12:10:16.112208 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:16.111956 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls podName:75ea9270-5ce5-4e3e-b123-b1d099383c10 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:32.111940228 +0000 UTC m=+67.173065372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls") pod "image-registry-b7fd6b98f-zjgzz" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10") : secret "image-registry-tls" not found Jun 08 12:10:16.212301 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:16.212257 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:16.212482 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:16.212410 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:16.212482 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:16.212473 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls podName:e83de341-8e6e-47ff-b99a-859fe33c83e6 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:32.212454462 +0000 UTC m=+67.273579609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls") pod "dns-default-gfh8r" (UID: "e83de341-8e6e-47ff-b99a-859fe33c83e6") : secret "dns-default-metrics-tls" not found Jun 08 12:10:27.567083 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:27.567057 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt29v" Jun 08 12:10:30.114750 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.114713 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:10:30.115187 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.114770 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:10:30.117277 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.117253 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:10:30.117335 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.117318 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:10:30.125462 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:30.125443 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 12:10:30.125525 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:30.125514 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs podName:ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b nodeName:}" failed. No retries permitted until 2026-06-08 12:11:34.125492772 +0000 UTC m=+129.186617935 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs") pod "network-metrics-daemon-vdsvw" (UID: "ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b") : secret "metrics-daemon-secret" not found Jun 08 12:10:30.127717 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.127700 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2566b6-1a94-4bd2-bea1-10852ae45061-original-pull-secret\") pod \"global-pull-secret-syncer-kz97q\" (UID: \"dc2566b6-1a94-4bd2-bea1-10852ae45061\") " pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:10:30.316089 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.316041 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ksjk\" (UniqueName: \"kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk\") pod \"network-check-target-chx9n\" (UID: \"f22d64d7-163e-4ada-9869-d53b62eaca3f\") " pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:10:30.318727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.318705 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 12:10:30.328669 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.328642 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 12:10:30.339758 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.339730 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ksjk\" (UniqueName: \"kubernetes.io/projected/f22d64d7-163e-4ada-9869-d53b62eaca3f-kube-api-access-4ksjk\") pod \"network-check-target-chx9n\" (UID: \"f22d64d7-163e-4ada-9869-d53b62eaca3f\") " pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:10:30.389244 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.389166 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nvw7c\"" Jun 08 12:10:30.393036 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.393021 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz97q" Jun 08 12:10:30.396638 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.396620 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:10:30.523878 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.523844 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kz97q"] Jun 08 12:10:30.526831 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:10:30.526805 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2566b6_1a94_4bd2_bea1_10852ae45061.slice/crio-44d48a3b13afbc75522126ffa10b6e7c4d32eff5e9890f1744c51a6566c92d7e WatchSource:0}: Error finding container 44d48a3b13afbc75522126ffa10b6e7c4d32eff5e9890f1744c51a6566c92d7e: Status 404 returned error can't find the container with id 44d48a3b13afbc75522126ffa10b6e7c4d32eff5e9890f1744c51a6566c92d7e Jun 08 12:10:30.541823 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.539079 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-chx9n"] Jun 08 12:10:30.542341 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:10:30.542320 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22d64d7_163e_4ada_9869_d53b62eaca3f.slice/crio-66c96f13c8d20b0ab5680380316f1de9bfe9ae5a64cd9b42c5ef398635a314ec WatchSource:0}: Error finding container 66c96f13c8d20b0ab5680380316f1de9bfe9ae5a64cd9b42c5ef398635a314ec: Status 404 returned error can't find the container with id 66c96f13c8d20b0ab5680380316f1de9bfe9ae5a64cd9b42c5ef398635a314ec Jun 08 12:10:30.657319 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.657224 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-chx9n" event={"ID":"f22d64d7-163e-4ada-9869-d53b62eaca3f","Type":"ContainerStarted","Data":"66c96f13c8d20b0ab5680380316f1de9bfe9ae5a64cd9b42c5ef398635a314ec"} Jun 08 12:10:30.658204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:30.658181 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kz97q" event={"ID":"dc2566b6-1a94-4bd2-bea1-10852ae45061","Type":"ContainerStarted","Data":"44d48a3b13afbc75522126ffa10b6e7c4d32eff5e9890f1744c51a6566c92d7e"} Jun 08 12:10:32.130715 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:32.130678 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:10:32.131188 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:32.130874 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:10:32.131188 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:32.130897 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7fd6b98f-zjgzz: secret "image-registry-tls" not found Jun 08 12:10:32.131188 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:32.130967 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls podName:75ea9270-5ce5-4e3e-b123-b1d099383c10 nodeName:}" failed. No retries permitted until 2026-06-08 12:11:04.130949324 +0000 UTC m=+99.192074486 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls") pod "image-registry-b7fd6b98f-zjgzz" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10") : secret "image-registry-tls" not found Jun 08 12:10:32.231125 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:32.231091 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:10:32.231292 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:32.231242 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:32.231356 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:10:32.231301 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls podName:e83de341-8e6e-47ff-b99a-859fe33c83e6 nodeName:}" failed. No retries permitted until 2026-06-08 12:11:04.231285946 +0000 UTC m=+99.292411093 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls") pod "dns-default-gfh8r" (UID: "e83de341-8e6e-47ff-b99a-859fe33c83e6") : secret "dns-default-metrics-tls" not found Jun 08 12:10:36.675852 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:36.675809 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-chx9n" event={"ID":"f22d64d7-163e-4ada-9869-d53b62eaca3f","Type":"ContainerStarted","Data":"af086bb9bc4181bdb646eb490e166ffa7f6892136f46c2a9b8d9bcba7752e5a5"} Jun 08 12:10:36.676359 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:36.675930 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:10:36.677267 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:36.677245 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kz97q" event={"ID":"dc2566b6-1a94-4bd2-bea1-10852ae45061","Type":"ContainerStarted","Data":"35c921695e14508c61068d08cdcdc93064faabe66928893d8c4b7d0e04041f36"} Jun 08 12:10:36.692017 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:10:36.691948 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-chx9n" podStartSLOduration=66.240834147 podStartE2EDuration="1m11.691933045s" totalImagesPullingTime="5.451098898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:36.691469432 +0000 UTC m=+71.752594600" watchObservedRunningTime="2026-06-08 12:10:36.691933045 +0000 UTC m=+71.753058212" Jun 08 12:11:04.159238 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:11:04.159197 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:11:04.159787 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:11:04.159327 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:11:04.159787 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:11:04.159340 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7fd6b98f-zjgzz: secret "image-registry-tls" not found Jun 08 12:11:04.159787 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:11:04.159395 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls podName:75ea9270-5ce5-4e3e-b123-b1d099383c10 nodeName:}" failed. No retries permitted until 2026-06-08 12:12:08.159380011 +0000 UTC m=+163.220505155 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls") pod "image-registry-b7fd6b98f-zjgzz" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10") : secret "image-registry-tls" not found Jun 08 12:11:04.259825 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:11:04.259771 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:11:04.260008 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:11:04.259899 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:11:04.260008 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:11:04.259960 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls podName:e83de341-8e6e-47ff-b99a-859fe33c83e6 nodeName:}" failed. No retries permitted until 2026-06-08 12:12:08.259946714 +0000 UTC m=+163.321071864 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls") pod "dns-default-gfh8r" (UID: "e83de341-8e6e-47ff-b99a-859fe33c83e6") : secret "dns-default-metrics-tls" not found Jun 08 12:11:07.682837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:11:07.682807 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-chx9n" Jun 08 12:11:07.705256 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:11:07.705207 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kz97q" podStartSLOduration=97.237146588 podStartE2EDuration="1m42.705169943s" totalImagesPullingTime="5.468023355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:36.705426136 +0000 UTC m=+71.766551302" watchObservedRunningTime="2026-06-08 12:11:07.705169943 +0000 UTC m=+102.766295168" Jun 08 12:11:34.179334 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:11:34.179282 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:11:34.179842 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:11:34.179412 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 12:11:34.179842 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:11:34.179469 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs podName:ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b nodeName:}" failed. No retries permitted until 2026-06-08 12:13:36.179453632 +0000 UTC m=+251.240578777 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs") pod "network-metrics-daemon-vdsvw" (UID: "ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b") : secret "metrics-daemon-secret" not found Jun 08 12:12:03.319528 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:12:03.319464 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" podUID="75ea9270-5ce5-4e3e-b123-b1d099383c10" Jun 08 12:12:03.344700 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:12:03.344661 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gfh8r" podUID="e83de341-8e6e-47ff-b99a-859fe33c83e6" Jun 08 12:12:03.397158 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:12:03.397119 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:12:03.919126 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:12:03.919089 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:12:03.919328 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:12:03.919089 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gfh8r" Jun 08 12:12:08.217844 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:12:08.217745 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:12:08.218285 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:12:08.217871 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:12:08.218285 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:12:08.217883 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7fd6b98f-zjgzz: secret "image-registry-tls" not found Jun 08 12:12:08.218285 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:12:08.217942 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls podName:75ea9270-5ce5-4e3e-b123-b1d099383c10 nodeName:}" failed. No retries permitted until 2026-06-08 12:14:10.217929333 +0000 UTC m=+285.279054478 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls") pod "image-registry-b7fd6b98f-zjgzz" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10") : secret "image-registry-tls" not found Jun 08 12:12:08.318498 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:12:08.318436 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:12:08.318668 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:12:08.318597 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:12:08.318708 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:12:08.318675 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls podName:e83de341-8e6e-47ff-b99a-859fe33c83e6 nodeName:}" failed. No retries permitted until 2026-06-08 12:14:10.318658515 +0000 UTC m=+285.379783661 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls") pod "dns-default-gfh8r" (UID: "e83de341-8e6e-47ff-b99a-859fe33c83e6") : secret "dns-default-metrics-tls" not found Jun 08 12:12:14.375798 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:12:14.375758 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:13:28.098013 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:28.097963 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hv8xt_ee2b4d11-85ce-48f3-aaf4-2bf19efeb291/dns-node-resolver/0.log" Jun 08 12:13:28.898107 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:28.898075 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sftwv_07032d7f-d6b8-4655-bbf6-4bcec05ab66b/node-ca/0.log" Jun 08 12:13:29.700171 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:29.700144 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-99vw4_305be2de-71c9-4673-870e-b0c19976f8db/serve-healthcheck-canary/0.log" Jun 08 12:13:36.257120 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:36.257068 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:13:36.257555 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:13:36.257201 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 12:13:36.257555 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:13:36.257258 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs podName:ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b nodeName:}" failed. No retries permitted until 2026-06-08 12:15:38.257242425 +0000 UTC m=+373.318367570 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs") pod "network-metrics-daemon-vdsvw" (UID: "ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b") : secret "metrics-daemon-secret" not found Jun 08 12:13:48.709900 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.709856 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cxs74"] Jun 08 12:13:48.711837 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.711818 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.714319 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.714293 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 12:13:48.715488 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.715471 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 12:13:48.715719 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.715701 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kznpq\"" Jun 08 12:13:48.715778 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.715701 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 12:13:48.715825 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.715704 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 12:13:48.726402 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.726379 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cxs74"] Jun 08 12:13:48.743705 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.743680 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4189b09-dd78-437e-8a60-396957a503b0-data-volume\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.743841 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.743738 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4189b09-dd78-437e-8a60-396957a503b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.743841 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.743798 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4189b09-dd78-437e-8a60-396957a503b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.743946 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.743843 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4189b09-dd78-437e-8a60-396957a503b0-crio-socket\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.743946 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.743876 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hnvr\" (UniqueName: \"kubernetes.io/projected/c4189b09-dd78-437e-8a60-396957a503b0-kube-api-access-2hnvr\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.844480 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.844429 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4189b09-dd78-437e-8a60-396957a503b0-data-volume\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.844683 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.844500 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4189b09-dd78-437e-8a60-396957a503b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.844683 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.844529 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4189b09-dd78-437e-8a60-396957a503b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.844683 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.844572 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4189b09-dd78-437e-8a60-396957a503b0-crio-socket\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.844683 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.844608 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hnvr\" (UniqueName: \"kubernetes.io/projected/c4189b09-dd78-437e-8a60-396957a503b0-kube-api-access-2hnvr\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.844884 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.844722 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4189b09-dd78-437e-8a60-396957a503b0-crio-socket\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.844884 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.844817 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4189b09-dd78-437e-8a60-396957a503b0-data-volume\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.845120 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.845101 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4189b09-dd78-437e-8a60-396957a503b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.847040 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.847024 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4189b09-dd78-437e-8a60-396957a503b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:48.866731 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:48.866702 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hnvr\" (UniqueName: \"kubernetes.io/projected/c4189b09-dd78-437e-8a60-396957a503b0-kube-api-access-2hnvr\") pod \"insights-runtime-extractor-cxs74\" (UID: \"c4189b09-dd78-437e-8a60-396957a503b0\") " pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:49.020510 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:49.020434 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cxs74" Jun 08 12:13:49.148659 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:49.145831 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cxs74"] Jun 08 12:13:49.151712 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:13:49.151686 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4189b09_dd78_437e_8a60_396957a503b0.slice/crio-e92c8a23167d3f4510cb9139255cfbdf5b360a1b29a4fe9860415de14f1100ed WatchSource:0}: Error finding container e92c8a23167d3f4510cb9139255cfbdf5b360a1b29a4fe9860415de14f1100ed: Status 404 returned error can't find the container with id e92c8a23167d3f4510cb9139255cfbdf5b360a1b29a4fe9860415de14f1100ed Jun 08 12:13:49.217792 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:49.217755 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxs74" event={"ID":"c4189b09-dd78-437e-8a60-396957a503b0","Type":"ContainerStarted","Data":"856b9bd571bf6edbeed754244e16557bdfc6b4611138acfaeff7b6f118ed164e"} Jun 08 12:13:49.217929 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:49.217828 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxs74" event={"ID":"c4189b09-dd78-437e-8a60-396957a503b0","Type":"ContainerStarted","Data":"e92c8a23167d3f4510cb9139255cfbdf5b360a1b29a4fe9860415de14f1100ed"} Jun 08 12:13:51.224445 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:51.224413 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxs74" event={"ID":"c4189b09-dd78-437e-8a60-396957a503b0","Type":"ContainerStarted","Data":"3a3e5c3519878e5ccd20272d96cf00e15faa0df0e27117ad8b446dfc5de84738"} Jun 08 12:13:55.238988 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:55.238938 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxs74" event={"ID":"c4189b09-dd78-437e-8a60-396957a503b0","Type":"ContainerStarted","Data":"be1fe53c1b0ce3bbdc226dd212ca96e34e60e5c18bd3efbc838cf910e96531e6"} Jun 08 12:13:55.260048 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:13:55.259996 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cxs74" podStartSLOduration=2.257945474 podStartE2EDuration="7.259966211s" totalImagesPullingTime="5.002020737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:13:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:55.25936307 +0000 UTC m=+270.320488227" watchObservedRunningTime="2026-06-08 12:13:55.259966211 +0000 UTC m=+270.321091377" Jun 08 12:14:04.097925 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.097892 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5t47s"] Jun 08 12:14:04.099951 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.099934 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.102549 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.102525 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 12:14:04.103410 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.103388 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 12:14:04.103410 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.103400 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4h642\"" Jun 08 12:14:04.103583 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.103439 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 12:14:04.103583 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.103567 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 12:14:04.103753 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.103693 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 12:14:04.103848 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.103827 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 12:14:04.152173 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.152139 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5595f219-a3c3-4769-81ea-d11dbbda659a-metrics-client-ca\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.152342 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.152198 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-textfile\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.152342 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.152249 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.152342 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.152282 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-wtmp\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.152342 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.152304 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5595f219-a3c3-4769-81ea-d11dbbda659a-sys\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.152342 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.152333 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpl4s\" (UniqueName: \"kubernetes.io/projected/5595f219-a3c3-4769-81ea-d11dbbda659a-kube-api-access-xpl4s\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.152513 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.152363 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5595f219-a3c3-4769-81ea-d11dbbda659a-root\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.152513 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.152397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-tls\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.152513 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.152417 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.252853 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.252809 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5595f219-a3c3-4769-81ea-d11dbbda659a-root\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.252853 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.252851 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-tls\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253148 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.252873 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253148 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.252923 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5595f219-a3c3-4769-81ea-d11dbbda659a-metrics-client-ca\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253148 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.252954 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-textfile\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253148 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.252949 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5595f219-a3c3-4769-81ea-d11dbbda659a-root\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253148 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.253011 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253148 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.253041 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-wtmp\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253148 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.253058 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5595f219-a3c3-4769-81ea-d11dbbda659a-sys\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253148 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.253082 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpl4s\" (UniqueName: \"kubernetes.io/projected/5595f219-a3c3-4769-81ea-d11dbbda659a-kube-api-access-xpl4s\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253508 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.253183 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5595f219-a3c3-4769-81ea-d11dbbda659a-sys\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253508 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.253227 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-wtmp\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253508 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.253435 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-textfile\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253635 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.253547 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.253684 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.253667 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5595f219-a3c3-4769-81ea-d11dbbda659a-metrics-client-ca\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.255614 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.255592 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.255710 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.255656 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5595f219-a3c3-4769-81ea-d11dbbda659a-node-exporter-tls\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.261404 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.261379 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpl4s\" (UniqueName: \"kubernetes.io/projected/5595f219-a3c3-4769-81ea-d11dbbda659a-kube-api-access-xpl4s\") pod \"node-exporter-5t47s\" (UID: \"5595f219-a3c3-4769-81ea-d11dbbda659a\") " pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.409362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:04.409267 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5t47s" Jun 08 12:14:04.418626 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:14:04.418597 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5595f219_a3c3_4769_81ea_d11dbbda659a.slice/crio-8019f6afac7f8f7b204d686882530a467c4cbcf3d5dcf7975446bd492970c5fd WatchSource:0}: Error finding container 8019f6afac7f8f7b204d686882530a467c4cbcf3d5dcf7975446bd492970c5fd: Status 404 returned error can't find the container with id 8019f6afac7f8f7b204d686882530a467c4cbcf3d5dcf7975446bd492970c5fd Jun 08 12:14:05.268595 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:05.268559 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5t47s" event={"ID":"5595f219-a3c3-4769-81ea-d11dbbda659a","Type":"ContainerStarted","Data":"8019f6afac7f8f7b204d686882530a467c4cbcf3d5dcf7975446bd492970c5fd"} Jun 08 12:14:06.247742 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:06.247706 2584 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" podUID="9affbc9a-8d07-476f-b258-35f631d639f7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 12:14:06.273051 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:06.273013 2584 generic.go:356] "Generic (PLEG): container finished" podID="5595f219-a3c3-4769-81ea-d11dbbda659a" containerID="c6e86c49f91ff75a623acc0564549c053ab8bbdf1c10a8a6e9dccadbd71d7129" exitCode=0 Jun 08 12:14:06.273527 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:06.273080 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5t47s" event={"ID":"5595f219-a3c3-4769-81ea-d11dbbda659a","Type":"ContainerDied","Data":"c6e86c49f91ff75a623acc0564549c053ab8bbdf1c10a8a6e9dccadbd71d7129"} Jun 08 12:14:06.919988 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:14:06.919929 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" podUID="75ea9270-5ce5-4e3e-b123-b1d099383c10" Jun 08 12:14:06.920197 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:14:06.919926 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gfh8r" podUID="e83de341-8e6e-47ff-b99a-859fe33c83e6" Jun 08 12:14:07.278777 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:07.278698 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:14:07.278777 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:07.278699 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5t47s" event={"ID":"5595f219-a3c3-4769-81ea-d11dbbda659a","Type":"ContainerStarted","Data":"c92f2b593c95f5f9b3406a83c4453b7c4973137151d04e13ef1f0da0301d157f"} Jun 08 12:14:07.278777 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:07.278768 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5t47s" event={"ID":"5595f219-a3c3-4769-81ea-d11dbbda659a","Type":"ContainerStarted","Data":"8d9f8bc827c305f564f10abb257400ef5eaedcec40519c3b3a104e3b002506d9"} Jun 08 12:14:07.279270 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:07.278935 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gfh8r" Jun 08 12:14:07.301843 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:07.301789 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5t47s" podStartSLOduration=2.358716476 podStartE2EDuration="3.301776527s" totalImagesPullingTime="869.749745ms" totalInitContainerRuntime="73.310306ms" isStatefulPod=true podCreationTimestamp="2026-06-08 12:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:07.300873172 +0000 UTC m=+282.361998340" watchObservedRunningTime="2026-06-08 12:14:07.301776527 +0000 UTC m=+282.362901693" Jun 08 12:14:10.306162 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.306120 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:14:10.308680 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.308658 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"image-registry-b7fd6b98f-zjgzz\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:14:10.312099 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.312077 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:14:10.316383 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.316359 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.318834 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.318816 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 12:14:10.318968 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.318949 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 12:14:10.319099 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.319083 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 12:14:10.319174 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.319089 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kpvn9\"" Jun 08 12:14:10.319174 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.319088 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 12:14:10.319174 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.319157 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 12:14:10.319561 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.319545 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 12:14:10.319699 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.319686 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 12:14:10.319764 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.319696 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 12:14:10.319869 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.319854 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 12:14:10.319938 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.319909 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 12:14:10.319938 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.319917 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5ffcputd6k654\"" Jun 08 12:14:10.320057 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.319922 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 12:14:10.320175 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.320159 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 12:14:10.320234 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.320194 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 12:14:10.320234 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.320200 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 12:14:10.322384 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.322367 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 12:14:10.336295 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.336269 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:14:10.407477 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407436 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407477 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407476 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407754 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407507 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407754 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407576 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:14:10.407754 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407620 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407754 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407651 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407754 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407677 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrjlq\" (UniqueName: \"kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-kube-api-access-nrjlq\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407754 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407707 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407962 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407781 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407962 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407811 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407962 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407833 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407962 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407891 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407962 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407910 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407962 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407927 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-config\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.407962 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407943 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.408247 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.407995 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.408247 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.408017 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.408247 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.408036 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.408247 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.408054 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.408247 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.408073 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.408247 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.408122 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.410055 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.410038 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e83de341-8e6e-47ff-b99a-859fe33c83e6-metrics-tls\") pod \"dns-default-gfh8r\" (UID: \"e83de341-8e6e-47ff-b99a-859fe33c83e6\") " pod="openshift-dns/dns-default-gfh8r" Jun 08 12:14:10.509471 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509429 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.509471 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509466 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.509727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509484 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.509727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509504 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.509727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509522 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.509727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509540 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.509727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509562 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.509727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509591 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.509727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509624 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.509727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509657 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.509727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509681 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.509727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509700 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrjlq\" (UniqueName: \"kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-kube-api-access-nrjlq\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.510224 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509725 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.510224 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509778 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.510224 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509801 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.510224 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509827 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.510224 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509863 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.510224 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509885 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.510224 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509910 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-config\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.510224 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.509955 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.510224 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.510059 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.510823 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.510590 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.512539 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.511469 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.512539 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.511793 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.512539 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.512368 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.513593 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.513530 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.513593 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.513575 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.513782 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.513761 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.514057 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.513929 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.514445 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.514423 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.514606 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.514565 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.514835 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.514809 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.515019 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.514909 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.515404 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.515375 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.515504 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.515411 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.515836 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.515809 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.516191 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.516172 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-config\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.516595 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.516571 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.516699 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.516685 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.520464 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.520449 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrjlq\" (UniqueName: \"kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-kube-api-access-nrjlq\") pod \"prometheus-k8s-0\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.582819 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.582738 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-txkmd\"" Jun 08 12:14:10.582996 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.582818 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8rrt4\"" Jun 08 12:14:10.590297 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.590281 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gfh8r" Jun 08 12:14:10.590374 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.590360 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:14:10.627036 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.626968 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:10.743061 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.743029 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b7fd6b98f-zjgzz"] Jun 08 12:14:10.747264 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:14:10.747237 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ea9270_5ce5_4e3e_b123_b1d099383c10.slice/crio-834c1d24fbf66dd11767c85bad7bb3dfca5991093b5f2f9ff5a5167831a1e50a WatchSource:0}: Error finding container 834c1d24fbf66dd11767c85bad7bb3dfca5991093b5f2f9ff5a5167831a1e50a: Status 404 returned error can't find the container with id 834c1d24fbf66dd11767c85bad7bb3dfca5991093b5f2f9ff5a5167831a1e50a Jun 08 12:14:10.761380 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.761347 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gfh8r"] Jun 08 12:14:10.801413 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:10.801383 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:14:10.806923 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:14:10.806896 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ee126b_164c_4a83_bca4_307bb96a76c7.slice/crio-1c0ba780c2efc119f3e1ec92e1a4bcd109ed30ece0833962a4f0260b7437b200 WatchSource:0}: Error finding container 1c0ba780c2efc119f3e1ec92e1a4bcd109ed30ece0833962a4f0260b7437b200: Status 404 returned error can't find the container with id 1c0ba780c2efc119f3e1ec92e1a4bcd109ed30ece0833962a4f0260b7437b200 Jun 08 12:14:11.293040 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:11.292999 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerStarted","Data":"1c0ba780c2efc119f3e1ec92e1a4bcd109ed30ece0833962a4f0260b7437b200"} Jun 08 12:14:11.294569 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:11.294536 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gfh8r" event={"ID":"e83de341-8e6e-47ff-b99a-859fe33c83e6","Type":"ContainerStarted","Data":"e97c714389161f14aed311f12b5ae2e185cb8d310679854111679cf317b86965"} Jun 08 12:14:11.296652 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:11.296614 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" event={"ID":"75ea9270-5ce5-4e3e-b123-b1d099383c10","Type":"ContainerStarted","Data":"1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e"} Jun 08 12:14:11.296755 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:11.296671 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" event={"ID":"75ea9270-5ce5-4e3e-b123-b1d099383c10","Type":"ContainerStarted","Data":"834c1d24fbf66dd11767c85bad7bb3dfca5991093b5f2f9ff5a5167831a1e50a"} Jun 08 12:14:11.297172 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:11.296936 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:14:11.320823 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:11.320610 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" podStartSLOduration=286.320590968 podStartE2EDuration="4m46.320590968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:11.319592128 +0000 UTC m=+286.380717300" watchObservedRunningTime="2026-06-08 12:14:11.320590968 +0000 UTC m=+286.381716235" Jun 08 12:14:12.303228 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:12.303189 2584 generic.go:356] "Generic (PLEG): container finished" podID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerID="5a39b068f0cfe3fc68ea9c9575628a406a849c5068a4e1815996d8d968bf4d2d" exitCode=0 Jun 08 12:14:12.303391 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:12.303257 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerDied","Data":"5a39b068f0cfe3fc68ea9c9575628a406a849c5068a4e1815996d8d968bf4d2d"} Jun 08 12:14:13.311124 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:13.311082 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gfh8r" event={"ID":"e83de341-8e6e-47ff-b99a-859fe33c83e6","Type":"ContainerStarted","Data":"76232f661631554686edbf17f2d538c8a1b308c25608525a1535db81ad2b23e9"} Jun 08 12:14:13.311538 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:13.311148 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gfh8r" event={"ID":"e83de341-8e6e-47ff-b99a-859fe33c83e6","Type":"ContainerStarted","Data":"297ab12591c0fd9f5c9ab97bb1e218ab835634e34293840664ea7e191b7d9110"} Jun 08 12:14:13.311538 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:13.311224 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gfh8r" Jun 08 12:14:13.331481 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:13.331426 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gfh8r" podStartSLOduration=251.596222082 podStartE2EDuration="4m13.331407078s" totalImagesPullingTime="1.735184996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:13.33041117 +0000 UTC m=+288.391536340" watchObservedRunningTime="2026-06-08 12:14:13.331407078 +0000 UTC m=+288.392532246" Jun 08 12:14:16.247090 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:16.247000 2584 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" podUID="9affbc9a-8d07-476f-b258-35f631d639f7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 12:14:16.324998 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:16.324946 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerStarted","Data":"aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352"} Jun 08 12:14:16.325132 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:16.325036 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerStarted","Data":"9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7"} Jun 08 12:14:17.376824 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:14:17.376782 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vdsvw" podUID="ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b" Jun 08 12:14:18.336150 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:18.336112 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerStarted","Data":"d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea"} Jun 08 12:14:18.336306 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:18.336226 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerStarted","Data":"f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6"} Jun 08 12:14:18.336306 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:18.336273 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerStarted","Data":"e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe"} Jun 08 12:14:18.336377 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:18.336310 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerStarted","Data":"288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39"} Jun 08 12:14:18.372282 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:18.372229 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.7747368730000002 podStartE2EDuration="8.372212526s" totalImagesPullingTime="6.574655114s" totalInitContainerRuntime="22.820539ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:18.37052904 +0000 UTC m=+293.431654206" watchObservedRunningTime="2026-06-08 12:14:18.372212526 +0000 UTC m=+293.433337741" Jun 08 12:14:20.627794 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:20.627756 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:14:23.318030 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:23.318000 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gfh8r" Jun 08 12:14:25.326370 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:25.326338 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:14:25.327056 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:25.327039 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:14:25.329420 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:25.329405 2584 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 12:14:26.247568 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:26.247533 2584 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" podUID="9affbc9a-8d07-476f-b258-35f631d639f7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 12:14:26.249771 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:26.247612 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" Jun 08 12:14:26.249771 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:26.248169 2584 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"37fc12938a7932c5581acd218ef360ae258b9c2a610ff45677332cb4e6207286"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 08 12:14:26.249771 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:26.248224 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" podUID="9affbc9a-8d07-476f-b258-35f631d639f7" containerName="service-proxy" containerID="cri-o://37fc12938a7932c5581acd218ef360ae258b9c2a610ff45677332cb4e6207286" gracePeriod=30 Jun 08 12:14:26.371379 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:26.371354 2584 generic.go:356] "Generic (PLEG): container finished" podID="9affbc9a-8d07-476f-b258-35f631d639f7" containerID="37fc12938a7932c5581acd218ef360ae258b9c2a610ff45677332cb4e6207286" exitCode=2 Jun 08 12:14:26.371763 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:26.371410 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" event={"ID":"9affbc9a-8d07-476f-b258-35f631d639f7","Type":"ContainerDied","Data":"37fc12938a7932c5581acd218ef360ae258b9c2a610ff45677332cb4e6207286"} Jun 08 12:14:27.382735 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:27.382698 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788f74cb48-cd9f7" event={"ID":"9affbc9a-8d07-476f-b258-35f631d639f7","Type":"ContainerStarted","Data":"160c73de3af6f61927c38baaf5c63eadea63b0729564638997f0e2f74c0bf2c0"} Jun 08 12:14:30.595256 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:30.595219 2584 patch_prober.go:28] interesting pod/image-registry-b7fd6b98f-zjgzz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 12:14:30.595626 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:30.595269 2584 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" podUID="75ea9270-5ce5-4e3e-b123-b1d099383c10" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:14:31.375523 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:31.375489 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:14:32.308260 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:32.308230 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:14:39.137545 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:39.137513 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b7fd6b98f-zjgzz"] Jun 08 12:14:56.336024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:56.335962 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b7fd6b98f-zjgzz_75ea9270-5ce5-4e3e-b123-b1d099383c10/registry/0.log" Jun 08 12:14:56.349402 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:14:56.349378 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sftwv_07032d7f-d6b8-4655-bbf6-4bcec05ab66b/node-ca/0.log" Jun 08 12:15:04.157383 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:04.157341 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" podUID="75ea9270-5ce5-4e3e-b123-b1d099383c10" containerName="registry" containerID="cri-o://1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e" gracePeriod=30 Jun 08 12:15:05.405198 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.405175 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:15:05.464639 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.464606 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gg74\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-kube-api-access-6gg74\") pod \"75ea9270-5ce5-4e3e-b123-b1d099383c10\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " Jun 08 12:15:05.464829 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.464649 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") pod \"75ea9270-5ce5-4e3e-b123-b1d099383c10\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " Jun 08 12:15:05.464829 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.464683 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-trusted-ca\") pod \"75ea9270-5ce5-4e3e-b123-b1d099383c10\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " Jun 08 12:15:05.464829 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.464721 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-bound-sa-token\") pod \"75ea9270-5ce5-4e3e-b123-b1d099383c10\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " Jun 08 12:15:05.464829 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.464748 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-installation-pull-secrets\") pod \"75ea9270-5ce5-4e3e-b123-b1d099383c10\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " Jun 08 12:15:05.464829 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.464772 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75ea9270-5ce5-4e3e-b123-b1d099383c10-ca-trust-extracted\") pod \"75ea9270-5ce5-4e3e-b123-b1d099383c10\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " Jun 08 12:15:05.464829 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.464806 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-image-registry-private-configuration\") pod \"75ea9270-5ce5-4e3e-b123-b1d099383c10\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " Jun 08 12:15:05.465159 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.464847 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-certificates\") pod \"75ea9270-5ce5-4e3e-b123-b1d099383c10\" (UID: \"75ea9270-5ce5-4e3e-b123-b1d099383c10\") " Jun 08 12:15:05.466447 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.466062 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "75ea9270-5ce5-4e3e-b123-b1d099383c10" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:05.466447 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.466368 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "75ea9270-5ce5-4e3e-b123-b1d099383c10" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:05.474750 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.474439 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-kube-api-access-6gg74" (OuterVolumeSpecName: "kube-api-access-6gg74") pod "75ea9270-5ce5-4e3e-b123-b1d099383c10" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10"). InnerVolumeSpecName "kube-api-access-6gg74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:15:05.474750 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.474724 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "75ea9270-5ce5-4e3e-b123-b1d099383c10" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:05.475024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.474840 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "75ea9270-5ce5-4e3e-b123-b1d099383c10" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:15:05.475024 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.474919 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "75ea9270-5ce5-4e3e-b123-b1d099383c10" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:05.475495 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.475402 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "75ea9270-5ce5-4e3e-b123-b1d099383c10" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:15:05.476787 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.476763 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ea9270-5ce5-4e3e-b123-b1d099383c10-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "75ea9270-5ce5-4e3e-b123-b1d099383c10" (UID: "75ea9270-5ce5-4e3e-b123-b1d099383c10"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:15:05.502565 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.502495 2584 generic.go:356] "Generic (PLEG): container finished" podID="75ea9270-5ce5-4e3e-b123-b1d099383c10" containerID="1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e" exitCode=0 Jun 08 12:15:05.502565 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.502553 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" Jun 08 12:15:05.502698 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.502552 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" event={"ID":"75ea9270-5ce5-4e3e-b123-b1d099383c10","Type":"ContainerDied","Data":"1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e"} Jun 08 12:15:05.502732 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.502702 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7fd6b98f-zjgzz" event={"ID":"75ea9270-5ce5-4e3e-b123-b1d099383c10","Type":"ContainerDied","Data":"834c1d24fbf66dd11767c85bad7bb3dfca5991093b5f2f9ff5a5167831a1e50a"} Jun 08 12:15:05.502768 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.502744 2584 scope.go:117] "RemoveContainer" containerID="1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e" Jun 08 12:15:05.511130 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.511114 2584 scope.go:117] "RemoveContainer" containerID="1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e" Jun 08 12:15:05.511414 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:15:05.511394 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e\": container with ID starting with 1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e not found: ID does not exist" containerID="1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e" Jun 08 12:15:05.511472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.511422 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e"} err="failed to get container status \"1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e\": rpc error: code = NotFound desc = could not find container \"1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e\": container with ID starting with 1ecb23625067fbcd15f69ac9abaf766ca8afe5e1c1a9369543fcb924694c311e not found: ID does not exist" Jun 08 12:15:05.530629 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.530603 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b7fd6b98f-zjgzz"] Jun 08 12:15:05.533878 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.533857 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b7fd6b98f-zjgzz"] Jun 08 12:15:05.565910 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.565833 2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-tls\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:05.565910 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.565860 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-trusted-ca\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:05.565910 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.565869 2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-bound-sa-token\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:05.565910 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.565877 2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-installation-pull-secrets\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:05.565910 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.565886 2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75ea9270-5ce5-4e3e-b123-b1d099383c10-ca-trust-extracted\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:05.565910 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.565895 2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75ea9270-5ce5-4e3e-b123-b1d099383c10-image-registry-private-configuration\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:05.565910 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.565903 2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75ea9270-5ce5-4e3e-b123-b1d099383c10-registry-certificates\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:05.565910 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:05.565914 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gg74\" (UniqueName: \"kubernetes.io/projected/75ea9270-5ce5-4e3e-b123-b1d099383c10-kube-api-access-6gg74\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:07.380370 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:07.380338 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75ea9270-5ce5-4e3e-b123-b1d099383c10" path="/var/lib/kubelet/pods/75ea9270-5ce5-4e3e-b123-b1d099383c10/volumes" Jun 08 12:15:10.627634 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:10.627605 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:10.647919 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:10.647893 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:11.544159 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:11.544126 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:28.660600 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:28.660560 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:15:28.661136 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:28.660964 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="prometheus" containerID="cri-o://9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7" gracePeriod=600 Jun 08 12:15:28.661136 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:28.661005 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="thanos-sidecar" containerID="cri-o://288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39" gracePeriod=600 Jun 08 12:15:28.661136 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:28.661031 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy-web" containerID="cri-o://e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe" gracePeriod=600 Jun 08 12:15:28.661136 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:28.661046 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="config-reloader" containerID="cri-o://aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352" gracePeriod=600 Jun 08 12:15:28.661136 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:28.661005 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy" containerID="cri-o://f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6" gracePeriod=600 Jun 08 12:15:28.661136 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:28.661008 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea" gracePeriod=600 Jun 08 12:15:29.591864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:29.591828 2584 generic.go:356] "Generic (PLEG): container finished" podID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerID="d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea" exitCode=0 Jun 08 12:15:29.591864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:29.591853 2584 generic.go:356] "Generic (PLEG): container finished" podID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerID="f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6" exitCode=0 Jun 08 12:15:29.591864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:29.591860 2584 generic.go:356] "Generic (PLEG): container finished" podID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerID="288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39" exitCode=0 Jun 08 12:15:29.591864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:29.591866 2584 generic.go:356] "Generic (PLEG): container finished" podID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerID="aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352" exitCode=0 Jun 08 12:15:29.591864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:29.591871 2584 generic.go:356] "Generic (PLEG): container finished" podID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerID="9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7" exitCode=0 Jun 08 12:15:29.592179 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:29.591896 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerDied","Data":"d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea"} Jun 08 12:15:29.592179 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:29.591958 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerDied","Data":"f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6"} Jun 08 12:15:29.592179 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:29.592001 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerDied","Data":"288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39"} Jun 08 12:15:29.592179 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:29.592026 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerDied","Data":"aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352"} Jun 08 12:15:29.592179 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:29.592049 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerDied","Data":"9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7"} Jun 08 12:15:29.893765 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:29.893737 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.065592 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065549 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-kubelet-serving-ca-bundle\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.065592 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065595 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-serving-certs-ca-bundle\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.065851 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065613 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-trusted-ca-bundle\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.065851 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065632 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-0\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.065851 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065656 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.065851 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065771 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.065851 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065795 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-web-config\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.065851 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065818 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-1\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.065851 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065839 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-grpc-tls\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065866 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-kube-rbac-proxy\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065894 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-tls\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065934 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-2\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.065970 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-db\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066024 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-thanos-prometheus-http-client-file\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066050 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-config-out\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066078 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrjlq\" (UniqueName: \"kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-kube-api-access-nrjlq\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066092 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066107 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-config\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066129 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066150 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066182 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-metrics-client-certs\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066208 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066210 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-tls-assets\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066798 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066268 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-metrics-client-ca\") pod \"a1ee126b-164c-4a83-bca4-307bb96a76c7\" (UID: \"a1ee126b-164c-4a83-bca4-307bb96a76c7\") " Jun 08 12:15:30.066798 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066511 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:30.066798 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066608 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.066798 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066627 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.066798 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066643 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.066798 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066722 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.067442 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.066808 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:30.067442 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.067365 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:30.067537 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.067201 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:30.069136 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.069109 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:15:30.069242 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.069214 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:30.069313 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.069257 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:30.069877 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.069784 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-config-out" (OuterVolumeSpecName: "config-out") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:15:30.069877 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.069866 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-config" (OuterVolumeSpecName: "config") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:30.070407 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.070382 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:30.070928 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.070891 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:30.071206 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.071168 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:30.071428 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.071410 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:30.071477 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.071456 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:15:30.071770 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.071744 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-kube-api-access-nrjlq" (OuterVolumeSpecName: "kube-api-access-nrjlq") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "kube-api-access-nrjlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:15:30.072033 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.072011 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:30.105121 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.105087 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-web-config" (OuterVolumeSpecName: "web-config") pod "a1ee126b-164c-4a83-bca4-307bb96a76c7" (UID: "a1ee126b-164c-4a83-bca4-307bb96a76c7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:30.167551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167459 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-db\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167493 2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167505 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1ee126b-164c-4a83-bca4-307bb96a76c7-config-out\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167514 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrjlq\" (UniqueName: \"kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-kube-api-access-nrjlq\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167523 2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-config\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167531 2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-metrics-client-certs\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167539 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1ee126b-164c-4a83-bca4-307bb96a76c7-tls-assets\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167548 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-configmap-metrics-client-ca\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167551 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167556 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167565 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167575 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167583 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-web-config\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167590 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1ee126b-164c-4a83-bca4-307bb96a76c7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167599 2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-grpc-tls\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167606 2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-kube-rbac-proxy\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.167926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.167614 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1ee126b-164c-4a83-bca4-307bb96a76c7-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:15:30.598737 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.598707 2584 generic.go:356] "Generic (PLEG): container finished" podID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerID="e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe" exitCode=0 Jun 08 12:15:30.598907 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.598751 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerDied","Data":"e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe"} Jun 08 12:15:30.598907 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.598794 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.598907 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.598819 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1ee126b-164c-4a83-bca4-307bb96a76c7","Type":"ContainerDied","Data":"1c0ba780c2efc119f3e1ec92e1a4bcd109ed30ece0833962a4f0260b7437b200"} Jun 08 12:15:30.598907 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.598853 2584 scope.go:117] "RemoveContainer" containerID="d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea" Jun 08 12:15:30.607462 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.607442 2584 scope.go:117] "RemoveContainer" containerID="f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6" Jun 08 12:15:30.618709 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.618687 2584 scope.go:117] "RemoveContainer" containerID="e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe" Jun 08 12:15:30.624475 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.624448 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:15:30.626433 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.626411 2584 scope.go:117] "RemoveContainer" containerID="288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39" Jun 08 12:15:30.628503 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.628486 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:15:30.633290 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.633270 2584 scope.go:117] "RemoveContainer" containerID="aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352" Jun 08 12:15:30.639987 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.639945 2584 scope.go:117] "RemoveContainer" containerID="9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7" Jun 08 12:15:30.647591 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.647573 2584 scope.go:117] "RemoveContainer" containerID="5a39b068f0cfe3fc68ea9c9575628a406a849c5068a4e1815996d8d968bf4d2d" Jun 08 12:15:30.653548 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653525 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:15:30.653771 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653758 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ea9270-5ce5-4e3e-b123-b1d099383c10" containerName="registry" Jun 08 12:15:30.653831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653772 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ea9270-5ce5-4e3e-b123-b1d099383c10" containerName="registry" Jun 08 12:15:30.653831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653780 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="config-reloader" Jun 08 12:15:30.653831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653786 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="config-reloader" Jun 08 12:15:30.653831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653793 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="thanos-sidecar" Jun 08 12:15:30.653831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653798 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="thanos-sidecar" Jun 08 12:15:30.653831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653806 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy-web" Jun 08 12:15:30.653831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653811 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy-web" Jun 08 12:15:30.653831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653819 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="init-config-reloader" Jun 08 12:15:30.653831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653825 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="init-config-reloader" Jun 08 12:15:30.653831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653830 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="prometheus" Jun 08 12:15:30.653831 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653836 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="prometheus" Jun 08 12:15:30.654472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653844 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy" Jun 08 12:15:30.654472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653849 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy" Jun 08 12:15:30.654472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653854 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy-thanos" Jun 08 12:15:30.654472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653859 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy-thanos" Jun 08 12:15:30.654472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653891 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="config-reloader" Jun 08 12:15:30.654472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653898 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy-thanos" Jun 08 12:15:30.654472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653904 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy-web" Jun 08 12:15:30.654472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653910 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="thanos-sidecar" Jun 08 12:15:30.654472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653916 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ea9270-5ce5-4e3e-b123-b1d099383c10" containerName="registry" Jun 08 12:15:30.654472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653921 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="kube-rbac-proxy" Jun 08 12:15:30.654472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.653926 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" containerName="prometheus" Jun 08 12:15:30.655058 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.655033 2584 scope.go:117] "RemoveContainer" containerID="d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea" Jun 08 12:15:30.655364 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:15:30.655346 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea\": container with ID starting with d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea not found: ID does not exist" containerID="d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea" Jun 08 12:15:30.655407 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.655372 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea"} err="failed to get container status \"d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea\": rpc error: code = NotFound desc = could not find container \"d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea\": container with ID starting with d080795856e93cf4bc6a71b478ede99d8de94d845114f1b471196beb89d5b4ea not found: ID does not exist" Jun 08 12:15:30.655407 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.655394 2584 scope.go:117] "RemoveContainer" containerID="f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6" Jun 08 12:15:30.655648 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:15:30.655627 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6\": container with ID starting with f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6 not found: ID does not exist" containerID="f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6" Jun 08 12:15:30.655707 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.655652 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6"} err="failed to get container status \"f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6\": rpc error: code = NotFound desc = could not find container \"f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6\": container with ID starting with f5fb0e3e2c020080da122ea1446b5606fce9f4be28edae064329cad44f99ecd6 not found: ID does not exist" Jun 08 12:15:30.655707 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.655665 2584 scope.go:117] "RemoveContainer" containerID="e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe" Jun 08 12:15:30.655890 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:15:30.655875 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe\": container with ID starting with e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe not found: ID does not exist" containerID="e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe" Jun 08 12:15:30.655937 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.655893 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe"} err="failed to get container status \"e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe\": rpc error: code = NotFound desc = could not find container \"e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe\": container with ID starting with e7251b1a17c7d58147678bdfdfb8095f0cd493c8a08695e4cc6ed550629248fe not found: ID does not exist" Jun 08 12:15:30.655937 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.655905 2584 scope.go:117] "RemoveContainer" containerID="288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39" Jun 08 12:15:30.656168 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:15:30.656151 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39\": container with ID starting with 288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39 not found: ID does not exist" containerID="288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39" Jun 08 12:15:30.656222 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.656171 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39"} err="failed to get container status \"288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39\": rpc error: code = NotFound desc = could not find container \"288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39\": container with ID starting with 288124a2daed659dd39d113a267bf0cf72b86bcb175676cf63a4e1c48f9b1d39 not found: ID does not exist" Jun 08 12:15:30.656222 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.656188 2584 scope.go:117] "RemoveContainer" containerID="aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352" Jun 08 12:15:30.656421 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:15:30.656395 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352\": container with ID starting with aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352 not found: ID does not exist" containerID="aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352" Jun 08 12:15:30.656471 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.656418 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352"} err="failed to get container status \"aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352\": rpc error: code = NotFound desc = could not find container \"aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352\": container with ID starting with aa0416d32e0554f71b36df8b4b3bcf7d39c46e6375556d6165da45299eb00352 not found: ID does not exist" Jun 08 12:15:30.656471 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.656433 2584 scope.go:117] "RemoveContainer" containerID="9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7" Jun 08 12:15:30.656667 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:15:30.656643 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7\": container with ID starting with 9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7 not found: ID does not exist" containerID="9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7" Jun 08 12:15:30.656714 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.656669 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7"} err="failed to get container status \"9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7\": rpc error: code = NotFound desc = could not find container \"9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7\": container with ID starting with 9eafcdde6cda05b28ccd0652193ef67d57dff040adb1935e451b49e2d25ab9b7 not found: ID does not exist" Jun 08 12:15:30.656714 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.656682 2584 scope.go:117] "RemoveContainer" containerID="5a39b068f0cfe3fc68ea9c9575628a406a849c5068a4e1815996d8d968bf4d2d" Jun 08 12:15:30.656895 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:15:30.656878 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a39b068f0cfe3fc68ea9c9575628a406a849c5068a4e1815996d8d968bf4d2d\": container with ID starting with 5a39b068f0cfe3fc68ea9c9575628a406a849c5068a4e1815996d8d968bf4d2d not found: ID does not exist" containerID="5a39b068f0cfe3fc68ea9c9575628a406a849c5068a4e1815996d8d968bf4d2d" Jun 08 12:15:30.656949 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.656905 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a39b068f0cfe3fc68ea9c9575628a406a849c5068a4e1815996d8d968bf4d2d"} err="failed to get container status \"5a39b068f0cfe3fc68ea9c9575628a406a849c5068a4e1815996d8d968bf4d2d\": rpc error: code = NotFound desc = could not find container \"5a39b068f0cfe3fc68ea9c9575628a406a849c5068a4e1815996d8d968bf4d2d\": container with ID starting with 5a39b068f0cfe3fc68ea9c9575628a406a849c5068a4e1815996d8d968bf4d2d not found: ID does not exist" Jun 08 12:15:30.657591 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.657575 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.660414 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.660394 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 12:15:30.660552 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.660434 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 12:15:30.660552 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.660423 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 12:15:30.660552 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.660456 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 12:15:30.660706 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.660670 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5ffcputd6k654\"" Jun 08 12:15:30.660850 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.660830 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kpvn9\"" Jun 08 12:15:30.660943 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.660902 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 12:15:30.661015 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.660997 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 12:15:30.661071 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.661059 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 12:15:30.661171 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.661062 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 12:15:30.661171 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.661154 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 12:15:30.661275 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.661171 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 12:15:30.661394 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.661350 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 12:15:30.661394 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.661393 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 12:15:30.661558 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.661405 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 12:15:30.663226 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.663201 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 12:15:30.665728 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.665710 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 12:15:30.676507 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.676477 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:15:30.771540 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771506 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771698 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771547 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ba52bca-8496-4063-a777-711df6f3dd1f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771698 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771566 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771698 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771586 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771698 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771632 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771698 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771686 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771858 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771709 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771858 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771729 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771858 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771804 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771858 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771835 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771996 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771866 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771996 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771895 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771996 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771917 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ba52bca-8496-4063-a777-711df6f3dd1f-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771996 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771932 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771996 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771952 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.771996 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.771968 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.772170 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.772007 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-config\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.772170 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.772021 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.772170 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.772040 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d6dg\" (UniqueName: \"kubernetes.io/projected/0ba52bca-8496-4063-a777-711df6f3dd1f-kube-api-access-6d6dg\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.772170 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.772074 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873251 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873163 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873251 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873204 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ba52bca-8496-4063-a777-711df6f3dd1f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873251 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873228 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873257 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873283 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873319 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873343 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873366 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873402 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873429 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873463 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873486 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873854 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873518 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ba52bca-8496-4063-a777-711df6f3dd1f-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873854 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873543 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873854 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873573 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873854 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873596 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873854 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873620 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-config\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873854 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873642 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873854 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873673 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d6dg\" (UniqueName: \"kubernetes.io/projected/0ba52bca-8496-4063-a777-711df6f3dd1f-kube-api-access-6d6dg\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873854 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873702 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.873854 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873765 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.874334 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.873907 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.874334 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.874216 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.874446 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.874331 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.876550 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.875119 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.876550 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.875695 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.876550 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.876462 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ba52bca-8496-4063-a777-711df6f3dd1f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.876550 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.876525 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.876840 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.876613 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ba52bca-8496-4063-a777-711df6f3dd1f-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.877452 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.877142 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.877452 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.877328 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.877452 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.877342 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.877716 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.877541 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.878423 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.878399 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.878622 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.878606 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ba52bca-8496-4063-a777-711df6f3dd1f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.879565 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.879239 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.879565 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.879533 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-config\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.880126 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.880105 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.880204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.880111 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ba52bca-8496-4063-a777-711df6f3dd1f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.882292 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.882271 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d6dg\" (UniqueName: \"kubernetes.io/projected/0ba52bca-8496-4063-a777-711df6f3dd1f-kube-api-access-6d6dg\") pod \"prometheus-k8s-0\" (UID: \"0ba52bca-8496-4063-a777-711df6f3dd1f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:30.967327 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:30.967274 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:31.110865 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:31.110822 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:15:31.115328 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:15:31.115298 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba52bca_8496_4063_a777_711df6f3dd1f.slice/crio-16005092c8341e81a0a2836f47a321af5671227f9bd23fdc9d9ab61dd09532fb WatchSource:0}: Error finding container 16005092c8341e81a0a2836f47a321af5671227f9bd23fdc9d9ab61dd09532fb: Status 404 returned error can't find the container with id 16005092c8341e81a0a2836f47a321af5671227f9bd23fdc9d9ab61dd09532fb Jun 08 12:15:31.380372 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:31.380287 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1ee126b-164c-4a83-bca4-307bb96a76c7" path="/var/lib/kubelet/pods/a1ee126b-164c-4a83-bca4-307bb96a76c7/volumes" Jun 08 12:15:31.604099 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:31.604066 2584 generic.go:356] "Generic (PLEG): container finished" podID="0ba52bca-8496-4063-a777-711df6f3dd1f" containerID="3f4d1e416b58cf7683c56e59b3fce2253a359113a28c71a6fa9c18eb7048753d" exitCode=0 Jun 08 12:15:31.604267 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:31.604123 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba52bca-8496-4063-a777-711df6f3dd1f","Type":"ContainerDied","Data":"3f4d1e416b58cf7683c56e59b3fce2253a359113a28c71a6fa9c18eb7048753d"} Jun 08 12:15:31.604267 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:31.604189 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba52bca-8496-4063-a777-711df6f3dd1f","Type":"ContainerStarted","Data":"16005092c8341e81a0a2836f47a321af5671227f9bd23fdc9d9ab61dd09532fb"} Jun 08 12:15:32.611057 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:32.611024 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba52bca-8496-4063-a777-711df6f3dd1f","Type":"ContainerStarted","Data":"1fa11f2553cb9e90d0c296a1d867b93dae90424cb1d6d577cd1fed751b0f1479"} Jun 08 12:15:32.611484 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:32.611113 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba52bca-8496-4063-a777-711df6f3dd1f","Type":"ContainerStarted","Data":"ac9bf8628e2a39ce1c9c9a71dfb67b7f0be016da032b956a6f974634064d4b14"} Jun 08 12:15:32.611484 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:32.611140 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba52bca-8496-4063-a777-711df6f3dd1f","Type":"ContainerStarted","Data":"dd67ed46d712ea1959a77f3926dc321e83ac51646d24d07d714ae465c161f827"} Jun 08 12:15:32.611484 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:32.611164 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba52bca-8496-4063-a777-711df6f3dd1f","Type":"ContainerStarted","Data":"3363a7cb077b4767be92f5a64d665b0fd63666fd8a2f92d49072964bd63e6789"} Jun 08 12:15:32.611484 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:32.611191 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba52bca-8496-4063-a777-711df6f3dd1f","Type":"ContainerStarted","Data":"c0294e17d551cd08535c9a10e75eda52b8d1824132c3dc4f44625db89182dc33"} Jun 08 12:15:32.611484 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:32.611219 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ba52bca-8496-4063-a777-711df6f3dd1f","Type":"ContainerStarted","Data":"cf5751af679065c98a5e08baef092f480cd0c2dc630edad4908823b89ba0d225"} Jun 08 12:15:32.643294 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:32.643227 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.623439334 podStartE2EDuration="2.643206158s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.766824ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:15:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:15:32.641893745 +0000 UTC m=+367.703018909" watchObservedRunningTime="2026-06-08 12:15:32.643206158 +0000 UTC m=+367.704331327" Jun 08 12:15:35.968236 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:35.968203 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:15:38.332710 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:38.332670 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:15:38.335097 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:38.335077 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b-metrics-certs\") pod \"network-metrics-daemon-vdsvw\" (UID: \"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b\") " pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:15:38.579357 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:38.579327 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h8l7g\"" Jun 08 12:15:38.587240 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:38.587189 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdsvw" Jun 08 12:15:38.718413 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:38.718383 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdsvw"] Jun 08 12:15:38.721439 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:15:38.721413 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd27503_2d0a_4b3e_9f7a_f6d9c3e1806b.slice/crio-89778e2aafa2bb648ae9e54377a0cecbdff1097c5ed6716df32bd4f3ec762394 WatchSource:0}: Error finding container 89778e2aafa2bb648ae9e54377a0cecbdff1097c5ed6716df32bd4f3ec762394: Status 404 returned error can't find the container with id 89778e2aafa2bb648ae9e54377a0cecbdff1097c5ed6716df32bd4f3ec762394 Jun 08 12:15:38.723280 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:38.723265 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:15:39.636291 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:39.636257 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdsvw" event={"ID":"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b","Type":"ContainerStarted","Data":"89778e2aafa2bb648ae9e54377a0cecbdff1097c5ed6716df32bd4f3ec762394"} Jun 08 12:15:40.641399 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:40.641359 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdsvw" event={"ID":"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b","Type":"ContainerStarted","Data":"ca4666184ccfb2968da9541454d83f5739115892735eb327c32d29287a190ab1"} Jun 08 12:15:40.641895 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:40.641435 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdsvw" event={"ID":"ecd27503-2d0a-4b3e-9f7a-f6d9c3e1806b","Type":"ContainerStarted","Data":"45c244400c14483f9723d0aeb705bd48dc327a519ba555ad884a06c5a53b1045"} Jun 08 12:15:40.658748 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:15:40.658701 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vdsvw" podStartSLOduration=374.222937262 podStartE2EDuration="6m15.658685836s" totalImagesPullingTime="1.435748574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:15:40.657922335 +0000 UTC m=+375.719047504" watchObservedRunningTime="2026-06-08 12:15:40.658685836 +0000 UTC m=+375.719811002" Jun 08 12:16:30.967801 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:16:30.967752 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:16:30.983581 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:16:30.983556 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:16:31.826311 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:16:31.826283 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:17:34.114105 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.114070 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5"] Jun 08 12:17:34.115966 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.115950 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.120861 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.120821 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g9df2\"" Jun 08 12:17:34.121028 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.121001 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 12:17:34.121196 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.121173 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 12:17:34.121323 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.121232 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 12:17:34.121716 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.121700 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 12:17:34.165200 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.165164 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5"] Jun 08 12:17:34.181771 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.181735 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1206957a-9f7c-4800-82e4-74bd93070949-manifests\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.181771 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.181768 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1206957a-9f7c-4800-82e4-74bd93070949-tmp\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.182060 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.181790 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1206957a-9f7c-4800-82e4-74bd93070949-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.182060 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.181812 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1206957a-9f7c-4800-82e4-74bd93070949-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.182060 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.181970 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpb8b\" (UniqueName: \"kubernetes.io/projected/1206957a-9f7c-4800-82e4-74bd93070949-kube-api-access-vpb8b\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.283194 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.283154 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1206957a-9f7c-4800-82e4-74bd93070949-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.283417 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.283242 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpb8b\" (UniqueName: \"kubernetes.io/projected/1206957a-9f7c-4800-82e4-74bd93070949-kube-api-access-vpb8b\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.283417 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.283269 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1206957a-9f7c-4800-82e4-74bd93070949-manifests\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.283417 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.283285 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1206957a-9f7c-4800-82e4-74bd93070949-tmp\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.283417 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.283304 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1206957a-9f7c-4800-82e4-74bd93070949-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.283766 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.283732 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1206957a-9f7c-4800-82e4-74bd93070949-manifests\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.285805 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.285778 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1206957a-9f7c-4800-82e4-74bd93070949-tmp\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.286043 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.286023 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1206957a-9f7c-4800-82e4-74bd93070949-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.286132 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.286098 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1206957a-9f7c-4800-82e4-74bd93070949-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.302787 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.302750 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpb8b\" (UniqueName: \"kubernetes.io/projected/1206957a-9f7c-4800-82e4-74bd93070949-kube-api-access-vpb8b\") pod \"opendatahub-operator-controller-manager-6858dfdb94-4jkr5\" (UID: \"1206957a-9f7c-4800-82e4-74bd93070949\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.426201 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.426109 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:34.589793 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:34.589757 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5"] Jun 08 12:17:34.593031 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:17:34.593003 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1206957a_9f7c_4800_82e4_74bd93070949.slice/crio-f1f157fa443284363ba8685e617d24cc90a367901aa404ff33a2742f32fa4faf WatchSource:0}: Error finding container f1f157fa443284363ba8685e617d24cc90a367901aa404ff33a2742f32fa4faf: Status 404 returned error can't find the container with id f1f157fa443284363ba8685e617d24cc90a367901aa404ff33a2742f32fa4faf Jun 08 12:17:35.015034 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:35.015001 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" event={"ID":"1206957a-9f7c-4800-82e4-74bd93070949","Type":"ContainerStarted","Data":"f1f157fa443284363ba8685e617d24cc90a367901aa404ff33a2742f32fa4faf"} Jun 08 12:17:38.032042 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:38.031940 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" event={"ID":"1206957a-9f7c-4800-82e4-74bd93070949","Type":"ContainerStarted","Data":"74e90a65c783f20b1745b7693e51c09317f2d2c1a9a87914f0b0d866e433c506"} Jun 08 12:17:39.037288 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:39.037197 2584 generic.go:356] "Generic (PLEG): container finished" podID="1206957a-9f7c-4800-82e4-74bd93070949" containerID="74e90a65c783f20b1745b7693e51c09317f2d2c1a9a87914f0b0d866e433c506" exitCode=0 Jun 08 12:17:39.037288 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:39.037257 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" event={"ID":"1206957a-9f7c-4800-82e4-74bd93070949","Type":"ContainerDied","Data":"74e90a65c783f20b1745b7693e51c09317f2d2c1a9a87914f0b0d866e433c506"} Jun 08 12:17:40.042991 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:40.042939 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" event={"ID":"1206957a-9f7c-4800-82e4-74bd93070949","Type":"ContainerStarted","Data":"648abac19e2718e6f8ac21223796c64864b71c9149c33d3d1c2c8e4bd3b3289a"} Jun 08 12:17:40.043400 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:40.043115 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:40.091428 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:40.091361 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" podStartSLOduration=1.688051843 podStartE2EDuration="6.091343745s" totalImagesPullingTime="3.405692828s" totalInitContainerRuntime="997.599074ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:17:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:17:40.090750733 +0000 UTC m=+495.151875900" watchObservedRunningTime="2026-06-08 12:17:40.091343745 +0000 UTC m=+495.152468913" Jun 08 12:17:51.049393 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:51.049358 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-4jkr5" Jun 08 12:17:53.993795 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:53.993760 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86b9d9554c-frfns"] Jun 08 12:17:54.004986 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.004941 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" Jun 08 12:17:54.010302 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.010279 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 12:17:54.012304 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.012286 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 12:17:54.013203 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.013185 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2kznx\"" Jun 08 12:17:54.013294 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.013197 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 12:17:54.013294 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.013188 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 12:17:54.024928 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.024905 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86b9d9554c-frfns"] Jun 08 12:17:54.151288 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.151245 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38d13beb-df56-469f-aeed-a8c0c40eb527-tls-certs\") pod \"kube-auth-proxy-86b9d9554c-frfns\" (UID: \"38d13beb-df56-469f-aeed-a8c0c40eb527\") " pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" Jun 08 12:17:54.151288 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.151290 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d13beb-df56-469f-aeed-a8c0c40eb527-tmp\") pod \"kube-auth-proxy-86b9d9554c-frfns\" (UID: \"38d13beb-df56-469f-aeed-a8c0c40eb527\") " pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" Jun 08 12:17:54.151546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.151356 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bggm\" (UniqueName: \"kubernetes.io/projected/38d13beb-df56-469f-aeed-a8c0c40eb527-kube-api-access-7bggm\") pod \"kube-auth-proxy-86b9d9554c-frfns\" (UID: \"38d13beb-df56-469f-aeed-a8c0c40eb527\") " pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" Jun 08 12:17:54.251864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.251774 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38d13beb-df56-469f-aeed-a8c0c40eb527-tls-certs\") pod \"kube-auth-proxy-86b9d9554c-frfns\" (UID: \"38d13beb-df56-469f-aeed-a8c0c40eb527\") " pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" Jun 08 12:17:54.251864 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.251842 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d13beb-df56-469f-aeed-a8c0c40eb527-tmp\") pod \"kube-auth-proxy-86b9d9554c-frfns\" (UID: \"38d13beb-df56-469f-aeed-a8c0c40eb527\") " pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" Jun 08 12:17:54.252131 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.251900 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bggm\" (UniqueName: \"kubernetes.io/projected/38d13beb-df56-469f-aeed-a8c0c40eb527-kube-api-access-7bggm\") pod \"kube-auth-proxy-86b9d9554c-frfns\" (UID: \"38d13beb-df56-469f-aeed-a8c0c40eb527\") " pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" Jun 08 12:17:54.254441 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.254415 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d13beb-df56-469f-aeed-a8c0c40eb527-tmp\") pod \"kube-auth-proxy-86b9d9554c-frfns\" (UID: \"38d13beb-df56-469f-aeed-a8c0c40eb527\") " pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" Jun 08 12:17:54.254560 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.254487 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38d13beb-df56-469f-aeed-a8c0c40eb527-tls-certs\") pod \"kube-auth-proxy-86b9d9554c-frfns\" (UID: \"38d13beb-df56-469f-aeed-a8c0c40eb527\") " pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" Jun 08 12:17:54.297007 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.296958 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bggm\" (UniqueName: \"kubernetes.io/projected/38d13beb-df56-469f-aeed-a8c0c40eb527-kube-api-access-7bggm\") pod \"kube-auth-proxy-86b9d9554c-frfns\" (UID: \"38d13beb-df56-469f-aeed-a8c0c40eb527\") " pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" Jun 08 12:17:54.314953 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.314921 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" Jun 08 12:17:54.452132 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:54.452100 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86b9d9554c-frfns"] Jun 08 12:17:54.456309 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:17:54.456279 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d13beb_df56_469f_aeed_a8c0c40eb527.slice/crio-b13e4eb7905897975aa3e87a27b0638e3fee2da5738ebd28a3126d3e29eba767 WatchSource:0}: Error finding container b13e4eb7905897975aa3e87a27b0638e3fee2da5738ebd28a3126d3e29eba767: Status 404 returned error can't find the container with id b13e4eb7905897975aa3e87a27b0638e3fee2da5738ebd28a3126d3e29eba767 Jun 08 12:17:55.096438 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:55.096406 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" event={"ID":"38d13beb-df56-469f-aeed-a8c0c40eb527","Type":"ContainerStarted","Data":"b13e4eb7905897975aa3e87a27b0638e3fee2da5738ebd28a3126d3e29eba767"} Jun 08 12:17:58.110556 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:58.110519 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" event={"ID":"38d13beb-df56-469f-aeed-a8c0c40eb527","Type":"ContainerStarted","Data":"a7bac8a60eb44e024a87cd581ba8c5be3289c786d98baa914135ea27b71374b6"} Jun 08 12:17:58.129452 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:17:58.129402 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86b9d9554c-frfns" podStartSLOduration=2.280666554 podStartE2EDuration="5.129385876s" totalImagesPullingTime="2.848719322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:17:58.128246082 +0000 UTC m=+513.189371259" watchObservedRunningTime="2026-06-08 12:17:58.129385876 +0000 UTC m=+513.190511044" Jun 08 12:18:02.799906 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.799865 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t"] Jun 08 12:18:02.802933 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.802914 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:02.806426 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.806407 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 12:18:02.807186 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.807159 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 12:18:02.807286 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.807201 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-chdj7\"" Jun 08 12:18:02.808520 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.808492 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:18:02.808785 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.808768 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 12:18:02.810051 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.810031 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 12:18:02.820563 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.820537 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t"] Jun 08 12:18:02.922228 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.922173 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44380a07-b08a-4f09-9ed4-30b80ee67226-manager-config\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:02.922228 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.922222 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4g4n\" (UniqueName: \"kubernetes.io/projected/44380a07-b08a-4f09-9ed4-30b80ee67226-kube-api-access-k4g4n\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:02.922494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.922342 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44380a07-b08a-4f09-9ed4-30b80ee67226-cert\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:02.922494 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:02.922409 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44380a07-b08a-4f09-9ed4-30b80ee67226-metrics-cert\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:03.023669 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:03.023626 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44380a07-b08a-4f09-9ed4-30b80ee67226-manager-config\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:03.023669 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:03.023666 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4g4n\" (UniqueName: \"kubernetes.io/projected/44380a07-b08a-4f09-9ed4-30b80ee67226-kube-api-access-k4g4n\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:03.023905 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:03.023715 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44380a07-b08a-4f09-9ed4-30b80ee67226-cert\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:03.023905 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:03.023746 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44380a07-b08a-4f09-9ed4-30b80ee67226-metrics-cert\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:03.024348 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:03.024313 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44380a07-b08a-4f09-9ed4-30b80ee67226-manager-config\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:03.026385 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:03.026364 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44380a07-b08a-4f09-9ed4-30b80ee67226-cert\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:03.026544 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:03.026524 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44380a07-b08a-4f09-9ed4-30b80ee67226-metrics-cert\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:03.067727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:03.067660 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4g4n\" (UniqueName: \"kubernetes.io/projected/44380a07-b08a-4f09-9ed4-30b80ee67226-kube-api-access-k4g4n\") pod \"lws-controller-manager-6d9b9957d4-zct2t\" (UID: \"44380a07-b08a-4f09-9ed4-30b80ee67226\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:03.112213 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:03.112175 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:03.274746 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:03.274714 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t"] Jun 08 12:18:03.277800 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:18:03.277772 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44380a07_b08a_4f09_9ed4_30b80ee67226.slice/crio-e8469c0d6aac14192a2b82bd16e4c1ce4b13d690e69215b4012f638bdf140b55 WatchSource:0}: Error finding container e8469c0d6aac14192a2b82bd16e4c1ce4b13d690e69215b4012f638bdf140b55: Status 404 returned error can't find the container with id e8469c0d6aac14192a2b82bd16e4c1ce4b13d690e69215b4012f638bdf140b55 Jun 08 12:18:04.132472 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:04.132434 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" event={"ID":"44380a07-b08a-4f09-9ed4-30b80ee67226","Type":"ContainerStarted","Data":"e8469c0d6aac14192a2b82bd16e4c1ce4b13d690e69215b4012f638bdf140b55"} Jun 08 12:18:08.149041 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:08.149009 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" event={"ID":"44380a07-b08a-4f09-9ed4-30b80ee67226","Type":"ContainerStarted","Data":"930654bc66e5eedc52b6374549d2e8bb6f3bfaad32399a0ecf872ad7794cb243"} Jun 08 12:18:08.149463 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:08.149080 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:19.154682 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:19.154650 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" Jun 08 12:18:19.192747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:18:19.192696 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-zct2t" podStartSLOduration=12.762754011 podStartE2EDuration="17.192681254s" totalImagesPullingTime="4.429927243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:18:08.192797715 +0000 UTC m=+523.253922882" watchObservedRunningTime="2026-06-08 12:18:19.192681254 +0000 UTC m=+534.253806420" Jun 08 12:19:25.354716 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:25.354685 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:19:25.355310 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:25.355016 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:19:37.760935 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:37.760896 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n"] Jun 08 12:19:37.763938 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:37.763922 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:37.770445 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:37.770426 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wdkxq\"" Jun 08 12:19:37.771224 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:37.771208 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 12:19:37.772101 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:37.772089 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 12:19:37.783650 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:37.783621 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n"] Jun 08 12:19:37.870071 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:37.870033 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfbfb\" (UniqueName: \"kubernetes.io/projected/54975200-2c07-4638-8e59-4cc5276f6004-kube-api-access-rfbfb\") pod \"limitador-operator-controller-manager-859d7b78bd-4cj4n\" (UID: \"54975200-2c07-4638-8e59-4cc5276f6004\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:37.971025 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:37.970955 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfbfb\" (UniqueName: \"kubernetes.io/projected/54975200-2c07-4638-8e59-4cc5276f6004-kube-api-access-rfbfb\") pod \"limitador-operator-controller-manager-859d7b78bd-4cj4n\" (UID: \"54975200-2c07-4638-8e59-4cc5276f6004\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:37.989259 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:37.989233 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfbfb\" (UniqueName: \"kubernetes.io/projected/54975200-2c07-4638-8e59-4cc5276f6004-kube-api-access-rfbfb\") pod \"limitador-operator-controller-manager-859d7b78bd-4cj4n\" (UID: \"54975200-2c07-4638-8e59-4cc5276f6004\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:38.073812 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:38.073769 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:38.265173 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:38.265137 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n"] Jun 08 12:19:38.268140 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:19:38.268112 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54975200_2c07_4638_8e59_4cc5276f6004.slice/crio-ae91cda5536895c020b5e3050998d2e7825f23f6dc9af03ddf96e2fdcdb5d7f8 WatchSource:0}: Error finding container ae91cda5536895c020b5e3050998d2e7825f23f6dc9af03ddf96e2fdcdb5d7f8: Status 404 returned error can't find the container with id ae91cda5536895c020b5e3050998d2e7825f23f6dc9af03ddf96e2fdcdb5d7f8 Jun 08 12:19:38.474639 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:38.474550 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" event={"ID":"54975200-2c07-4638-8e59-4cc5276f6004","Type":"ContainerStarted","Data":"ae91cda5536895c020b5e3050998d2e7825f23f6dc9af03ddf96e2fdcdb5d7f8"} Jun 08 12:19:40.484511 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:40.484476 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" event={"ID":"54975200-2c07-4638-8e59-4cc5276f6004","Type":"ContainerStarted","Data":"3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7"} Jun 08 12:19:40.484917 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:40.484576 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:40.554869 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:40.554816 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" podStartSLOduration=1.4808008209999999 podStartE2EDuration="3.55480108s" totalImagesPullingTime="2.074000259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:19:40.552425913 +0000 UTC m=+615.613551082" watchObservedRunningTime="2026-06-08 12:19:40.55480108 +0000 UTC m=+615.615926246" Jun 08 12:19:41.863140 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:41.863105 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5"] Jun 08 12:19:41.866237 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:41.866215 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" Jun 08 12:19:41.870885 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:41.870867 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4pvhh\"" Jun 08 12:19:41.871054 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:41.870870 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 08 12:19:41.871552 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:41.871538 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 08 12:19:41.906367 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:41.906335 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5"] Jun 08 12:19:42.007739 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.007704 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b4e6f52-a697-4732-842d-ecf007af63af-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7mkg5\" (UID: \"9b4e6f52-a697-4732-842d-ecf007af63af\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" Jun 08 12:19:42.007924 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.007757 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b4e6f52-a697-4732-842d-ecf007af63af-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7mkg5\" (UID: \"9b4e6f52-a697-4732-842d-ecf007af63af\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" Jun 08 12:19:42.007924 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.007820 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m9jl\" (UniqueName: \"kubernetes.io/projected/9b4e6f52-a697-4732-842d-ecf007af63af-kube-api-access-4m9jl\") pod \"kuadrant-console-plugin-66b5774985-7mkg5\" (UID: \"9b4e6f52-a697-4732-842d-ecf007af63af\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" Jun 08 12:19:42.109047 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.109007 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b4e6f52-a697-4732-842d-ecf007af63af-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7mkg5\" (UID: \"9b4e6f52-a697-4732-842d-ecf007af63af\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" Jun 08 12:19:42.109215 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.109066 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b4e6f52-a697-4732-842d-ecf007af63af-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7mkg5\" (UID: \"9b4e6f52-a697-4732-842d-ecf007af63af\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" Jun 08 12:19:42.109215 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.109093 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m9jl\" (UniqueName: \"kubernetes.io/projected/9b4e6f52-a697-4732-842d-ecf007af63af-kube-api-access-4m9jl\") pod \"kuadrant-console-plugin-66b5774985-7mkg5\" (UID: \"9b4e6f52-a697-4732-842d-ecf007af63af\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" Jun 08 12:19:42.109741 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.109704 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b4e6f52-a697-4732-842d-ecf007af63af-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7mkg5\" (UID: \"9b4e6f52-a697-4732-842d-ecf007af63af\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" Jun 08 12:19:42.111511 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.111492 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b4e6f52-a697-4732-842d-ecf007af63af-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7mkg5\" (UID: \"9b4e6f52-a697-4732-842d-ecf007af63af\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" Jun 08 12:19:42.127950 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.127885 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m9jl\" (UniqueName: \"kubernetes.io/projected/9b4e6f52-a697-4732-842d-ecf007af63af-kube-api-access-4m9jl\") pod \"kuadrant-console-plugin-66b5774985-7mkg5\" (UID: \"9b4e6f52-a697-4732-842d-ecf007af63af\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" Jun 08 12:19:42.175567 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.175525 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" Jun 08 12:19:42.327367 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.327334 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5"] Jun 08 12:19:42.330302 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:19:42.330276 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b4e6f52_a697_4732_842d_ecf007af63af.slice/crio-80b6ddfa32a747b19ab74d304ed6f4ca4944639e5359234dd44aa9ae0ac20a64 WatchSource:0}: Error finding container 80b6ddfa32a747b19ab74d304ed6f4ca4944639e5359234dd44aa9ae0ac20a64: Status 404 returned error can't find the container with id 80b6ddfa32a747b19ab74d304ed6f4ca4944639e5359234dd44aa9ae0ac20a64 Jun 08 12:19:42.491861 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:42.491775 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" event={"ID":"9b4e6f52-a697-4732-842d-ecf007af63af","Type":"ContainerStarted","Data":"80b6ddfa32a747b19ab74d304ed6f4ca4944639e5359234dd44aa9ae0ac20a64"} Jun 08 12:19:51.491007 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:51.490948 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:53.461141 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:53.461097 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n"] Jun 08 12:19:53.461580 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:53.461338 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" podUID="54975200-2c07-4638-8e59-4cc5276f6004" containerName="manager" containerID="cri-o://3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7" gracePeriod=2 Jun 08 12:19:53.490875 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:19:53.490838 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4cj4n\" is forbidden: User \"system:node:ip-10-0-136-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-216.ec2.internal' and this object" podUID="54975200-2c07-4638-8e59-4cc5276f6004" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:53.491546 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:53.491522 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n"] Jun 08 12:19:53.724469 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:53.724406 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:53.729720 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:19:53.729690 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4cj4n\" is forbidden: User \"system:node:ip-10-0-136-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-216.ec2.internal' and this object" podUID="54975200-2c07-4638-8e59-4cc5276f6004" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:53.809384 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:53.809353 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfbfb\" (UniqueName: \"kubernetes.io/projected/54975200-2c07-4638-8e59-4cc5276f6004-kube-api-access-rfbfb\") pod \"54975200-2c07-4638-8e59-4cc5276f6004\" (UID: \"54975200-2c07-4638-8e59-4cc5276f6004\") " Jun 08 12:19:53.811690 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:53.811657 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54975200-2c07-4638-8e59-4cc5276f6004-kube-api-access-rfbfb" (OuterVolumeSpecName: "kube-api-access-rfbfb") pod "54975200-2c07-4638-8e59-4cc5276f6004" (UID: "54975200-2c07-4638-8e59-4cc5276f6004"). InnerVolumeSpecName "kube-api-access-rfbfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:19:53.911006 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:53.910950 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfbfb\" (UniqueName: \"kubernetes.io/projected/54975200-2c07-4638-8e59-4cc5276f6004-kube-api-access-rfbfb\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:19:54.537913 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:54.537877 2584 generic.go:356] "Generic (PLEG): container finished" podID="54975200-2c07-4638-8e59-4cc5276f6004" containerID="3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7" exitCode=0 Jun 08 12:19:54.538375 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:54.537925 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:54.538375 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:54.538007 2584 scope.go:117] "RemoveContainer" containerID="3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7" Jun 08 12:19:54.544322 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:19:54.544289 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4cj4n\" is forbidden: User \"system:node:ip-10-0-136-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-216.ec2.internal' and this object" podUID="54975200-2c07-4638-8e59-4cc5276f6004" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:54.547158 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:54.547133 2584 scope.go:117] "RemoveContainer" containerID="3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7" Jun 08 12:19:54.547437 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:19:54.547418 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7\": container with ID starting with 3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7 not found: ID does not exist" containerID="3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7" Jun 08 12:19:54.547499 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:54.547449 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7"} err="failed to get container status \"3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7\": rpc error: code = NotFound desc = could not find container \"3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7\": container with ID starting with 3fe8a4da86786b11e34de4214061f8b651bf4e93462eb4c624142aae843cf2d7 not found: ID does not exist" Jun 08 12:19:54.549315 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:19:54.549291 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4cj4n\" is forbidden: User \"system:node:ip-10-0-136-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-216.ec2.internal' and this object" podUID="54975200-2c07-4638-8e59-4cc5276f6004" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:55.380027 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:19:55.379966 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4cj4n\" is forbidden: User \"system:node:ip-10-0-136-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-216.ec2.internal' and this object" podUID="54975200-2c07-4638-8e59-4cc5276f6004" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4cj4n" Jun 08 12:19:55.382059 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:55.382032 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54975200-2c07-4638-8e59-4cc5276f6004" path="/var/lib/kubelet/pods/54975200-2c07-4638-8e59-4cc5276f6004/volumes" Jun 08 12:19:57.777162 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:57.777126 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c"] Jun 08 12:19:57.777678 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:57.777413 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54975200-2c07-4638-8e59-4cc5276f6004" containerName="manager" Jun 08 12:19:57.777678 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:57.777425 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="54975200-2c07-4638-8e59-4cc5276f6004" containerName="manager" Jun 08 12:19:57.777678 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:57.777483 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="54975200-2c07-4638-8e59-4cc5276f6004" containerName="manager" Jun 08 12:19:57.783384 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:57.783357 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:19:57.786937 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:57.786859 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wq4rb\"" Jun 08 12:19:57.801281 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:57.801256 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c"] Jun 08 12:19:57.948424 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:57.948382 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk2dt\" (UniqueName: \"kubernetes.io/projected/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-kube-api-access-hk2dt\") pod \"kuadrant-operator-controller-manager-86878c769f-5567c\" (UID: \"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:19:57.948634 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:57.948548 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5567c\" (UID: \"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:19:58.049906 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:58.049864 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk2dt\" (UniqueName: \"kubernetes.io/projected/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-kube-api-access-hk2dt\") pod \"kuadrant-operator-controller-manager-86878c769f-5567c\" (UID: \"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:19:58.050119 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:58.049962 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5567c\" (UID: \"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:19:58.050384 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:58.050362 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5567c\" (UID: \"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:19:58.063629 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:58.063596 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk2dt\" (UniqueName: \"kubernetes.io/projected/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-kube-api-access-hk2dt\") pod \"kuadrant-operator-controller-manager-86878c769f-5567c\" (UID: \"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:19:58.096598 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:19:58.096559 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:20:11.972840 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:11.972815 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c"] Jun 08 12:20:11.974695 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:20:11.974578 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6edbfb_9e49_4e5d_983b_070dfcb08f9c.slice/crio-32661174bb986ebc912f3a12526f09bb0fc6ae23232bb422f3f6fbc0ab3be55c WatchSource:0}: Error finding container 32661174bb986ebc912f3a12526f09bb0fc6ae23232bb422f3f6fbc0ab3be55c: Status 404 returned error can't find the container with id 32661174bb986ebc912f3a12526f09bb0fc6ae23232bb422f3f6fbc0ab3be55c Jun 08 12:20:12.617679 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:12.617630 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" event={"ID":"9b4e6f52-a697-4732-842d-ecf007af63af","Type":"ContainerStarted","Data":"d6b03a1026fc8ad5755f1ef1b00e816be160ecd2b53e2584902f3a1c419faace"} Jun 08 12:20:12.618926 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:12.618901 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" event={"ID":"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c","Type":"ContainerStarted","Data":"32661174bb986ebc912f3a12526f09bb0fc6ae23232bb422f3f6fbc0ab3be55c"} Jun 08 12:20:12.642523 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:12.642473 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mkg5" podStartSLOduration=2.064747755 podStartE2EDuration="31.642455343s" totalImagesPullingTime="29.577707588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:20:12.641129037 +0000 UTC m=+647.702254205" watchObservedRunningTime="2026-06-08 12:20:12.642455343 +0000 UTC m=+647.703580510" Jun 08 12:20:17.648925 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:17.648883 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" event={"ID":"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c","Type":"ContainerStarted","Data":"42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867"} Jun 08 12:20:17.649361 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:17.649029 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:20:17.693785 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:17.693735 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" podStartSLOduration=15.857249961 podStartE2EDuration="20.693718517s" totalImagesPullingTime="4.836468556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:20:17.6907051 +0000 UTC m=+652.751830268" watchObservedRunningTime="2026-06-08 12:20:17.693718517 +0000 UTC m=+652.754843753" Jun 08 12:20:28.655150 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:28.655113 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:20:50.558021 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:50.557969 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-c2jdr"] Jun 08 12:20:50.605355 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:50.605319 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c2jdr"] Jun 08 12:20:50.605515 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:50.605417 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c2jdr" Jun 08 12:20:50.609281 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:50.609258 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ll99m\"" Jun 08 12:20:50.661780 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:50.661741 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkknh\" (UniqueName: \"kubernetes.io/projected/46cc7d1a-70a0-4d01-928d-12630b223330-kube-api-access-fkknh\") pod \"authorino-58cd955675-c2jdr\" (UID: \"46cc7d1a-70a0-4d01-928d-12630b223330\") " pod="kuadrant-system/authorino-58cd955675-c2jdr" Jun 08 12:20:50.763080 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:50.763039 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkknh\" (UniqueName: \"kubernetes.io/projected/46cc7d1a-70a0-4d01-928d-12630b223330-kube-api-access-fkknh\") pod \"authorino-58cd955675-c2jdr\" (UID: \"46cc7d1a-70a0-4d01-928d-12630b223330\") " pod="kuadrant-system/authorino-58cd955675-c2jdr" Jun 08 12:20:50.772736 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:50.772712 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkknh\" (UniqueName: \"kubernetes.io/projected/46cc7d1a-70a0-4d01-928d-12630b223330-kube-api-access-fkknh\") pod \"authorino-58cd955675-c2jdr\" (UID: \"46cc7d1a-70a0-4d01-928d-12630b223330\") " pod="kuadrant-system/authorino-58cd955675-c2jdr" Jun 08 12:20:50.914646 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:50.914566 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c2jdr" Jun 08 12:20:51.050354 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:51.050322 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c2jdr"] Jun 08 12:20:51.053603 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:20:51.053569 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46cc7d1a_70a0_4d01_928d_12630b223330.slice/crio-f9fd92c7b922495a6b867ee9b5488729f028fc608641554a208abe90ec60eae9 WatchSource:0}: Error finding container f9fd92c7b922495a6b867ee9b5488729f028fc608641554a208abe90ec60eae9: Status 404 returned error can't find the container with id f9fd92c7b922495a6b867ee9b5488729f028fc608641554a208abe90ec60eae9 Jun 08 12:20:51.054856 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:51.054838 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:20:51.792786 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:51.792748 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c2jdr" event={"ID":"46cc7d1a-70a0-4d01-928d-12630b223330","Type":"ContainerStarted","Data":"f9fd92c7b922495a6b867ee9b5488729f028fc608641554a208abe90ec60eae9"} Jun 08 12:20:54.808879 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:54.808845 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c2jdr" event={"ID":"46cc7d1a-70a0-4d01-928d-12630b223330","Type":"ContainerStarted","Data":"a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e"} Jun 08 12:20:54.827624 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:54.827570 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-c2jdr" podStartSLOduration=1.217019989 podStartE2EDuration="4.827552483s" totalImagesPullingTime="3.610532494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:20:54.826944766 +0000 UTC m=+689.888069933" watchObservedRunningTime="2026-06-08 12:20:54.827552483 +0000 UTC m=+689.888677649" Jun 08 12:20:55.644605 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:55.644568 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c2jdr"] Jun 08 12:20:56.818067 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:56.818025 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-c2jdr" podUID="46cc7d1a-70a0-4d01-928d-12630b223330" containerName="authorino" containerID="cri-o://a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e" gracePeriod=30 Jun 08 12:20:57.061714 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.061691 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c2jdr" Jun 08 12:20:57.221248 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.221163 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkknh\" (UniqueName: \"kubernetes.io/projected/46cc7d1a-70a0-4d01-928d-12630b223330-kube-api-access-fkknh\") pod \"46cc7d1a-70a0-4d01-928d-12630b223330\" (UID: \"46cc7d1a-70a0-4d01-928d-12630b223330\") " Jun 08 12:20:57.223417 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.223383 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46cc7d1a-70a0-4d01-928d-12630b223330-kube-api-access-fkknh" (OuterVolumeSpecName: "kube-api-access-fkknh") pod "46cc7d1a-70a0-4d01-928d-12630b223330" (UID: "46cc7d1a-70a0-4d01-928d-12630b223330"). InnerVolumeSpecName "kube-api-access-fkknh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:20:57.321649 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.321616 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkknh\" (UniqueName: \"kubernetes.io/projected/46cc7d1a-70a0-4d01-928d-12630b223330-kube-api-access-fkknh\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:20:57.823691 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.823654 2584 generic.go:356] "Generic (PLEG): container finished" podID="46cc7d1a-70a0-4d01-928d-12630b223330" containerID="a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e" exitCode=0 Jun 08 12:20:57.823691 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.823688 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c2jdr" event={"ID":"46cc7d1a-70a0-4d01-928d-12630b223330","Type":"ContainerDied","Data":"a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e"} Jun 08 12:20:57.824167 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.823704 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c2jdr" Jun 08 12:20:57.824167 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.823716 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c2jdr" event={"ID":"46cc7d1a-70a0-4d01-928d-12630b223330","Type":"ContainerDied","Data":"f9fd92c7b922495a6b867ee9b5488729f028fc608641554a208abe90ec60eae9"} Jun 08 12:20:57.824167 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.823731 2584 scope.go:117] "RemoveContainer" containerID="a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e" Jun 08 12:20:57.832319 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.832294 2584 scope.go:117] "RemoveContainer" containerID="a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e" Jun 08 12:20:57.832568 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:20:57.832549 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e\": container with ID starting with a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e not found: ID does not exist" containerID="a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e" Jun 08 12:20:57.832651 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.832575 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e"} err="failed to get container status \"a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e\": rpc error: code = NotFound desc = could not find container \"a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e\": container with ID starting with a62ce1c6c88503c85ae2bacefe3211a2e5f1aba361f2f9285392fb6fa9198a1e not found: ID does not exist" Jun 08 12:20:57.841134 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.841110 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c2jdr"] Jun 08 12:20:57.845358 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:57.845331 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-c2jdr"] Jun 08 12:20:59.380727 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:20:59.380691 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46cc7d1a-70a0-4d01-928d-12630b223330" path="/var/lib/kubelet/pods/46cc7d1a-70a0-4d01-928d-12630b223330/volumes" Jun 08 12:21:45.810645 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:45.810610 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:21:45.811166 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:45.810865 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46cc7d1a-70a0-4d01-928d-12630b223330" containerName="authorino" Jun 08 12:21:45.811166 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:45.810877 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="46cc7d1a-70a0-4d01-928d-12630b223330" containerName="authorino" Jun 08 12:21:45.811166 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:45.810930 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="46cc7d1a-70a0-4d01-928d-12630b223330" containerName="authorino" Jun 08 12:21:45.812682 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:45.812666 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:21:45.816240 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:45.816217 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 12:21:45.816366 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:45.816274 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-fnh62\"" Jun 08 12:21:45.816662 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:45.816643 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 12:21:45.816751 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:45.816723 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 12:21:45.825509 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:45.825488 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:21:45.903135 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:45.903100 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cns5w\" (UniqueName: \"kubernetes.io/projected/dd8b8470-53e3-49be-8992-0026f1459ba8-kube-api-access-cns5w\") pod \"maas-keycloak-0\" (UID: \"dd8b8470-53e3-49be-8992-0026f1459ba8\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:21:46.004416 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:46.004384 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cns5w\" (UniqueName: \"kubernetes.io/projected/dd8b8470-53e3-49be-8992-0026f1459ba8-kube-api-access-cns5w\") pod \"maas-keycloak-0\" (UID: \"dd8b8470-53e3-49be-8992-0026f1459ba8\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:21:46.013997 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:46.013955 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cns5w\" (UniqueName: \"kubernetes.io/projected/dd8b8470-53e3-49be-8992-0026f1459ba8-kube-api-access-cns5w\") pod \"maas-keycloak-0\" (UID: \"dd8b8470-53e3-49be-8992-0026f1459ba8\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:21:46.122205 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:46.122104 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:21:46.259998 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:46.259937 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:21:46.263989 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:21:46.263952 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8b8470_53e3_49be_8992_0026f1459ba8.slice/crio-0df85b0e26532085f0f63385916a2cc7dfb263423ccbe75af589df7dc40a348c WatchSource:0}: Error finding container 0df85b0e26532085f0f63385916a2cc7dfb263423ccbe75af589df7dc40a348c: Status 404 returned error can't find the container with id 0df85b0e26532085f0f63385916a2cc7dfb263423ccbe75af589df7dc40a348c Jun 08 12:21:47.015628 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:47.015592 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dd8b8470-53e3-49be-8992-0026f1459ba8","Type":"ContainerStarted","Data":"0df85b0e26532085f0f63385916a2cc7dfb263423ccbe75af589df7dc40a348c"} Jun 08 12:21:52.039871 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:52.039770 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dd8b8470-53e3-49be-8992-0026f1459ba8","Type":"ContainerStarted","Data":"fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d"} Jun 08 12:21:52.060776 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:52.060711 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.721692121 podStartE2EDuration="7.060689202s" totalImagesPullingTime="5.338997081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:21:52.059642714 +0000 UTC m=+747.120767882" watchObservedRunningTime="2026-06-08 12:21:52.060689202 +0000 UTC m=+747.121814372" Jun 08 12:21:52.123229 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:52.123176 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 12:21:52.125346 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:52.125300 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:21:53.122994 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:53.122925 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:21:54.123231 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:54.123177 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:21:55.123231 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:55.123175 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:21:56.122671 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:56.122612 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 12:21:56.123202 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:56.123021 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:21:57.123834 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:57.123373 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:21:58.123521 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:58.123463 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:21:59.123232 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:21:59.123180 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:22:00.122959 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:00.122891 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:22:01.123543 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:01.123489 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:22:02.122791 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:02.122734 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:22:03.123372 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:03.123330 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:22:04.123405 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:04.123360 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 08 12:22:05.246959 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:05.246929 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 12:22:05.265272 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:05.265213 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:22:15.253309 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:15.253275 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 12:22:16.684650 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.684605 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67955f88bc-fqlfl"] Jun 08 12:22:16.690309 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.690289 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67955f88bc-fqlfl" Jun 08 12:22:16.693716 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.693700 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 12:22:16.694591 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.694576 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ll99m\"" Jun 08 12:22:16.701433 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.701413 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67955f88bc-fqlfl"] Jun 08 12:22:16.781246 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.781214 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7slhb\" (UniqueName: \"kubernetes.io/projected/87399ba2-95a8-4612-95fe-0d6be0ee588d-kube-api-access-7slhb\") pod \"authorino-67955f88bc-fqlfl\" (UID: \"87399ba2-95a8-4612-95fe-0d6be0ee588d\") " pod="kuadrant-system/authorino-67955f88bc-fqlfl" Jun 08 12:22:16.781425 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.781259 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87399ba2-95a8-4612-95fe-0d6be0ee588d-tls-cert\") pod \"authorino-67955f88bc-fqlfl\" (UID: \"87399ba2-95a8-4612-95fe-0d6be0ee588d\") " pod="kuadrant-system/authorino-67955f88bc-fqlfl" Jun 08 12:22:16.882469 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.882436 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87399ba2-95a8-4612-95fe-0d6be0ee588d-tls-cert\") pod \"authorino-67955f88bc-fqlfl\" (UID: \"87399ba2-95a8-4612-95fe-0d6be0ee588d\") " pod="kuadrant-system/authorino-67955f88bc-fqlfl" Jun 08 12:22:16.882644 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.882520 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7slhb\" (UniqueName: \"kubernetes.io/projected/87399ba2-95a8-4612-95fe-0d6be0ee588d-kube-api-access-7slhb\") pod \"authorino-67955f88bc-fqlfl\" (UID: \"87399ba2-95a8-4612-95fe-0d6be0ee588d\") " pod="kuadrant-system/authorino-67955f88bc-fqlfl" Jun 08 12:22:16.885152 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.885123 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87399ba2-95a8-4612-95fe-0d6be0ee588d-tls-cert\") pod \"authorino-67955f88bc-fqlfl\" (UID: \"87399ba2-95a8-4612-95fe-0d6be0ee588d\") " pod="kuadrant-system/authorino-67955f88bc-fqlfl" Jun 08 12:22:16.896357 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.896334 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7slhb\" (UniqueName: \"kubernetes.io/projected/87399ba2-95a8-4612-95fe-0d6be0ee588d-kube-api-access-7slhb\") pod \"authorino-67955f88bc-fqlfl\" (UID: \"87399ba2-95a8-4612-95fe-0d6be0ee588d\") " pod="kuadrant-system/authorino-67955f88bc-fqlfl" Jun 08 12:22:16.999207 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:16.999120 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67955f88bc-fqlfl" Jun 08 12:22:17.152124 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:17.152087 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67955f88bc-fqlfl"] Jun 08 12:22:17.157123 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:22:17.157095 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87399ba2_95a8_4612_95fe_0d6be0ee588d.slice/crio-5645d8a9d6bf08c3429cca66ded007488957be038b3a08a4c38a717f5a694921 WatchSource:0}: Error finding container 5645d8a9d6bf08c3429cca66ded007488957be038b3a08a4c38a717f5a694921: Status 404 returned error can't find the container with id 5645d8a9d6bf08c3429cca66ded007488957be038b3a08a4c38a717f5a694921 Jun 08 12:22:17.178955 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:17.178930 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67955f88bc-fqlfl" event={"ID":"87399ba2-95a8-4612-95fe-0d6be0ee588d","Type":"ContainerStarted","Data":"5645d8a9d6bf08c3429cca66ded007488957be038b3a08a4c38a717f5a694921"} Jun 08 12:22:19.188185 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:19.188149 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67955f88bc-fqlfl" event={"ID":"87399ba2-95a8-4612-95fe-0d6be0ee588d","Type":"ContainerStarted","Data":"1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c"} Jun 08 12:22:19.229387 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:19.229335 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67955f88bc-fqlfl" podStartSLOduration=1.9941649799999999 podStartE2EDuration="3.229318577s" totalImagesPullingTime="1.235153597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:22:19.228313689 +0000 UTC m=+774.289438856" watchObservedRunningTime="2026-06-08 12:22:19.229318577 +0000 UTC m=+774.290443760" Jun 08 12:22:55.749572 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:55.749529 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g"] Jun 08 12:22:55.753135 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:55.753111 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" Jun 08 12:22:55.756845 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:55.756824 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 08 12:22:55.757424 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:55.757406 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 08 12:22:55.757519 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:55.757408 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-5pztg\"" Jun 08 12:22:55.757519 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:55.757409 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 08 12:22:55.768559 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:55.768539 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g"] Jun 08 12:22:55.903229 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:55.903192 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133c4996-8e9a-417a-8e14-0786d9cc2f48-maas-api-tls\") pod \"maas-api-dfdf55b86-g8k7g\" (UID: \"133c4996-8e9a-417a-8e14-0786d9cc2f48\") " pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" Jun 08 12:22:55.903414 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:55.903257 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghpg5\" (UniqueName: \"kubernetes.io/projected/133c4996-8e9a-417a-8e14-0786d9cc2f48-kube-api-access-ghpg5\") pod \"maas-api-dfdf55b86-g8k7g\" (UID: \"133c4996-8e9a-417a-8e14-0786d9cc2f48\") " pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" Jun 08 12:22:56.004108 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:56.004030 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghpg5\" (UniqueName: \"kubernetes.io/projected/133c4996-8e9a-417a-8e14-0786d9cc2f48-kube-api-access-ghpg5\") pod \"maas-api-dfdf55b86-g8k7g\" (UID: \"133c4996-8e9a-417a-8e14-0786d9cc2f48\") " pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" Jun 08 12:22:56.004246 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:56.004113 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133c4996-8e9a-417a-8e14-0786d9cc2f48-maas-api-tls\") pod \"maas-api-dfdf55b86-g8k7g\" (UID: \"133c4996-8e9a-417a-8e14-0786d9cc2f48\") " pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" Jun 08 12:22:56.006645 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:56.006614 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133c4996-8e9a-417a-8e14-0786d9cc2f48-maas-api-tls\") pod \"maas-api-dfdf55b86-g8k7g\" (UID: \"133c4996-8e9a-417a-8e14-0786d9cc2f48\") " pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" Jun 08 12:22:56.015165 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:56.015143 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghpg5\" (UniqueName: \"kubernetes.io/projected/133c4996-8e9a-417a-8e14-0786d9cc2f48-kube-api-access-ghpg5\") pod \"maas-api-dfdf55b86-g8k7g\" (UID: \"133c4996-8e9a-417a-8e14-0786d9cc2f48\") " pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" Jun 08 12:22:56.064160 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:56.064128 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" Jun 08 12:22:56.206467 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:56.206431 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g"] Jun 08 12:22:56.209805 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:22:56.209773 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133c4996_8e9a_417a_8e14_0786d9cc2f48.slice/crio-5b3e4f67ab6ed5c66d1b6731935387464d34bc5767dfac5961a33dda3fe91de4 WatchSource:0}: Error finding container 5b3e4f67ab6ed5c66d1b6731935387464d34bc5767dfac5961a33dda3fe91de4: Status 404 returned error can't find the container with id 5b3e4f67ab6ed5c66d1b6731935387464d34bc5767dfac5961a33dda3fe91de4 Jun 08 12:22:56.336174 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:56.336140 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" event={"ID":"133c4996-8e9a-417a-8e14-0786d9cc2f48","Type":"ContainerStarted","Data":"5b3e4f67ab6ed5c66d1b6731935387464d34bc5767dfac5961a33dda3fe91de4"} Jun 08 12:22:59.354266 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:59.354229 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" event={"ID":"133c4996-8e9a-417a-8e14-0786d9cc2f48","Type":"ContainerStarted","Data":"d516b5a98968c6328e01330f1074c63c5e85bfaac1746c95b4bbe4e7cda8e5ec"} Jun 08 12:22:59.354657 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:59.354355 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" Jun 08 12:22:59.375324 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:22:59.375273 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" podStartSLOduration=2.091838321 podStartE2EDuration="4.375256594s" totalImagesPullingTime="2.283418273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:22:59.373620581 +0000 UTC m=+814.434745771" watchObservedRunningTime="2026-06-08 12:22:59.375256594 +0000 UTC m=+814.436381762" Jun 08 12:23:05.364195 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:05.364166 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-dfdf55b86-g8k7g" Jun 08 12:23:07.194129 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:07.194100 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:23:07.194504 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:07.194298 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" containerID="cri-o://fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d" gracePeriod=30 Jun 08 12:23:08.841632 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:08.841608 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:08.909568 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:08.909477 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cns5w\" (UniqueName: \"kubernetes.io/projected/dd8b8470-53e3-49be-8992-0026f1459ba8-kube-api-access-cns5w\") pod \"dd8b8470-53e3-49be-8992-0026f1459ba8\" (UID: \"dd8b8470-53e3-49be-8992-0026f1459ba8\") " Jun 08 12:23:08.911746 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:08.911721 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd8b8470-53e3-49be-8992-0026f1459ba8-kube-api-access-cns5w" (OuterVolumeSpecName: "kube-api-access-cns5w") pod "dd8b8470-53e3-49be-8992-0026f1459ba8" (UID: "dd8b8470-53e3-49be-8992-0026f1459ba8"). InnerVolumeSpecName "kube-api-access-cns5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:23:09.010229 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.010190 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cns5w\" (UniqueName: \"kubernetes.io/projected/dd8b8470-53e3-49be-8992-0026f1459ba8-kube-api-access-cns5w\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:23:09.395443 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.395412 2584 generic.go:356] "Generic (PLEG): container finished" podID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerID="fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d" exitCode=143 Jun 08 12:23:09.395554 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.395463 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dd8b8470-53e3-49be-8992-0026f1459ba8","Type":"ContainerDied","Data":"fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d"} Jun 08 12:23:09.395554 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.395469 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:09.395554 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.395502 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dd8b8470-53e3-49be-8992-0026f1459ba8","Type":"ContainerDied","Data":"0df85b0e26532085f0f63385916a2cc7dfb263423ccbe75af589df7dc40a348c"} Jun 08 12:23:09.395554 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.395521 2584 scope.go:117] "RemoveContainer" containerID="fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d" Jun 08 12:23:09.404817 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.404796 2584 scope.go:117] "RemoveContainer" containerID="fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d" Jun 08 12:23:09.405103 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:23:09.405080 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d\": container with ID starting with fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d not found: ID does not exist" containerID="fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d" Jun 08 12:23:09.405175 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.405115 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d"} err="failed to get container status \"fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d\": rpc error: code = NotFound desc = could not find container \"fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d\": container with ID starting with fc59de7451adaa8194847c08a92fddf448e2289e358548b4a0be4e3f07369f4d not found: ID does not exist" Jun 08 12:23:09.441150 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.441121 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:23:09.447138 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.447114 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:23:09.498862 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.498824 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:23:09.499158 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.499133 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" Jun 08 12:23:09.499158 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.499160 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" Jun 08 12:23:09.499257 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.499222 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" containerName="keycloak" Jun 08 12:23:09.503383 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.503365 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:09.511102 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.511081 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 12:23:09.511211 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.511129 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 12:23:09.511211 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.511081 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 12:23:09.511603 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.511589 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 12:23:09.511825 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.511811 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-fnh62\"" Jun 08 12:23:09.514335 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.514316 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk6hq\" (UniqueName: \"kubernetes.io/projected/b5178a3a-a6c4-4fb0-b6df-60c752015920-kube-api-access-pk6hq\") pod \"maas-keycloak-0\" (UID: \"b5178a3a-a6c4-4fb0-b6df-60c752015920\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:09.514444 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.514408 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b5178a3a-a6c4-4fb0-b6df-60c752015920-test-realms\") pod \"maas-keycloak-0\" (UID: \"b5178a3a-a6c4-4fb0-b6df-60c752015920\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:09.520012 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.519991 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:23:09.615252 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.615223 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6hq\" (UniqueName: \"kubernetes.io/projected/b5178a3a-a6c4-4fb0-b6df-60c752015920-kube-api-access-pk6hq\") pod \"maas-keycloak-0\" (UID: \"b5178a3a-a6c4-4fb0-b6df-60c752015920\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:09.615424 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.615295 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b5178a3a-a6c4-4fb0-b6df-60c752015920-test-realms\") pod \"maas-keycloak-0\" (UID: \"b5178a3a-a6c4-4fb0-b6df-60c752015920\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:09.616003 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.615957 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b5178a3a-a6c4-4fb0-b6df-60c752015920-test-realms\") pod \"maas-keycloak-0\" (UID: \"b5178a3a-a6c4-4fb0-b6df-60c752015920\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:09.625021 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.625003 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk6hq\" (UniqueName: \"kubernetes.io/projected/b5178a3a-a6c4-4fb0-b6df-60c752015920-kube-api-access-pk6hq\") pod \"maas-keycloak-0\" (UID: \"b5178a3a-a6c4-4fb0-b6df-60c752015920\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:09.813163 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.813129 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:09.959070 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:09.959020 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:23:09.961467 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:23:09.961438 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5178a3a_a6c4_4fb0_b6df_60c752015920.slice/crio-035b280fdca1cf8751132ad51c143d4e9c87cbd9eb2328915afd1fbce7170b0c WatchSource:0}: Error finding container 035b280fdca1cf8751132ad51c143d4e9c87cbd9eb2328915afd1fbce7170b0c: Status 404 returned error can't find the container with id 035b280fdca1cf8751132ad51c143d4e9c87cbd9eb2328915afd1fbce7170b0c Jun 08 12:23:10.401543 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:10.401511 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b5178a3a-a6c4-4fb0-b6df-60c752015920","Type":"ContainerStarted","Data":"035b280fdca1cf8751132ad51c143d4e9c87cbd9eb2328915afd1fbce7170b0c"} Jun 08 12:23:11.382023 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:11.381963 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd8b8470-53e3-49be-8992-0026f1459ba8" path="/var/lib/kubelet/pods/dd8b8470-53e3-49be-8992-0026f1459ba8/volumes" Jun 08 12:23:11.408451 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:11.408412 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b5178a3a-a6c4-4fb0-b6df-60c752015920","Type":"ContainerStarted","Data":"6c3ff37647c2b43f28326456a88a00832865e76831613c280dfcf691450b8d6f"} Jun 08 12:23:11.445922 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:11.445859 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.005833857 podStartE2EDuration="2.445837127s" totalImagesPullingTime="440.00327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:23:11.44505724 +0000 UTC m=+826.506182409" watchObservedRunningTime="2026-06-08 12:23:11.445837127 +0000 UTC m=+826.506962295" Jun 08 12:23:11.814242 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:11.814204 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:11.816314 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:11.815968 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:12.814276 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:12.814230 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:13.814009 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:13.813926 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:14.814107 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:14.814050 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:15.813757 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:15.813710 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:16.814277 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:16.814161 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:17.813798 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:17.813749 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:18.813624 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:18.813575 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:19.813927 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:19.813879 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:19.814351 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:19.814141 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:20.814354 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:20.814301 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:21.814460 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:21.814419 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:22.813904 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:22.813852 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:23.814204 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:23.814157 2584 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jun 08 12:23:24.922533 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:24.922482 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:24.937553 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:24.937508 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b5178a3a-a6c4-4fb0-b6df-60c752015920" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:23:34.929337 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:34.929296 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 12:23:46.768785 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:46.768738 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67955f88bc-fqlfl"] Jun 08 12:23:46.769522 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:46.769487 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-67955f88bc-fqlfl" podUID="87399ba2-95a8-4612-95fe-0d6be0ee588d" containerName="authorino" containerID="cri-o://1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c" gracePeriod=30 Jun 08 12:23:47.017654 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.017620 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67955f88bc-fqlfl" Jun 08 12:23:47.169285 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.169250 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7slhb\" (UniqueName: \"kubernetes.io/projected/87399ba2-95a8-4612-95fe-0d6be0ee588d-kube-api-access-7slhb\") pod \"87399ba2-95a8-4612-95fe-0d6be0ee588d\" (UID: \"87399ba2-95a8-4612-95fe-0d6be0ee588d\") " Jun 08 12:23:47.169487 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.169349 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87399ba2-95a8-4612-95fe-0d6be0ee588d-tls-cert\") pod \"87399ba2-95a8-4612-95fe-0d6be0ee588d\" (UID: \"87399ba2-95a8-4612-95fe-0d6be0ee588d\") " Jun 08 12:23:47.171578 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.171546 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87399ba2-95a8-4612-95fe-0d6be0ee588d-kube-api-access-7slhb" (OuterVolumeSpecName: "kube-api-access-7slhb") pod "87399ba2-95a8-4612-95fe-0d6be0ee588d" (UID: "87399ba2-95a8-4612-95fe-0d6be0ee588d"). InnerVolumeSpecName "kube-api-access-7slhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:23:47.178441 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.178418 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87399ba2-95a8-4612-95fe-0d6be0ee588d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "87399ba2-95a8-4612-95fe-0d6be0ee588d" (UID: "87399ba2-95a8-4612-95fe-0d6be0ee588d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:23:47.270075 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.270031 2584 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87399ba2-95a8-4612-95fe-0d6be0ee588d-tls-cert\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:23:47.270075 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.270070 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7slhb\" (UniqueName: \"kubernetes.io/projected/87399ba2-95a8-4612-95fe-0d6be0ee588d-kube-api-access-7slhb\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:23:47.598833 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.598794 2584 generic.go:356] "Generic (PLEG): container finished" podID="87399ba2-95a8-4612-95fe-0d6be0ee588d" containerID="1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c" exitCode=0 Jun 08 12:23:47.599027 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.598881 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67955f88bc-fqlfl" Jun 08 12:23:47.599027 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.598892 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67955f88bc-fqlfl" event={"ID":"87399ba2-95a8-4612-95fe-0d6be0ee588d","Type":"ContainerDied","Data":"1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c"} Jun 08 12:23:47.599027 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.598939 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67955f88bc-fqlfl" event={"ID":"87399ba2-95a8-4612-95fe-0d6be0ee588d","Type":"ContainerDied","Data":"5645d8a9d6bf08c3429cca66ded007488957be038b3a08a4c38a717f5a694921"} Jun 08 12:23:47.599027 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.598964 2584 scope.go:117] "RemoveContainer" containerID="1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c" Jun 08 12:23:47.607319 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.607300 2584 scope.go:117] "RemoveContainer" containerID="1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c" Jun 08 12:23:47.607585 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:23:47.607564 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c\": container with ID starting with 1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c not found: ID does not exist" containerID="1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c" Jun 08 12:23:47.607680 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.607591 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c"} err="failed to get container status \"1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c\": rpc error: code = NotFound desc = could not find container \"1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c\": container with ID starting with 1e1bfda0cc0f25ade97b8bdd1369235f53b0e6c4057a501a4d40670017be371c not found: ID does not exist" Jun 08 12:23:47.621112 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.621085 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67955f88bc-fqlfl"] Jun 08 12:23:47.627721 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:47.627700 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67955f88bc-fqlfl"] Jun 08 12:23:49.381072 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:23:49.381036 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87399ba2-95a8-4612-95fe-0d6be0ee588d" path="/var/lib/kubelet/pods/87399ba2-95a8-4612-95fe-0d6be0ee588d/volumes" Jun 08 12:24:03.294120 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.294084 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc"] Jun 08 12:24:03.294588 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.294407 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87399ba2-95a8-4612-95fe-0d6be0ee588d" containerName="authorino" Jun 08 12:24:03.294588 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.294421 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="87399ba2-95a8-4612-95fe-0d6be0ee588d" containerName="authorino" Jun 08 12:24:03.294588 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.294478 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="87399ba2-95a8-4612-95fe-0d6be0ee588d" containerName="authorino" Jun 08 12:24:03.299342 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.299319 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.305003 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.304956 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wj8pd\"" Jun 08 12:24:03.305105 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.305066 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 12:24:03.305105 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.304963 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 12:24:03.305222 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.304967 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 12:24:03.314757 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.314736 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc"] Jun 08 12:24:03.390098 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.390072 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.390226 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.390124 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14020a38-546b-4d59-b32d-390c8fdb6cb5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.390226 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.390162 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tggsw\" (UniqueName: \"kubernetes.io/projected/14020a38-546b-4d59-b32d-390c8fdb6cb5-kube-api-access-tggsw\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.390226 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.390204 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.390377 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.390265 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.390377 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.390298 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.491446 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.491408 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.491639 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.491460 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.491639 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.491497 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14020a38-546b-4d59-b32d-390c8fdb6cb5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.491639 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.491524 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tggsw\" (UniqueName: \"kubernetes.io/projected/14020a38-546b-4d59-b32d-390c8fdb6cb5-kube-api-access-tggsw\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.491639 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.491564 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.491639 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.491617 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.491866 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.491839 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.492131 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.492112 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.492383 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.492133 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.494025 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.494004 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14020a38-546b-4d59-b32d-390c8fdb6cb5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.494229 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.494212 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14020a38-546b-4d59-b32d-390c8fdb6cb5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.501132 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.501106 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tggsw\" (UniqueName: \"kubernetes.io/projected/14020a38-546b-4d59-b32d-390c8fdb6cb5-kube-api-access-tggsw\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc\" (UID: \"14020a38-546b-4d59-b32d-390c8fdb6cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.639185 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.639096 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:03.790804 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:03.790782 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc"] Jun 08 12:24:03.792922 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:24:03.792883 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14020a38_546b_4d59_b32d_390c8fdb6cb5.slice/crio-62fdada527cbce52929e3927d16545bddf790fa4453bbd16a92f91ef9a2b8e6d WatchSource:0}: Error finding container 62fdada527cbce52929e3927d16545bddf790fa4453bbd16a92f91ef9a2b8e6d: Status 404 returned error can't find the container with id 62fdada527cbce52929e3927d16545bddf790fa4453bbd16a92f91ef9a2b8e6d Jun 08 12:24:04.670720 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:04.670683 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" event={"ID":"14020a38-546b-4d59-b32d-390c8fdb6cb5","Type":"ContainerStarted","Data":"62fdada527cbce52929e3927d16545bddf790fa4453bbd16a92f91ef9a2b8e6d"} Jun 08 12:24:07.686773 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:07.686741 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" event={"ID":"14020a38-546b-4d59-b32d-390c8fdb6cb5","Type":"ContainerStarted","Data":"0e4f65d9fc9e1e90f1259fd021cce2532a917e1de44aa7fc248273574297f3b5"} Jun 08 12:24:09.696959 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:09.696924 2584 generic.go:356] "Generic (PLEG): container finished" podID="14020a38-546b-4d59-b32d-390c8fdb6cb5" containerID="0e4f65d9fc9e1e90f1259fd021cce2532a917e1de44aa7fc248273574297f3b5" exitCode=0 Jun 08 12:24:09.697501 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:09.697013 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" event={"ID":"14020a38-546b-4d59-b32d-390c8fdb6cb5","Type":"ContainerDied","Data":"0e4f65d9fc9e1e90f1259fd021cce2532a917e1de44aa7fc248273574297f3b5"} Jun 08 12:24:12.710733 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:12.710693 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" event={"ID":"14020a38-546b-4d59-b32d-390c8fdb6cb5","Type":"ContainerStarted","Data":"f70253bed684d5760b00a5c79017677d72b0a20576cf5f6ed2e45feee19093dd"} Jun 08 12:24:12.751645 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:12.751587 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" podStartSLOduration=2.279676642 podStartE2EDuration="9.751573946s" totalImagesPullingTime="6.100488382s" totalInitContainerRuntime="1.371408922s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:24:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:24:12.749687252 +0000 UTC m=+887.810812418" watchObservedRunningTime="2026-06-08 12:24:12.751573946 +0000 UTC m=+887.812699112" Jun 08 12:24:13.640086 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:13.640050 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:13.640269 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:13.640113 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:13.652863 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:13.652831 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:13.725519 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:13.725489 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc" Jun 08 12:24:14.131114 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.131080 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x"] Jun 08 12:24:14.138456 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.138435 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.141275 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.141253 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 12:24:14.153858 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.153839 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x"] Jun 08 12:24:14.180745 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.180710 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.180894 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.180774 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.180894 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.180800 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c85c7c83-3821-426a-abc5-38a8225a4f4d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.180894 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.180820 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.181014 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.180899 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8s6x\" (UniqueName: \"kubernetes.io/projected/c85c7c83-3821-426a-abc5-38a8225a4f4d-kube-api-access-d8s6x\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.181014 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.180916 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.282306 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.282264 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8s6x\" (UniqueName: \"kubernetes.io/projected/c85c7c83-3821-426a-abc5-38a8225a4f4d-kube-api-access-d8s6x\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.282306 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.282307 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.282557 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.282341 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.282557 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.282394 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.282557 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.282422 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c85c7c83-3821-426a-abc5-38a8225a4f4d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.282705 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.282566 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.282848 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.282828 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.282913 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.282838 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.282913 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.282884 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.284747 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.284726 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c85c7c83-3821-426a-abc5-38a8225a4f4d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.284891 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.284875 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c85c7c83-3821-426a-abc5-38a8225a4f4d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.292135 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.292112 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8s6x\" (UniqueName: \"kubernetes.io/projected/c85c7c83-3821-426a-abc5-38a8225a4f4d-kube-api-access-d8s6x\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x\" (UID: \"c85c7c83-3821-426a-abc5-38a8225a4f4d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.449177 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.449091 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:14.591824 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.591793 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x"] Jun 08 12:24:14.594995 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:24:14.594945 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85c7c83_3821_426a_abc5_38a8225a4f4d.slice/crio-c882df6194434eb4804342ddfdbae2e9a51a8224292e0d8a697aa5b419017b23 WatchSource:0}: Error finding container c882df6194434eb4804342ddfdbae2e9a51a8224292e0d8a697aa5b419017b23: Status 404 returned error can't find the container with id c882df6194434eb4804342ddfdbae2e9a51a8224292e0d8a697aa5b419017b23 Jun 08 12:24:14.720311 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.720210 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" event={"ID":"c85c7c83-3821-426a-abc5-38a8225a4f4d","Type":"ContainerStarted","Data":"3b1678433119f8be26baea2b82f9c106ec3688a147e5bee25091d8474264d927"} Jun 08 12:24:14.720311 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:14.720266 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" event={"ID":"c85c7c83-3821-426a-abc5-38a8225a4f4d","Type":"ContainerStarted","Data":"c882df6194434eb4804342ddfdbae2e9a51a8224292e0d8a697aa5b419017b23"} Jun 08 12:24:16.734522 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:16.734483 2584 generic.go:356] "Generic (PLEG): container finished" podID="c85c7c83-3821-426a-abc5-38a8225a4f4d" containerID="3b1678433119f8be26baea2b82f9c106ec3688a147e5bee25091d8474264d927" exitCode=0 Jun 08 12:24:16.734893 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:16.734554 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" event={"ID":"c85c7c83-3821-426a-abc5-38a8225a4f4d","Type":"ContainerDied","Data":"3b1678433119f8be26baea2b82f9c106ec3688a147e5bee25091d8474264d927"} Jun 08 12:24:17.740874 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:17.740835 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" event={"ID":"c85c7c83-3821-426a-abc5-38a8225a4f4d","Type":"ContainerStarted","Data":"4b3f96a545b116fc720a45e625e023c7f831cda2c5f704736d8a31967d28be55"} Jun 08 12:24:17.764055 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:17.764004 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" podStartSLOduration=2.197929597 podStartE2EDuration="3.763967105s" totalImagesPullingTime="255.560232ms" totalInitContainerRuntime="1.310477276s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:24:17.762930883 +0000 UTC m=+892.824056050" watchObservedRunningTime="2026-06-08 12:24:17.763967105 +0000 UTC m=+892.825092272" Jun 08 12:24:24.450152 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:24.450109 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:24.450607 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:24.450175 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:24.462796 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:24.462771 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:24.781193 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:24.781118 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x" Jun 08 12:24:25.381753 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:25.381727 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:24:25.382216 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:25.382190 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:24:39.308550 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.308511 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj"] Jun 08 12:24:39.311879 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.311863 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.315157 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.315129 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 08 12:24:39.326691 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.326666 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj"] Jun 08 12:24:39.400876 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.400837 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.400876 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.400882 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.401105 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.400899 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbxz6\" (UniqueName: \"kubernetes.io/projected/a7208773-4d1d-4006-b392-4a37f84415d4-kube-api-access-dbxz6\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.401105 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.401016 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7208773-4d1d-4006-b392-4a37f84415d4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.401105 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.401055 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.401105 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.401077 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.502357 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.502315 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.502544 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.502378 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.502544 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.502456 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.502544 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.502484 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.502544 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.502507 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbxz6\" (UniqueName: \"kubernetes.io/projected/a7208773-4d1d-4006-b392-4a37f84415d4-kube-api-access-dbxz6\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.502797 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.502578 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7208773-4d1d-4006-b392-4a37f84415d4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.502797 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.502768 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.502907 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.502832 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.502949 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.502936 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.504840 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.504819 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7208773-4d1d-4006-b392-4a37f84415d4-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.505315 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.505295 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7208773-4d1d-4006-b392-4a37f84415d4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.512362 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.512341 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbxz6\" (UniqueName: \"kubernetes.io/projected/a7208773-4d1d-4006-b392-4a37f84415d4-kube-api-access-dbxz6\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj\" (UID: \"a7208773-4d1d-4006-b392-4a37f84415d4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.622105 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.622020 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:39.760751 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.760718 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj"] Jun 08 12:24:39.764031 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:24:39.763999 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7208773_4d1d_4006_b392_4a37f84415d4.slice/crio-0402c8bdfabeddca0797d6d009d0232b32caf146ffc14d8ccdea890e897955bd WatchSource:0}: Error finding container 0402c8bdfabeddca0797d6d009d0232b32caf146ffc14d8ccdea890e897955bd: Status 404 returned error can't find the container with id 0402c8bdfabeddca0797d6d009d0232b32caf146ffc14d8ccdea890e897955bd Jun 08 12:24:39.833040 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.833010 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" event={"ID":"a7208773-4d1d-4006-b392-4a37f84415d4","Type":"ContainerStarted","Data":"8767f25ef1e80cd8b8024bb4b905945fa4b6393437d9cfc1a886f926dab63c1d"} Jun 08 12:24:39.833187 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:39.833069 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" event={"ID":"a7208773-4d1d-4006-b392-4a37f84415d4","Type":"ContainerStarted","Data":"0402c8bdfabeddca0797d6d009d0232b32caf146ffc14d8ccdea890e897955bd"} Jun 08 12:24:50.996421 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:50.996383 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6"] Jun 08 12:24:51.002250 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.002225 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.004600 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.004582 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 08 12:24:51.013253 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.013225 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6"] Jun 08 12:24:51.102440 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.102406 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.102620 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.102494 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.102620 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.102516 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.102620 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.102535 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98f621a-dfa6-49cd-be65-ca927621f2d1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.102620 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.102606 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.102778 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.102639 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrrpq\" (UniqueName: \"kubernetes.io/projected/c98f621a-dfa6-49cd-be65-ca927621f2d1-kube-api-access-jrrpq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.203699 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.203650 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.203878 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.203726 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.203878 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.203763 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98f621a-dfa6-49cd-be65-ca927621f2d1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.203878 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.203826 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.203878 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.203874 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrrpq\" (UniqueName: \"kubernetes.io/projected/c98f621a-dfa6-49cd-be65-ca927621f2d1-kube-api-access-jrrpq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.204155 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.203915 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.205453 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.205416 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.205750 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.205725 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.207115 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.207089 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.208014 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.207541 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98f621a-dfa6-49cd-be65-ca927621f2d1-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.210891 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.210867 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98f621a-dfa6-49cd-be65-ca927621f2d1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.217274 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.217251 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrrpq\" (UniqueName: \"kubernetes.io/projected/c98f621a-dfa6-49cd-be65-ca927621f2d1-kube-api-access-jrrpq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh9z6\" (UID: \"c98f621a-dfa6-49cd-be65-ca927621f2d1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.313529 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.313483 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:24:51.457886 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.457853 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6"] Jun 08 12:24:51.460574 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:24:51.460546 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98f621a_dfa6_49cd_be65_ca927621f2d1.slice/crio-4d359005408be473a99b65b46de8dee71b0014d110a32d591d9b87657eb550bf WatchSource:0}: Error finding container 4d359005408be473a99b65b46de8dee71b0014d110a32d591d9b87657eb550bf: Status 404 returned error can't find the container with id 4d359005408be473a99b65b46de8dee71b0014d110a32d591d9b87657eb550bf Jun 08 12:24:51.888425 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.888386 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" event={"ID":"c98f621a-dfa6-49cd-be65-ca927621f2d1","Type":"ContainerStarted","Data":"f9ba80c71798c412e8c6c4df293dca75e3ba7e94297743e54cb18ab61510a1f6"} Jun 08 12:24:51.888425 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:51.888431 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" event={"ID":"c98f621a-dfa6-49cd-be65-ca927621f2d1","Type":"ContainerStarted","Data":"4d359005408be473a99b65b46de8dee71b0014d110a32d591d9b87657eb550bf"} Jun 08 12:24:52.894316 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:52.894279 2584 generic.go:356] "Generic (PLEG): container finished" podID="c98f621a-dfa6-49cd-be65-ca927621f2d1" containerID="f9ba80c71798c412e8c6c4df293dca75e3ba7e94297743e54cb18ab61510a1f6" exitCode=0 Jun 08 12:24:52.894714 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:52.894376 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" event={"ID":"c98f621a-dfa6-49cd-be65-ca927621f2d1","Type":"ContainerDied","Data":"f9ba80c71798c412e8c6c4df293dca75e3ba7e94297743e54cb18ab61510a1f6"} Jun 08 12:24:53.901127 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:53.901093 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" event={"ID":"c98f621a-dfa6-49cd-be65-ca927621f2d1","Type":"ContainerStarted","Data":"9f8c810423465e19352c03e9934e70f14a001f5021d13eb89e98cd3d2258ba28"} Jun 08 12:24:53.923350 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:53.923302 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" podStartSLOduration=2.25685543 podStartE2EDuration="3.923285553s" totalImagesPullingTime="374.157827ms" totalInitContainerRuntime="1.292272296s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:24:53.922268764 +0000 UTC m=+928.983393968" watchObservedRunningTime="2026-06-08 12:24:53.923285553 +0000 UTC m=+928.984410719" Jun 08 12:24:54.907127 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:54.907092 2584 generic.go:356] "Generic (PLEG): container finished" podID="a7208773-4d1d-4006-b392-4a37f84415d4" containerID="8767f25ef1e80cd8b8024bb4b905945fa4b6393437d9cfc1a886f926dab63c1d" exitCode=0 Jun 08 12:24:54.907514 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:54.907159 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" event={"ID":"a7208773-4d1d-4006-b392-4a37f84415d4","Type":"ContainerDied","Data":"8767f25ef1e80cd8b8024bb4b905945fa4b6393437d9cfc1a886f926dab63c1d"} Jun 08 12:24:55.912891 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:55.912854 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" event={"ID":"a7208773-4d1d-4006-b392-4a37f84415d4","Type":"ContainerStarted","Data":"d491d3b59822f860f0a7a20b5b530a8d530a14846fe3cc603c6652ff49369e32"} Jun 08 12:24:55.936030 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:55.935959 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" podStartSLOduration=2.061969488 podStartE2EDuration="16.935943291s" totalImagesPullingTime="564.421359ms" totalInitContainerRuntime="14.309552444s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:24:55.93475936 +0000 UTC m=+930.995884540" watchObservedRunningTime="2026-06-08 12:24:55.935943291 +0000 UTC m=+930.997068459" Jun 08 12:24:59.622946 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:59.622909 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:59.623363 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:59.623000 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:59.635592 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:59.635570 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:24:59.940794 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:24:59.940714 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj" Jun 08 12:25:01.314160 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:25:01.314125 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:25:01.314648 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:25:01.314176 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:25:01.326440 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:25:01.326418 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:25:01.948942 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:25:01.948916 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh9z6" Jun 08 12:29:25.412649 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:29:25.412620 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:29:25.413881 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:29:25.413861 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:34:25.441821 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:34:25.441780 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:34:25.444748 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:34:25.444726 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:37:44.668805 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:44.668767 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c"] Jun 08 12:37:44.669369 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:44.669037 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" podUID="fc6edbfb-9e49-4e5d-983b-070dfcb08f9c" containerName="manager" containerID="cri-o://42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867" gracePeriod=10 Jun 08 12:37:44.919705 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:44.919630 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:37:45.069038 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.069005 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk2dt\" (UniqueName: \"kubernetes.io/projected/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-kube-api-access-hk2dt\") pod \"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c\" (UID: \"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c\") " Jun 08 12:37:45.069038 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.069045 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-extensions-socket-volume\") pod \"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c\" (UID: \"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c\") " Jun 08 12:37:45.069464 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.069443 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc6edbfb-9e49-4e5d-983b-070dfcb08f9c" (UID: "fc6edbfb-9e49-4e5d-983b-070dfcb08f9c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:37:45.071260 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.071237 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-kube-api-access-hk2dt" (OuterVolumeSpecName: "kube-api-access-hk2dt") pod "fc6edbfb-9e49-4e5d-983b-070dfcb08f9c" (UID: "fc6edbfb-9e49-4e5d-983b-070dfcb08f9c"). InnerVolumeSpecName "kube-api-access-hk2dt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:37:45.169627 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.169596 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk2dt\" (UniqueName: \"kubernetes.io/projected/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-kube-api-access-hk2dt\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:37:45.169627 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.169623 2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c-extensions-socket-volume\") on node \"ip-10-0-136-216.ec2.internal\" DevicePath \"\"" Jun 08 12:37:45.229774 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.229677 2584 generic.go:356] "Generic (PLEG): container finished" podID="fc6edbfb-9e49-4e5d-983b-070dfcb08f9c" containerID="42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867" exitCode=0 Jun 08 12:37:45.229774 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.229721 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" Jun 08 12:37:45.229964 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.229771 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" event={"ID":"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c","Type":"ContainerDied","Data":"42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867"} Jun 08 12:37:45.229964 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.229817 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c" event={"ID":"fc6edbfb-9e49-4e5d-983b-070dfcb08f9c","Type":"ContainerDied","Data":"32661174bb986ebc912f3a12526f09bb0fc6ae23232bb422f3f6fbc0ab3be55c"} Jun 08 12:37:45.229964 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.229836 2584 scope.go:117] "RemoveContainer" containerID="42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867" Jun 08 12:37:45.239869 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.239854 2584 scope.go:117] "RemoveContainer" containerID="42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867" Jun 08 12:37:45.240125 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:37:45.240108 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867\": container with ID starting with 42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867 not found: ID does not exist" containerID="42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867" Jun 08 12:37:45.240202 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.240136 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867"} err="failed to get container status \"42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867\": rpc error: code = NotFound desc = could not find container \"42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867\": container with ID starting with 42c4777a1ffae6555416332f859593ca8e5dd698aae301fcf3b7e3d454bc7867 not found: ID does not exist" Jun 08 12:37:45.253383 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.253359 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c"] Jun 08 12:37:45.260487 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.260464 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5567c"] Jun 08 12:37:45.381247 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:37:45.381216 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc6edbfb-9e49-4e5d-983b-070dfcb08f9c" path="/var/lib/kubelet/pods/fc6edbfb-9e49-4e5d-983b-070dfcb08f9c/volumes" Jun 08 12:38:50.892016 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:50.891967 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm"] Jun 08 12:38:50.892469 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:50.892293 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc6edbfb-9e49-4e5d-983b-070dfcb08f9c" containerName="manager" Jun 08 12:38:50.892469 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:50.892303 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc6edbfb-9e49-4e5d-983b-070dfcb08f9c" containerName="manager" Jun 08 12:38:50.892469 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:50.892370 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc6edbfb-9e49-4e5d-983b-070dfcb08f9c" containerName="manager" Jun 08 12:38:50.895272 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:50.895254 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" Jun 08 12:38:50.898611 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:50.898592 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wq4rb\"" Jun 08 12:38:50.948213 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:50.948178 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bd8567a-de72-4de8-82c1-95362596813e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wzszm\" (UID: \"4bd8567a-de72-4de8-82c1-95362596813e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" Jun 08 12:38:50.948410 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:50.948238 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhvkz\" (UniqueName: \"kubernetes.io/projected/4bd8567a-de72-4de8-82c1-95362596813e-kube-api-access-dhvkz\") pod \"kuadrant-operator-controller-manager-86878c769f-wzszm\" (UID: \"4bd8567a-de72-4de8-82c1-95362596813e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" Jun 08 12:38:50.950318 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:50.950292 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm"] Jun 08 12:38:51.049501 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:51.049464 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhvkz\" (UniqueName: \"kubernetes.io/projected/4bd8567a-de72-4de8-82c1-95362596813e-kube-api-access-dhvkz\") pod \"kuadrant-operator-controller-manager-86878c769f-wzszm\" (UID: \"4bd8567a-de72-4de8-82c1-95362596813e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" Jun 08 12:38:51.049671 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:51.049572 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bd8567a-de72-4de8-82c1-95362596813e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wzszm\" (UID: \"4bd8567a-de72-4de8-82c1-95362596813e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" Jun 08 12:38:51.049927 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:51.049910 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bd8567a-de72-4de8-82c1-95362596813e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wzszm\" (UID: \"4bd8567a-de72-4de8-82c1-95362596813e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" Jun 08 12:38:51.065352 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:51.065311 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhvkz\" (UniqueName: \"kubernetes.io/projected/4bd8567a-de72-4de8-82c1-95362596813e-kube-api-access-dhvkz\") pod \"kuadrant-operator-controller-manager-86878c769f-wzszm\" (UID: \"4bd8567a-de72-4de8-82c1-95362596813e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" Jun 08 12:38:51.205703 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:51.205611 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" Jun 08 12:38:51.449626 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:51.449590 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm"] Jun 08 12:38:51.463181 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:38:51.463153 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd8567a_de72_4de8_82c1_95362596813e.slice/crio-0d9ad434c911b05b13f0dc2459d3e0ed4b57de9897c451bcedec64ab9a044432 WatchSource:0}: Error finding container 0d9ad434c911b05b13f0dc2459d3e0ed4b57de9897c451bcedec64ab9a044432: Status 404 returned error can't find the container with id 0d9ad434c911b05b13f0dc2459d3e0ed4b57de9897c451bcedec64ab9a044432 Jun 08 12:38:51.513114 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:51.513091 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" event={"ID":"4bd8567a-de72-4de8-82c1-95362596813e","Type":"ContainerStarted","Data":"0d9ad434c911b05b13f0dc2459d3e0ed4b57de9897c451bcedec64ab9a044432"} Jun 08 12:38:52.524633 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:52.524586 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" event={"ID":"4bd8567a-de72-4de8-82c1-95362596813e","Type":"ContainerStarted","Data":"6f55e85d38a54d3e5128471aac7f7a7dec3422af3ecebf26e8c62234625b48bf"} Jun 08 12:38:52.525044 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:52.524727 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" Jun 08 12:38:52.573191 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:38:52.573139 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" podStartSLOduration=2.573123556 podStartE2EDuration="2.573123556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:38:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:38:52.570200671 +0000 UTC m=+1767.631325837" watchObservedRunningTime="2026-06-08 12:38:52.573123556 +0000 UTC m=+1767.634248723" Jun 08 12:39:03.530923 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:39:03.530889 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wzszm" Jun 08 12:39:25.475497 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:39:25.475468 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:39:25.476202 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:39:25.476177 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:44:25.499819 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:44:25.499785 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:44:25.502528 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:44:25.502509 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:48:38.063433 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.063392 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88"] Jun 08 12:48:38.066883 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.066860 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:48:38.087939 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.087911 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c243bc6a-aa4c-4f81-8769-400a2e574188-maas-api-tls\") pod \"maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88\" (UID: \"c243bc6a-aa4c-4f81-8769-400a2e574188\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:48:38.088065 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.087948 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvrxs\" (UniqueName: \"kubernetes.io/projected/c243bc6a-aa4c-4f81-8769-400a2e574188-kube-api-access-rvrxs\") pod \"maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88\" (UID: \"c243bc6a-aa4c-4f81-8769-400a2e574188\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:48:38.096612 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.096588 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88"] Jun 08 12:48:38.189234 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.189194 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c243bc6a-aa4c-4f81-8769-400a2e574188-maas-api-tls\") pod \"maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88\" (UID: \"c243bc6a-aa4c-4f81-8769-400a2e574188\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:48:38.189234 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.189234 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvrxs\" (UniqueName: \"kubernetes.io/projected/c243bc6a-aa4c-4f81-8769-400a2e574188-kube-api-access-rvrxs\") pod \"maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88\" (UID: \"c243bc6a-aa4c-4f81-8769-400a2e574188\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:48:38.191842 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.191822 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c243bc6a-aa4c-4f81-8769-400a2e574188-maas-api-tls\") pod \"maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88\" (UID: \"c243bc6a-aa4c-4f81-8769-400a2e574188\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:48:38.197667 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.197642 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvrxs\" (UniqueName: \"kubernetes.io/projected/c243bc6a-aa4c-4f81-8769-400a2e574188-kube-api-access-rvrxs\") pod \"maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88\" (UID: \"c243bc6a-aa4c-4f81-8769-400a2e574188\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:48:38.376950 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.376863 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:48:38.518663 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.518551 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88"] Jun 08 12:48:38.521300 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:48:38.521272 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc243bc6a_aa4c_4f81_8769_400a2e574188.slice/crio-9cc78a7e369e0e21f7c5bca267caa933b4099363f6898ad8a4b3c3abf843b344 WatchSource:0}: Error finding container 9cc78a7e369e0e21f7c5bca267caa933b4099363f6898ad8a4b3c3abf843b344: Status 404 returned error can't find the container with id 9cc78a7e369e0e21f7c5bca267caa933b4099363f6898ad8a4b3c3abf843b344 Jun 08 12:48:38.522612 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:38.522592 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:48:39.002191 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:39.002152 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" event={"ID":"c243bc6a-aa4c-4f81-8769-400a2e574188","Type":"ContainerStarted","Data":"752eb5bb7e1968497857a7d386d22136d86d1aae7b0100a2330924f29686efb4"} Jun 08 12:48:39.002386 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:39.002233 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" event={"ID":"c243bc6a-aa4c-4f81-8769-400a2e574188","Type":"ContainerStarted","Data":"9cc78a7e369e0e21f7c5bca267caa933b4099363f6898ad8a4b3c3abf843b344"} Jun 08 12:48:39.002386 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:39.002253 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:48:39.024719 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:39.024672 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podStartSLOduration=0.725263767 podStartE2EDuration="1.024657026s" totalImagesPullingTime="299.393259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:48:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:48:39.022707054 +0000 UTC m=+2354.083832220" watchObservedRunningTime="2026-06-08 12:48:39.024657026 +0000 UTC m=+2354.085782192" Jun 08 12:48:40.007698 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:40.007665 2584 generic.go:356] "Generic (PLEG): container finished" podID="c243bc6a-aa4c-4f81-8769-400a2e574188" containerID="752eb5bb7e1968497857a7d386d22136d86d1aae7b0100a2330924f29686efb4" exitCode=1 Jun 08 12:48:40.008133 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:40.007725 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" event={"ID":"c243bc6a-aa4c-4f81-8769-400a2e574188","Type":"ContainerDied","Data":"752eb5bb7e1968497857a7d386d22136d86d1aae7b0100a2330924f29686efb4"} Jun 08 12:48:40.008133 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:40.008003 2584 scope.go:117] "RemoveContainer" containerID="752eb5bb7e1968497857a7d386d22136d86d1aae7b0100a2330924f29686efb4" Jun 08 12:48:41.013796 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:41.013706 2584 generic.go:356] "Generic (PLEG): container finished" podID="c243bc6a-aa4c-4f81-8769-400a2e574188" containerID="2aefce5d2d91c736aeefb5f19ef7dc4e42c905d2dfcb721dbb1b88c069388903" exitCode=1 Jun 08 12:48:41.014284 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:41.013789 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" event={"ID":"c243bc6a-aa4c-4f81-8769-400a2e574188","Type":"ContainerDied","Data":"2aefce5d2d91c736aeefb5f19ef7dc4e42c905d2dfcb721dbb1b88c069388903"} Jun 08 12:48:41.014284 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:41.013850 2584 scope.go:117] "RemoveContainer" containerID="752eb5bb7e1968497857a7d386d22136d86d1aae7b0100a2330924f29686efb4" Jun 08 12:48:41.014284 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:41.014052 2584 scope.go:117] "RemoveContainer" containerID="2aefce5d2d91c736aeefb5f19ef7dc4e42c905d2dfcb721dbb1b88c069388903" Jun 08 12:48:41.014453 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:48:41.014298 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88_redhat-ai-gateway-infra(c243bc6a-aa4c-4f81-8769-400a2e574188)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podUID="c243bc6a-aa4c-4f81-8769-400a2e574188" Jun 08 12:48:42.019344 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:42.019316 2584 scope.go:117] "RemoveContainer" containerID="2aefce5d2d91c736aeefb5f19ef7dc4e42c905d2dfcb721dbb1b88c069388903" Jun 08 12:48:42.019743 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:48:42.019481 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88_redhat-ai-gateway-infra(c243bc6a-aa4c-4f81-8769-400a2e574188)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podUID="c243bc6a-aa4c-4f81-8769-400a2e574188" Jun 08 12:48:44.003097 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:44.003059 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:48:44.003593 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:44.003528 2584 scope.go:117] "RemoveContainer" containerID="2aefce5d2d91c736aeefb5f19ef7dc4e42c905d2dfcb721dbb1b88c069388903" Jun 08 12:48:44.003775 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:48:44.003752 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88_redhat-ai-gateway-infra(c243bc6a-aa4c-4f81-8769-400a2e574188)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podUID="c243bc6a-aa4c-4f81-8769-400a2e574188" Jun 08 12:48:48.377596 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:48.377561 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:48:48.378017 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:48:48.377953 2584 scope.go:117] "RemoveContainer" containerID="2aefce5d2d91c736aeefb5f19ef7dc4e42c905d2dfcb721dbb1b88c069388903" Jun 08 12:48:48.378200 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:48:48.378180 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88_redhat-ai-gateway-infra(c243bc6a-aa4c-4f81-8769-400a2e574188)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podUID="c243bc6a-aa4c-4f81-8769-400a2e574188" Jun 08 12:49:00.375885 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:00.375854 2584 scope.go:117] "RemoveContainer" containerID="2aefce5d2d91c736aeefb5f19ef7dc4e42c905d2dfcb721dbb1b88c069388903" Jun 08 12:49:01.102613 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:01.102579 2584 generic.go:356] "Generic (PLEG): container finished" podID="c243bc6a-aa4c-4f81-8769-400a2e574188" containerID="da3b7c9e0e881cc15a3326b2943e27396d785c2b612e67140a02839674178cf6" exitCode=1 Jun 08 12:49:01.102785 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:01.102658 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" event={"ID":"c243bc6a-aa4c-4f81-8769-400a2e574188","Type":"ContainerDied","Data":"da3b7c9e0e881cc15a3326b2943e27396d785c2b612e67140a02839674178cf6"} Jun 08 12:49:01.102785 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:01.102725 2584 scope.go:117] "RemoveContainer" containerID="2aefce5d2d91c736aeefb5f19ef7dc4e42c905d2dfcb721dbb1b88c069388903" Jun 08 12:49:01.103086 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:01.103070 2584 scope.go:117] "RemoveContainer" containerID="da3b7c9e0e881cc15a3326b2943e27396d785c2b612e67140a02839674178cf6" Jun 08 12:49:01.103320 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:49:01.103298 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88_redhat-ai-gateway-infra(c243bc6a-aa4c-4f81-8769-400a2e574188)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podUID="c243bc6a-aa4c-4f81-8769-400a2e574188" Jun 08 12:49:03.451523 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:03.451489 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858dfdb94-4jkr5_1206957a-9f7c-4800-82e4-74bd93070949/manager/0.log" Jun 08 12:49:03.460117 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:03.460098 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858dfdb94-4jkr5_1206957a-9f7c-4800-82e4-74bd93070949/copy-manifests/0.log" Jun 08 12:49:04.003131 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:04.003079 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:49:04.003481 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:04.003465 2584 scope.go:117] "RemoveContainer" containerID="da3b7c9e0e881cc15a3326b2943e27396d785c2b612e67140a02839674178cf6" Jun 08 12:49:04.003662 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:49:04.003633 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88_redhat-ai-gateway-infra(c243bc6a-aa4c-4f81-8769-400a2e574188)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podUID="c243bc6a-aa4c-4f81-8769-400a2e574188" Jun 08 12:49:05.327616 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:05.327591 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7mkg5_9b4e6f52-a697-4732-842d-ecf007af63af/kuadrant-console-plugin/0.log" Jun 08 12:49:05.574447 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:05.574413 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wzszm_4bd8567a-de72-4de8-82c1-95362596813e/manager/0.log" Jun 08 12:49:06.392239 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:06.392212 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86b9d9554c-frfns_38d13beb-df56-469f-aeed-a8c0c40eb527/kube-auth-proxy/0.log" Jun 08 12:49:07.309047 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:07.309007 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc_14020a38-546b-4d59-b32d-390c8fdb6cb5/storage-initializer/0.log" Jun 08 12:49:07.317608 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:07.317583 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-q7jsc_14020a38-546b-4d59-b32d-390c8fdb6cb5/main/0.log" Jun 08 12:49:07.552439 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:07.552411 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x_c85c7c83-3821-426a-abc5-38a8225a4f4d/storage-initializer/0.log" Jun 08 12:49:07.560340 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:07.560280 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-fld5x_c85c7c83-3821-426a-abc5-38a8225a4f4d/main/0.log" Jun 08 12:49:07.792177 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:07.792150 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj_a7208773-4d1d-4006-b392-4a37f84415d4/storage-initializer/0.log" Jun 08 12:49:07.799132 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:07.799109 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-cwmwj_a7208773-4d1d-4006-b392-4a37f84415d4/main/0.log" Jun 08 12:49:07.905492 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:07.905416 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gh9z6_c98f621a-dfa6-49cd-be65-ca927621f2d1/storage-initializer/0.log" Jun 08 12:49:07.913897 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:07.913871 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gh9z6_c98f621a-dfa6-49cd-be65-ca927621f2d1/main/0.log" Jun 08 12:49:08.377090 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:08.377054 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:49:08.377435 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:08.377416 2584 scope.go:117] "RemoveContainer" containerID="da3b7c9e0e881cc15a3326b2943e27396d785c2b612e67140a02839674178cf6" Jun 08 12:49:08.377614 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:49:08.377593 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88_redhat-ai-gateway-infra(c243bc6a-aa4c-4f81-8769-400a2e574188)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podUID="c243bc6a-aa4c-4f81-8769-400a2e574188" Jun 08 12:49:15.339107 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:15.339076 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kz97q_dc2566b6-1a94-4bd2-bea1-10852ae45061/global-pull-secret-syncer/0.log" Jun 08 12:49:15.471160 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:15.471126 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pncd7_a1b88c71-84c8-4caa-b7ae-0911683f1008/konnectivity-agent/0.log" Jun 08 12:49:15.523520 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:15.523484 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-216.ec2.internal_b691406e1e053ba364f9fbf30fa94f31/haproxy/0.log" Jun 08 12:49:21.375030 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:21.374997 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7mkg5_9b4e6f52-a697-4732-842d-ecf007af63af/kuadrant-console-plugin/0.log" Jun 08 12:49:21.507942 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:21.507907 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wzszm_4bd8567a-de72-4de8-82c1-95362596813e/manager/0.log" Jun 08 12:49:23.376809 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:23.376772 2584 scope.go:117] "RemoveContainer" containerID="da3b7c9e0e881cc15a3326b2943e27396d785c2b612e67140a02839674178cf6" Jun 08 12:49:23.594565 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:23.594532 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5t47s_5595f219-a3c3-4769-81ea-d11dbbda659a/node-exporter/0.log" Jun 08 12:49:23.616290 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:23.616268 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5t47s_5595f219-a3c3-4769-81ea-d11dbbda659a/kube-rbac-proxy/0.log" Jun 08 12:49:23.643453 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:23.643429 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5t47s_5595f219-a3c3-4769-81ea-d11dbbda659a/init-textfile/0.log" Jun 08 12:49:24.001535 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:24.001462 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ba52bca-8496-4063-a777-711df6f3dd1f/prometheus/0.log" Jun 08 12:49:24.028025 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:24.027995 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ba52bca-8496-4063-a777-711df6f3dd1f/config-reloader/0.log" Jun 08 12:49:24.057021 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:24.056997 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ba52bca-8496-4063-a777-711df6f3dd1f/thanos-sidecar/0.log" Jun 08 12:49:24.082188 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:24.082168 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ba52bca-8496-4063-a777-711df6f3dd1f/kube-rbac-proxy-web/0.log" Jun 08 12:49:24.106361 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:24.106338 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ba52bca-8496-4063-a777-711df6f3dd1f/kube-rbac-proxy/0.log" Jun 08 12:49:24.130355 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:24.130328 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ba52bca-8496-4063-a777-711df6f3dd1f/kube-rbac-proxy-thanos/0.log" Jun 08 12:49:24.157406 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:24.157384 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ba52bca-8496-4063-a777-711df6f3dd1f/init-config-reloader/0.log" Jun 08 12:49:24.201765 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:24.201740 2584 generic.go:356] "Generic (PLEG): container finished" podID="c243bc6a-aa4c-4f81-8769-400a2e574188" containerID="dcdf33d3209eb47fc74593162ee6de9b017b878746ed07ea8318a192fcc69c3c" exitCode=1 Jun 08 12:49:24.201886 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:24.201776 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" event={"ID":"c243bc6a-aa4c-4f81-8769-400a2e574188","Type":"ContainerDied","Data":"dcdf33d3209eb47fc74593162ee6de9b017b878746ed07ea8318a192fcc69c3c"} Jun 08 12:49:24.201886 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:24.201824 2584 scope.go:117] "RemoveContainer" containerID="da3b7c9e0e881cc15a3326b2943e27396d785c2b612e67140a02839674178cf6" Jun 08 12:49:24.202157 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:24.202138 2584 scope.go:117] "RemoveContainer" containerID="dcdf33d3209eb47fc74593162ee6de9b017b878746ed07ea8318a192fcc69c3c" Jun 08 12:49:24.202359 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:49:24.202335 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88_redhat-ai-gateway-infra(c243bc6a-aa4c-4f81-8769-400a2e574188)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podUID="c243bc6a-aa4c-4f81-8769-400a2e574188" Jun 08 12:49:25.524902 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:25.524874 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:49:25.528215 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:25.528194 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt29v_24f34b7f-2c4c-4f88-a8bc-27927fc7bd5b/ovn-acl-logging/0.log" Jun 08 12:49:26.581355 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.581317 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6"] Jun 08 12:49:26.585648 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.585630 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.588051 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.588024 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vgzwv\"/\"openshift-service-ca.crt\"" Jun 08 12:49:26.588894 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.588849 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vgzwv\"/\"default-dockercfg-kqpfq\"" Jun 08 12:49:26.589022 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.588947 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vgzwv\"/\"kube-root-ca.crt\"" Jun 08 12:49:26.594603 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.594579 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6"] Jun 08 12:49:26.622443 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.622410 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-proc\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.622443 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.622444 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-lib-modules\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.622632 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.622463 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-sys\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.622632 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.622478 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgllq\" (UniqueName: \"kubernetes.io/projected/78419f88-b5e6-4976-b908-79d831775591-kube-api-access-bgllq\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.622632 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.622560 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-podres\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.723790 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.723744 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-proc\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.723790 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.723789 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-lib-modules\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.724104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.723816 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-sys\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.724104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.723839 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgllq\" (UniqueName: \"kubernetes.io/projected/78419f88-b5e6-4976-b908-79d831775591-kube-api-access-bgllq\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.724104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.723886 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-podres\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.724104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.723888 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-proc\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.724104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.723895 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-sys\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.724104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.723938 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-lib-modules\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.724104 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.724035 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/78419f88-b5e6-4976-b908-79d831775591-podres\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.732679 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.732661 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgllq\" (UniqueName: \"kubernetes.io/projected/78419f88-b5e6-4976-b908-79d831775591-kube-api-access-bgllq\") pod \"perf-node-gather-daemonset-pr2m6\" (UID: \"78419f88-b5e6-4976-b908-79d831775591\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:26.896801 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:26.896714 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:27.032879 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:27.032839 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6"] Jun 08 12:49:27.035217 ip-10-0-136-216 kubenswrapper[2584]: W0608 12:49:27.035186 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod78419f88_b5e6_4976_b908_79d831775591.slice/crio-95c409302260f54b03768a5863f0c857d6f912f427641a405df03bb028bbcc0f WatchSource:0}: Error finding container 95c409302260f54b03768a5863f0c857d6f912f427641a405df03bb028bbcc0f: Status 404 returned error can't find the container with id 95c409302260f54b03768a5863f0c857d6f912f427641a405df03bb028bbcc0f Jun 08 12:49:27.216414 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:27.216376 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" event={"ID":"78419f88-b5e6-4976-b908-79d831775591","Type":"ContainerStarted","Data":"6e364f60408cddec570ce6d076b1e19f19722925a930f2a55480946d84ef1206"} Jun 08 12:49:27.216557 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:27.216438 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" event={"ID":"78419f88-b5e6-4976-b908-79d831775591","Type":"ContainerStarted","Data":"95c409302260f54b03768a5863f0c857d6f912f427641a405df03bb028bbcc0f"} Jun 08 12:49:27.216557 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:27.216481 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:27.237137 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:27.237075 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" podStartSLOduration=1.237061472 podStartE2EDuration="1.237061472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:49:27.23575393 +0000 UTC m=+2402.296879114" watchObservedRunningTime="2026-06-08 12:49:27.237061472 +0000 UTC m=+2402.298186681" Jun 08 12:49:28.377352 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:28.377307 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:49:28.377744 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:28.377707 2584 scope.go:117] "RemoveContainer" containerID="dcdf33d3209eb47fc74593162ee6de9b017b878746ed07ea8318a192fcc69c3c" Jun 08 12:49:28.377898 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:49:28.377878 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88_redhat-ai-gateway-infra(c243bc6a-aa4c-4f81-8769-400a2e574188)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podUID="c243bc6a-aa4c-4f81-8769-400a2e574188" Jun 08 12:49:28.971838 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:28.971805 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gfh8r_e83de341-8e6e-47ff-b99a-859fe33c83e6/dns/0.log" Jun 08 12:49:28.995273 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:28.995251 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gfh8r_e83de341-8e6e-47ff-b99a-859fe33c83e6/kube-rbac-proxy/0.log" Jun 08 12:49:29.002847 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:29.002823 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" Jun 08 12:49:29.073050 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:29.073026 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hv8xt_ee2b4d11-85ce-48f3-aaf4-2bf19efeb291/dns-node-resolver/0.log" Jun 08 12:49:29.225324 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:29.225247 2584 scope.go:117] "RemoveContainer" containerID="dcdf33d3209eb47fc74593162ee6de9b017b878746ed07ea8318a192fcc69c3c" Jun 08 12:49:29.225465 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:49:29.225415 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88_redhat-ai-gateway-infra(c243bc6a-aa4c-4f81-8769-400a2e574188)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podUID="c243bc6a-aa4c-4f81-8769-400a2e574188" Jun 08 12:49:29.681361 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:29.681329 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sftwv_07032d7f-d6b8-4655-bbf6-4bcec05ab66b/node-ca/0.log" Jun 08 12:49:30.766633 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:30.766603 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86b9d9554c-frfns_38d13beb-df56-469f-aeed-a8c0c40eb527/kube-auth-proxy/0.log" Jun 08 12:49:31.691281 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:31.691252 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-99vw4_305be2de-71c9-4673-870e-b0c19976f8db/serve-healthcheck-canary/0.log" Jun 08 12:49:32.360932 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:32.360900 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxs74_c4189b09-dd78-437e-8a60-396957a503b0/kube-rbac-proxy/0.log" Jun 08 12:49:32.383489 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:32.383461 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxs74_c4189b09-dd78-437e-8a60-396957a503b0/exporter/0.log" Jun 08 12:49:32.406572 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:32.406543 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxs74_c4189b09-dd78-437e-8a60-396957a503b0/extractor/0.log" Jun 08 12:49:33.231452 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:33.231424 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-pr2m6" Jun 08 12:49:35.193092 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:35.193050 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858dfdb94-4jkr5_1206957a-9f7c-4800-82e4-74bd93070949/manager/0.log" Jun 08 12:49:35.210557 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:35.210530 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858dfdb94-4jkr5_1206957a-9f7c-4800-82e4-74bd93070949/copy-manifests/0.log" Jun 08 12:49:37.083078 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:37.083050 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d9b9957d4-zct2t_44380a07-b08a-4f09-9ed4-30b80ee67226/manager/0.log" Jun 08 12:49:40.574648 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:40.574616 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86b9d9554c-frfns_38d13beb-df56-469f-aeed-a8c0c40eb527/kube-auth-proxy/0.log" Jun 08 12:49:41.995516 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:41.995489 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86b9d9554c-frfns_38d13beb-df56-469f-aeed-a8c0c40eb527/kube-auth-proxy/0.log" Jun 08 12:49:43.953777 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:43.953742 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86b9d9554c-frfns_38d13beb-df56-469f-aeed-a8c0c40eb527/kube-auth-proxy/0.log" Jun 08 12:49:44.375809 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:44.375776 2584 scope.go:117] "RemoveContainer" containerID="dcdf33d3209eb47fc74593162ee6de9b017b878746ed07ea8318a192fcc69c3c" Jun 08 12:49:44.375963 ip-10-0-136-216 kubenswrapper[2584]: E0608 12:49:44.375949 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88_redhat-ai-gateway-infra(c243bc6a-aa4c-4f81-8769-400a2e574188)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-692ee7b1-6655d68bcf-mrx88" podUID="c243bc6a-aa4c-4f81-8769-400a2e574188" Jun 08 12:49:44.482455 ip-10-0-136-216 kubenswrapper[2584]: I0608 12:49:44.482428 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbzz9_079697c1-565d-4f5a-a03f-c52588d0f1e8/kube-multus-additional-cni-plugins/0.log"