Jul 20 19:20:14.159059 ip-10-0-143-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 19:20:14.159071 ip-10-0-143-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 19:20:14.159081 ip-10-0-143-187 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 19:20:14.159390 ip-10-0-143-187 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 19:20:25.383004 ip-10-0-143-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 19:20:25.383022 ip-10-0-143-187 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot aae513c3e259447ba23d2e80f512e456 -- Jul 20 19:22:09.865757 ip-10-0-143-187 systemd[1]: Starting Kubernetes Kubelet... Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.321866 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326060 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326076 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326080 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326083 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326088 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326091 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326094 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:10.470605 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326096 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326099 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326102 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326105 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326108 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326110 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326113 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326115 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326118 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326121 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326123 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326127 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326129 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326132 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326138 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326141 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326144 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326147 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326149 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326152 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:10.472809 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326155 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326157 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326160 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326162 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326165 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326167 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326170 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326172 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326175 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326178 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326181 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326183 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326186 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326188 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326192 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326194 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326198 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326201 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326204 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326206 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:10.473569 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326209 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326212 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326214 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326218 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326222 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326224 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326227 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326229 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326232 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326234 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326238 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326242 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326246 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326249 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326252 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326254 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326257 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326259 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326262 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:10.474242 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326265 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326267 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326270 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326273 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326275 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326279 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326281 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326284 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326286 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326289 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326294 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326298 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326301 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326305 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326308 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326311 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326315 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326319 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326323 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:10.474895 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326326 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326329 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326331 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326334 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326337 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326340 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326343 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326346 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326348 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326351 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326353 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326356 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326358 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.326361 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327105 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327113 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327117 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327120 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327122 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327127 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:10.475763 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327130 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327133 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327136 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327139 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327142 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327144 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327147 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327150 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327152 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327155 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327157 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327160 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327163 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327166 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327169 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327172 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327175 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327177 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327180 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:10.476371 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327183 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327185 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327188 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327191 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327194 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327197 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327199 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327202 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327205 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327208 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327210 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327213 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327216 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327220 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327222 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327225 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327228 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327230 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327233 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327235 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:10.477011 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327240 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327243 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327246 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327249 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327252 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327255 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327258 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327260 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327263 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327267 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327270 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327273 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327275 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327278 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327281 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327285 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327288 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327291 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327294 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327296 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:10.477914 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327300 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327303 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327306 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327309 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327311 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327314 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327317 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327323 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327325 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327328 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327331 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327333 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327335 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327338 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327341 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327343 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327346 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327350 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327353 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327356 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:10.478553 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327358 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327361 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327363 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327366 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327369 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327371 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327375 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327378 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327381 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327384 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327386 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327389 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327392 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327394 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327808 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327814 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327817 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327819 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327823 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327830 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:10.479189 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327833 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327836 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327839 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327842 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327844 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327847 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327849 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327852 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327854 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327859 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327862 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327864 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327867 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327869 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327872 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327874 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327877 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327879 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327882 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327885 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:10.479873 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327887 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327890 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327892 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327896 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327900 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327903 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327905 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327908 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327911 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327913 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327916 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327920 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327923 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327926 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327928 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327932 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327934 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327936 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327939 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:10.480542 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327942 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327945 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327949 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327952 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327955 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327957 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327960 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327963 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327965 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327968 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327971 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327973 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327976 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327978 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327981 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327983 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327986 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327988 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327991 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327993 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:10.481287 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327996 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.327998 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328001 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328003 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328008 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328011 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328013 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328015 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328018 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328023 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328026 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328029 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328032 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328034 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328038 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328041 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328043 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328046 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328049 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328051 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:10.483013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328054 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:10.482816 ip-10-0-143-187 systemd[1]: Started Kubernetes Kubelet. Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328056 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328059 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328061 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328064 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328066 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328069 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328071 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328073 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328076 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328079 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328081 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328084 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328088 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328180 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328195 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328204 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328209 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328215 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328218 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 19:22:10.498194 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328222 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328227 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328230 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328235 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328238 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328242 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328246 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328250 2555 flags.go:64] FLAG: --cgroup-root="" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328253 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328257 2555 flags.go:64] FLAG: --client-ca-file="" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328259 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328262 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328267 2555 flags.go:64] FLAG: --cluster-domain="" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328270 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328273 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328276 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328279 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328283 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328286 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328289 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328293 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328296 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328299 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328302 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 19:22:10.499338 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328305 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328308 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328312 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328329 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328333 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328336 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328339 2555 flags.go:64] FLAG: --enable-server="true" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328343 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328348 2555 flags.go:64] FLAG: --event-burst="100" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328351 2555 flags.go:64] FLAG: --event-qps="50" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328354 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328357 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328361 2555 flags.go:64] FLAG: --eviction-hard="" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328364 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328369 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328373 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328376 2555 flags.go:64] FLAG: --eviction-soft="" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328379 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328382 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328385 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328388 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328391 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328394 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328397 2555 flags.go:64] FLAG: --feature-gates="" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328401 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 19:22:10.507101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328418 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328422 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328425 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328428 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328431 2555 flags.go:64] FLAG: --help="false" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328434 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-143-187.ec2.internal" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328438 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328441 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328444 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328447 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328451 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328455 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328458 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328461 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328464 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328469 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328472 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328475 2555 flags.go:64] FLAG: --kube-reserved="" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328478 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328480 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328484 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328488 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328491 2555 flags.go:64] FLAG: --lock-file="" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328494 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 19:22:10.508836 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328497 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328500 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328506 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328509 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328512 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328515 2555 flags.go:64] FLAG: --logging-format="text" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328518 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328521 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328525 2555 flags.go:64] FLAG: --manifest-url="" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328528 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328532 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328535 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328539 2555 flags.go:64] FLAG: --max-pods="110" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328542 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328545 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328548 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328551 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328555 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328558 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328562 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328571 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328574 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328577 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 19:22:10.509927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328580 2555 flags.go:64] FLAG: --pod-cidr="" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328584 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328591 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328593 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328597 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328600 2555 flags.go:64] FLAG: --port="10250" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328603 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328609 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d663c08b3a3a73ed" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328612 2555 flags.go:64] FLAG: --qos-reserved="" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328615 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328618 2555 flags.go:64] FLAG: --register-node="true" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328621 2555 flags.go:64] FLAG: --register-with-taints="" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328625 2555 flags.go:64] FLAG: --registry-burst="10" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328628 2555 flags.go:64] FLAG: --registry-qps="5" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328631 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328634 2555 flags.go:64] FLAG: --reserved-memory="" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328638 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328641 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328645 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328648 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328651 2555 flags.go:64] FLAG: --runonce="false" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328654 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328657 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328660 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328663 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 19:22:10.511064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328666 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328669 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328673 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328679 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328682 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328685 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328687 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328690 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328694 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328700 2555 flags.go:64] FLAG: --system-cgroups="" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328703 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328709 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328712 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328715 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328722 2555 flags.go:64] FLAG: --tls-min-version="" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328725 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328728 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328731 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328734 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328738 2555 flags.go:64] FLAG: --v="2" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328742 2555 flags.go:64] FLAG: --version="false" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328746 2555 flags.go:64] FLAG: --vmodule="" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328750 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.328753 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328872 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:10.512861 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328877 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328880 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328884 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328886 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328889 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328892 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328896 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328900 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328903 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328905 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328911 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328913 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328916 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328918 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328921 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328924 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328926 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328930 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328932 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328935 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:10.514218 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328938 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328942 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328944 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328947 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328949 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328952 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328955 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328957 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328960 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328963 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328965 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328968 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328971 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328974 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328976 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328979 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328982 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328984 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328987 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328989 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:10.515328 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328992 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328995 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.328998 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329001 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329003 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329006 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329008 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329011 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329014 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329017 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329019 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329022 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329025 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329029 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329032 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329034 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329037 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329039 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329042 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329044 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:10.516435 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329047 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329051 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329054 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329057 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329060 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329062 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329065 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329067 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329070 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329073 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329075 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329078 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329081 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329083 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329087 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329090 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329092 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329095 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329097 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:10.517321 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329100 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329102 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329105 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329108 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329111 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329113 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329119 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329122 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329125 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329128 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329131 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329134 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329137 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329139 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329142 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329144 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329147 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329150 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:10.518428 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.329152 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.329936 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.338328 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.338350 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.339254 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.339266 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339333 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339340 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339344 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339348 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339351 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339354 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339357 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339360 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:10.519306 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339363 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339366 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339369 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339371 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339374 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339377 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339380 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339383 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339385 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339388 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339391 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339393 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339396 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339399 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339422 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339426 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339428 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339431 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339434 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339437 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:10.520184 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339440 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339444 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339447 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339450 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339452 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339456 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339462 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339465 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339468 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339471 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339473 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339476 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339478 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339481 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339483 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339486 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339488 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339491 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339494 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:10.521265 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339497 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339499 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339502 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339504 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339507 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339509 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339512 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339518 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339520 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339523 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339526 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339529 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339532 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339535 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339537 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339540 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339543 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339548 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339552 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339556 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:10.522128 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339559 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339562 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339565 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339567 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339570 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339572 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339575 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339577 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339580 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339582 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339587 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339589 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339592 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339595 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339598 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339600 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339603 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339605 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339608 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339611 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:10.523009 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339614 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339616 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339619 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339622 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339624 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339627 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339629 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339632 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339636 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339639 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339641 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339643 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.339649 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339773 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339778 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:10.523884 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339781 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339784 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339787 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339789 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339792 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339794 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339797 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339802 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339804 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339808 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339812 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339815 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339818 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339820 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339823 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339825 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339828 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339832 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339835 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:10.524538 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339839 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339842 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339845 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339848 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339850 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339853 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339855 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339859 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339861 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339865 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339869 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339872 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339875 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339877 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339880 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339883 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339885 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339888 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339891 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:10.525415 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339894 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339898 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339900 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339902 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339905 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339907 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339910 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339913 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339915 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339918 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339920 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339924 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339927 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339929 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339932 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339935 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339937 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339940 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339942 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339944 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:10.526281 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339947 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339950 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339953 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339955 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339958 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339960 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339963 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339965 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339968 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339970 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339973 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339975 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339978 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339985 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339987 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339990 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339992 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339995 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.339997 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340000 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:10.527180 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340002 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340004 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340007 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340011 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340013 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340016 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340018 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340021 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340024 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340026 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340028 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340031 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340033 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340036 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340039 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340041 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340044 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340046 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:10.530683 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:10.340049 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.340054 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.340230 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.343243 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.344923 2555 server.go:1019] "Starting client certificate rotation" Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.345038 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.345091 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.348679 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.350577 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.368693 2555 log.go:25] "Validated CRI v1 runtime API" Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.371165 2555 log.go:25] "Validated CRI v1 image API" Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.372135 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 19:22:10.595535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.374983 2555 fs.go:135] Filesystem UUIDs: map[75272279-e022-423d-8cc4-121b6c2cf687:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 89d72872-ce97-4547-bb21-cffbefe74dce:/dev/nvme0n1p4] Jul 20 19:22:10.602427 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.375000 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 19:22:10.602427 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.379382 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.380653 2555 manager.go:216] Machine: {Timestamp:2026-07-20 19:22:10.378989362 +0000 UTC m=+0.372180508 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095196 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23d0f13b4b27bdc6c75e37fd96d2f7 SystemUUID:ec23d0f1-3b4b-27bd-c6c7-5e37fd96d2f7 BootID:aae513c3-e259-447b-a23d-2e80f512e456 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:96:5f:d6:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:96:5f:d6:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:89:5c:91:e8:5c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.380769 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.380908 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.385110 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.385160 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.385947 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.385957 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.385964 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.386852 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.388218 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.391637 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.391787 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.391821 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.391838 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.391855 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.391865 2555 kubelet.go:398] "Adding apiserver pod source" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.391880 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 19:22:10.603089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.392261 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.392279 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.396045 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.405638 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.405668 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.426041 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9r7c" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.433908 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9r7c" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.471444 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.472747 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476229 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476249 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476259 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476268 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476281 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476291 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476303 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476311 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476321 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476330 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476343 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.476354 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.477184 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.477194 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.481517 2555 server.go:1268] "Started kubelet" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.481611 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.481727 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.481849 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.483178 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.483651 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.488944 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.495538 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.495586 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.495690 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.496400 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.496432 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.496607 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.496613 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.496613 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.497044 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.497059 2555 factory.go:55] Registering systemd factory Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.497068 2555 factory.go:223] Registration of the systemd container factory successfully Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.497425 2555 factory.go:153] Registering CRI-O factory Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.497441 2555 factory.go:223] Registration of the crio container factory successfully Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.497465 2555 factory.go:103] Registering Raw factory Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.497477 2555 manager.go:1196] Started watching for new ooms in manager Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.497858 2555 manager.go:349] Starting recovery of all containers Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.504868 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.512467 2555 manager.go:354] Recovery completed Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.518777 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:10.603986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.545723 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.545758 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.545771 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.546352 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.546362 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.546368 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.546393 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.546520 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.547200 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.547227 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.547238 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.548052 2555 policy_none.go:49] "None policy: Start" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.548066 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.548076 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.549353 2555 policy_none.go:47] "Start" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.550027 2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-187.ec2.internal\" not found" node="ip-10-0-143-187.ec2.internal" Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.551786 2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-187.ec2.internal" not found Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.567495 2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-187.ec2.internal" not found Jul 20 19:22:10.606056 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.596753 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found" Jul 20 19:22:10.704612 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.625919 2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-187.ec2.internal" not found Jul 20 19:22:10.704612 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.649272 2555 manager.go:337] "Starting Device Plugin manager" Jul 20 19:22:10.704612 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.649303 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 19:22:10.704612 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.649315 2555 server.go:87] "Starting device plugin registration server" Jul 20 19:22:10.704612 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.649633 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 19:22:10.704612 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.649646 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 19:22:10.704612 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.649858 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 19:22:10.704612 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.649940 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 19:22:10.704612 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.649948 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 19:22:10.704612 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.650314 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 19:22:10.704612 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.650365 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-187.ec2.internal\" not found" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.751296 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.752481 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.752523 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.752538 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.752570 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-187.ec2.internal" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.753153 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.753204 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.753228 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.753269 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.755752 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.762672 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-187.ec2.internal" Jul 20 19:22:10.795707 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.762691 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-187.ec2.internal\": node \"ip-10-0-143-187.ec2.internal\" not found" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:10.807494 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.853768 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal"] Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.853854 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.855140 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.855180 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.855193 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.857141 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.857320 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.857355 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.858030 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.858058 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.858060 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.858108 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.858120 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.858076 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.859577 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.859601 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.860385 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.860436 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:10.860456 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:12.013482 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:12.011017 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-187.ec2.internal\" not found" node="ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.015701 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:12.015024 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-187.ec2.internal\" not found" node="ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.105890 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:12.042997 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found" Jul 20 19:22:12.105890 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.043066 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.105890 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.043093 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.105890 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.043111 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/055b2da4f7f1fd6f00b0fe6f11d1c89c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-187.ec2.internal\" (UID: \"055b2da4f7f1fd6f00b0fe6f11d1c89c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.202029 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:12.143694 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found" Jul 20 19:22:12.202029 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.143761 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.202029 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.143787 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.202029 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.143805 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/055b2da4f7f1fd6f00b0fe6f11d1c89c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-187.ec2.internal\" (UID: \"055b2da4f7f1fd6f00b0fe6f11d1c89c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.202029 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.143832 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/055b2da4f7f1fd6f00b0fe6f11d1c89c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-187.ec2.internal\" (UID: \"055b2da4f7f1fd6f00b0fe6f11d1c89c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.202029 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.143866 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.202029 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.143850 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.303737 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:12.244090 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found" Jul 20 19:22:12.372856 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.316321 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.372856 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.318463 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.372856 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:12.345618 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found" Jul 20 19:22:12.463098 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:12.453361 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found" Jul 20 19:22:12.472143 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.470523 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 19:22:12.472143 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.470694 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:22:12.472143 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.470712 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:22:12.554262 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:12.554000 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found" Jul 20 19:22:12.636004 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.599180 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 19:17:11 +0000 UTC" deadline="2028-02-08 01:15:48.540824051 +0000 UTC" Jul 20 19:22:12.636004 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.599235 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13613h53m35.94159215s" Jul 20 19:22:12.638843 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.638475 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:12.716473 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.680565 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:12.723178 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.722753 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.787549 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.736653 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 19:22:12.787549 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.737729 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Jul 20 19:22:12.787549 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:12.744530 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 19:22:13.060224 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:13.060182 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1398e302ef95386d2a9d899ad51d74f.slice/crio-1de92ee533ed6dec6d1d3892ab558afaa0553958630e2155f69e59a18bdf99fc WatchSource:0}: Error finding container 1de92ee533ed6dec6d1d3892ab558afaa0553958630e2155f69e59a18bdf99fc: Status 404 returned error can't find the container with id 1de92ee533ed6dec6d1d3892ab558afaa0553958630e2155f69e59a18bdf99fc Jul 20 19:22:13.060522 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:13.060498 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055b2da4f7f1fd6f00b0fe6f11d1c89c.slice/crio-b5bb8428da357907437c236d01b637f510ba95e0171c4256e403c1f21bf0faef WatchSource:0}: Error finding container b5bb8428da357907437c236d01b637f510ba95e0171c4256e403c1f21bf0faef: Status 404 returned error can't find the container with id b5bb8428da357907437c236d01b637f510ba95e0171c4256e403c1f21bf0faef Jul 20 19:22:13.065806 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.065781 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:22:13.518831 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.518788 2555 apiserver.go:52] "Watching apiserver" Jul 20 19:22:13.525845 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.525810 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 19:22:13.528159 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.528121 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-82vjv","openshift-network-operator/iptables-alerter-sf26w","openshift-ovn-kubernetes/ovnkube-node-pcpqx","kube-system/global-pull-secret-syncer-9rmms","kube-system/konnectivity-agent-j22wh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6","openshift-cluster-node-tuning-operator/tuned-r5vqz","openshift-image-registry/node-ca-982g9","openshift-multus/multus-tl6sb","openshift-multus/network-metrics-daemon-qdtm4","openshift-network-diagnostics/network-check-target-97m6z","kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal","openshift-dns/node-resolver-t5n9q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"] Jul 20 19:22:13.529788 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.529763 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:13.531157 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.531133 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sf26w" Jul 20 19:22:13.532421 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.532377 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5n9q" Jul 20 19:22:13.532993 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.532970 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 19:22:13.533138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.533116 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 19:22:13.533210 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.533118 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z9htf\"" Jul 20 19:22:13.533501 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.533481 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 19:22:13.533602 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.533540 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:22:13.533602 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.533548 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 19:22:13.533816 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.533799 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9nbz6\"" Jul 20 19:22:13.533901 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.533861 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.535096 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.535079 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-csth2\"" Jul 20 19:22:13.535308 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.535281 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 19:22:13.535580 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.535532 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 19:22:13.535755 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.535735 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:13.535843 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:13.535815 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:13.535956 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.535936 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wfwhl\"" Jul 20 19:22:13.536066 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.536047 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:22:13.536534 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.536228 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 19:22:13.537165 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.537143 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.539474 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.539171 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.540932 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.540908 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wg8m4\"" Jul 20 19:22:13.541049 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.541032 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 19:22:13.541115 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.541044 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 19:22:13.541233 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.541213 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 19:22:13.541634 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.541555 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 19:22:13.541963 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.541843 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 19:22:13.542103 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.542083 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 19:22:13.542204 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.542134 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 19:22:13.542204 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.542154 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-982g9" Jul 20 19:22:13.542204 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.542160 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 19:22:13.542641 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.542615 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m9td5\"" Jul 20 19:22:13.543658 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.543641 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.544894 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.544712 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 19:22:13.544894 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.544736 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 19:22:13.544894 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.544895 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 19:22:13.545086 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.544955 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wvtpr\"" Jul 20 19:22:13.545225 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.545211 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:13.545312 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:13.545271 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:13.545867 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.545847 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 19:22:13.546443 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.546351 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pnfwh\"" Jul 20 19:22:13.546731 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.546704 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:13.546822 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:13.546777 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:13.548289 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.548261 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.550641 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.550614 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 19:22:13.550743 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.550728 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 19:22:13.550912 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.550886 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 19:22:13.550912 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.550900 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 19:22:13.551035 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.550979 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cn7w2\"" Jul 20 19:22:13.551232 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.551211 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 19:22:13.551337 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.551321 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 19:22:13.622684 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.622654 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 19:22:13.623427 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.623401 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 19:22:13.630661 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.630639 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:13.632445 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.632419 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 19:22:13.662424 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.662386 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d4z5b" Jul 20 19:22:13.671775 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.671738 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d4z5b" Jul 20 19:22:13.678660 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34ef2afb-6a97-4c52-9fc5-f7814f417a54-agent-certs\") pod \"konnectivity-agent-j22wh\" (UID: \"34ef2afb-6a97-4c52-9fc5-f7814f417a54\") " pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:13.678839 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678666 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-os-release\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.678839 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678697 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-sys\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.678839 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678724 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzzvf\" (UniqueName: \"kubernetes.io/projected/3b6c6f66-551a-4197-804f-77db8a93bde9-kube-api-access-rzzvf\") pod \"node-ca-982g9\" (UID: \"3b6c6f66-551a-4197-804f-77db8a93bde9\") " pod="openshift-image-registry/node-ca-982g9" Jul 20 19:22:13.678839 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678765 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-run-netns\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.678839 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678805 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/454112e2-4faf-4b41-b786-441c631e8530-iptables-alerter-script\") pod \"iptables-alerter-sf26w\" (UID: \"454112e2-4faf-4b41-b786-441c631e8530\") " pod="openshift-network-operator/iptables-alerter-sf26w" Jul 20 19:22:13.678839 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678834 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-var-lib-kubelet\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.679138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678860 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs2p4\" (UniqueName: \"kubernetes.io/projected/69985c88-2614-4138-92de-0e2b06c3711d-kube-api-access-zs2p4\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.679138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678886 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-os-release\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.679138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678910 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-var-lib-openvswitch\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.679138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678932 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-cni-dir\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.679138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-conf-dir\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.679138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.678979 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-run-multus-certs\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.679138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679004 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/454112e2-4faf-4b41-b786-441c631e8530-host-slash\") pod \"iptables-alerter-sf26w\" (UID: \"454112e2-4faf-4b41-b786-441c631e8530\") " pod="openshift-network-operator/iptables-alerter-sf26w" Jul 20 19:22:13.679138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679026 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-sysctl-conf\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.679138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679052 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c06ba15-50d4-43eb-ae03-7300a05215dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.679138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679075 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.679138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679099 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-ovnkube-config\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679143 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-ovn-node-metrics-cert\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679199 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caf8094f-b9d0-45bb-ac87-58ba04fabf80-cni-binary-copy\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679238 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvc42\" (UniqueName: \"kubernetes.io/projected/2c06ba15-50d4-43eb-ae03-7300a05215dc-kube-api-access-nvc42\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679307 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-ovnkube-script-lib\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679342 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-device-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679365 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b6c6f66-551a-4197-804f-77db8a93bde9-serviceca\") pod \"node-ca-982g9\" (UID: \"3b6c6f66-551a-4197-804f-77db8a93bde9\") " pod="openshift-image-registry/node-ca-982g9" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679400 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-var-lib-cni-multus\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679427 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5qxp\" (UniqueName: \"kubernetes.io/projected/b0449b8a-9354-485d-9abb-18111650b435-kube-api-access-w5qxp\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679451 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679474 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-registration-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679499 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-etc-kubernetes\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679542 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679574 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-sysconfig\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679608 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-lib-modules\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.679644 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679644 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-cni-bin\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679670 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-system-cni-dir\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679711 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-socket-dir-parent\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679736 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-env-overrides\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-cnibin\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679806 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-var-lib-kubelet\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679832 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-daemon-config\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679853 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dht55\" (UniqueName: \"kubernetes.io/projected/7cea5b32-464e-4339-b801-21ec0cc7358c-kube-api-access-dht55\") pod \"node-resolver-t5n9q\" (UID: \"7cea5b32-464e-4339-b801-21ec0cc7358c\") " pod="openshift-dns/node-resolver-t5n9q" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679876 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-cnibin\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679896 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-etc-openvswitch\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679920 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.679998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34ef2afb-6a97-4c52-9fc5-f7814f417a54-konnectivity-ca\") pod \"konnectivity-agent-j22wh\" (UID: \"34ef2afb-6a97-4c52-9fc5-f7814f417a54\") " pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680143 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m9zl\" (UniqueName: \"kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl\") pod \"network-check-target-97m6z\" (UID: \"94aaaffa-3620-4a4c-8987-353ba4707936\") " pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680173 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-run-openvswitch\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680196 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-var-lib-cni-bin\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680218 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-host\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.680286 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680243 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-run-netns\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680266 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-run-ovn\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-log-socket\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680336 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-sys-fs\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b6c6f66-551a-4197-804f-77db8a93bde9-host\") pod \"node-ca-982g9\" (UID: \"3b6c6f66-551a-4197-804f-77db8a93bde9\") " pod="openshift-image-registry/node-ca-982g9" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680376 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-hostroot\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680408 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-run\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680438 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c06ba15-50d4-43eb-ae03-7300a05215dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680463 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-systemd-units\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680485 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-run-k8s-cni-cncf-io\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680508 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69985c88-2614-4138-92de-0e2b06c3711d-tmp\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680531 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-run-systemd\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680581 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-node-log\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680618 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72wkn\" (UniqueName: \"kubernetes.io/projected/27f969ba-1c86-44a6-9f16-d84af67620b1-kube-api-access-72wkn\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680662 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9f1e451-881f-4c9e-a681-a7993f2ce583-kubelet-config\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680696 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9f1e451-881f-4c9e-a681-a7993f2ce583-dbus\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:13.681048 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680728 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7cea5b32-464e-4339-b801-21ec0cc7358c-hosts-file\") pod \"node-resolver-t5n9q\" (UID: \"7cea5b32-464e-4339-b801-21ec0cc7358c\") " pod="openshift-dns/node-resolver-t5n9q" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680793 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-modprobe-d\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680818 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-kubernetes\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680849 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-system-cni-dir\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680874 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-cni-netd\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680909 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfl72\" (UniqueName: \"kubernetes.io/projected/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-kube-api-access-nfl72\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680937 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680971 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jv5\" (UniqueName: \"kubernetes.io/projected/caf8094f-b9d0-45bb-ac87-58ba04fabf80-kube-api-access-w5jv5\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.680998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2t7c\" (UniqueName: \"kubernetes.io/projected/454112e2-4faf-4b41-b786-441c631e8530-kube-api-access-h2t7c\") pod \"iptables-alerter-sf26w\" (UID: \"454112e2-4faf-4b41-b786-441c631e8530\") " pod="openshift-network-operator/iptables-alerter-sf26w" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.681026 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cea5b32-464e-4339-b801-21ec0cc7358c-tmp-dir\") pod \"node-resolver-t5n9q\" (UID: \"7cea5b32-464e-4339-b801-21ec0cc7358c\") " pod="openshift-dns/node-resolver-t5n9q" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.681052 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-slash\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.681092 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-socket-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.681118 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-sysctl-d\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.681139 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-systemd\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.681164 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69985c88-2614-4138-92de-0e2b06c3711d-etc-tuned\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.681871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.681188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c06ba15-50d4-43eb-ae03-7300a05215dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.682565 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.681213 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-kubelet\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.682565 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.681239 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.766748 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.766711 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:13.782528 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782439 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34ef2afb-6a97-4c52-9fc5-f7814f417a54-konnectivity-ca\") pod \"konnectivity-agent-j22wh\" (UID: \"34ef2afb-6a97-4c52-9fc5-f7814f417a54\") " pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:13.782528 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782490 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m9zl\" (UniqueName: \"kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl\") pod \"network-check-target-97m6z\" (UID: \"94aaaffa-3620-4a4c-8987-353ba4707936\") " pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:13.782528 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782515 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-run-openvswitch\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782582 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-var-lib-cni-bin\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782604 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-host\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782626 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-run-netns\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782649 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-run-ovn\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782673 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-log-socket\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782694 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-sys-fs\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782716 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b6c6f66-551a-4197-804f-77db8a93bde9-host\") pod \"node-ca-982g9\" (UID: \"3b6c6f66-551a-4197-804f-77db8a93bde9\") " pod="openshift-image-registry/node-ca-982g9" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782738 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-hostroot\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-run\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782784 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c06ba15-50d4-43eb-ae03-7300a05215dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782791 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-run-openvswitch\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.782808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782812 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-systemd-units\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782843 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-run-k8s-cni-cncf-io\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782866 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69985c88-2614-4138-92de-0e2b06c3711d-tmp\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782889 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-run-systemd\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782913 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-node-log\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782939 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72wkn\" (UniqueName: \"kubernetes.io/projected/27f969ba-1c86-44a6-9f16-d84af67620b1-kube-api-access-72wkn\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782964 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9f1e451-881f-4c9e-a681-a7993f2ce583-kubelet-config\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.782989 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9f1e451-881f-4c9e-a681-a7993f2ce583-dbus\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783014 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783048 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7cea5b32-464e-4339-b801-21ec0cc7358c-hosts-file\") pod \"node-resolver-t5n9q\" (UID: \"7cea5b32-464e-4339-b801-21ec0cc7358c\") " pod="openshift-dns/node-resolver-t5n9q" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783073 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-modprobe-d\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783079 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-var-lib-cni-bin\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783103 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-kubernetes\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783132 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-system-cni-dir\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783140 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-systemd-units\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783158 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-cni-netd\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783183 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfl72\" (UniqueName: \"kubernetes.io/projected/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-kube-api-access-nfl72\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.783398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783199 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-host\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783244 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-run-netns\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783276 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783282 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-run-systemd\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783291 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-run-ovn\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783366 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-run-k8s-cni-cncf-io\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783370 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-sys-fs\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783409 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783436 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34ef2afb-6a97-4c52-9fc5-f7814f417a54-konnectivity-ca\") pod \"konnectivity-agent-j22wh\" (UID: \"34ef2afb-6a97-4c52-9fc5-f7814f417a54\") " pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783450 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9f1e451-881f-4c9e-a681-a7993f2ce583-dbus\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783460 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-run\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783470 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7cea5b32-464e-4339-b801-21ec0cc7358c-hosts-file\") pod \"node-resolver-t5n9q\" (UID: \"7cea5b32-464e-4339-b801-21ec0cc7358c\") " pod="openshift-dns/node-resolver-t5n9q" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783497 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jv5\" (UniqueName: \"kubernetes.io/projected/caf8094f-b9d0-45bb-ac87-58ba04fabf80-kube-api-access-w5jv5\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783526 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-system-cni-dir\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783528 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2t7c\" (UniqueName: \"kubernetes.io/projected/454112e2-4faf-4b41-b786-441c631e8530-kube-api-access-h2t7c\") pod \"iptables-alerter-sf26w\" (UID: \"454112e2-4faf-4b41-b786-441c631e8530\") " pod="openshift-network-operator/iptables-alerter-sf26w" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783559 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-modprobe-d\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783583 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cea5b32-464e-4339-b801-21ec0cc7358c-tmp-dir\") pod \"node-resolver-t5n9q\" (UID: \"7cea5b32-464e-4339-b801-21ec0cc7358c\") " pod="openshift-dns/node-resolver-t5n9q" Jul 20 19:22:13.784190 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783610 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-kubernetes\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783608 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-slash\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783640 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-socket-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783647 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-log-socket\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783665 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-sysctl-d\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783684 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-cni-netd\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783682 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783693 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-systemd\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783717 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69985c88-2614-4138-92de-0e2b06c3711d-etc-tuned\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783743 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c06ba15-50d4-43eb-ae03-7300a05215dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783779 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-kubelet\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783805 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783837 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34ef2afb-6a97-4c52-9fc5-f7814f417a54-agent-certs\") pod \"konnectivity-agent-j22wh\" (UID: \"34ef2afb-6a97-4c52-9fc5-f7814f417a54\") " pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783862 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-os-release\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783894 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-sys\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783906 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-systemd\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783920 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzzvf\" (UniqueName: \"kubernetes.io/projected/3b6c6f66-551a-4197-804f-77db8a93bde9-kube-api-access-rzzvf\") pod \"node-ca-982g9\" (UID: \"3b6c6f66-551a-4197-804f-77db8a93bde9\") " pod="openshift-image-registry/node-ca-982g9" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783408 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b6c6f66-551a-4197-804f-77db8a93bde9-host\") pod \"node-ca-982g9\" (UID: \"3b6c6f66-551a-4197-804f-77db8a93bde9\") " pod="openshift-image-registry/node-ca-982g9" Jul 20 19:22:13.785047 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783949 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-run-netns\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783960 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9f1e451-881f-4c9e-a681-a7993f2ce583-kubelet-config\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783996 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/454112e2-4faf-4b41-b786-441c631e8530-iptables-alerter-script\") pod \"iptables-alerter-sf26w\" (UID: \"454112e2-4faf-4b41-b786-441c631e8530\") " pod="openshift-network-operator/iptables-alerter-sf26w" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784003 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c06ba15-50d4-43eb-ae03-7300a05215dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784024 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-var-lib-kubelet\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784052 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs2p4\" (UniqueName: \"kubernetes.io/projected/69985c88-2614-4138-92de-0e2b06c3711d-kube-api-access-zs2p4\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784082 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-os-release\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784108 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-var-lib-openvswitch\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784113 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-socket-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784133 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-cni-dir\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784158 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-conf-dir\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784168 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-slash\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784187 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-run-multus-certs\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784197 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cea5b32-464e-4339-b801-21ec0cc7358c-tmp-dir\") pod \"node-resolver-t5n9q\" (UID: \"7cea5b32-464e-4339-b801-21ec0cc7358c\") " pod="openshift-dns/node-resolver-t5n9q" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784214 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/454112e2-4faf-4b41-b786-441c631e8530-host-slash\") pod \"iptables-alerter-sf26w\" (UID: \"454112e2-4faf-4b41-b786-441c631e8530\") " pod="openshift-network-operator/iptables-alerter-sf26w" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784243 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-sysctl-conf\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784252 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-sysctl-d\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.785927 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c06ba15-50d4-43eb-ae03-7300a05215dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.783496 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-hostroot\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784320 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784331 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-os-release\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784364 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-ovnkube-config\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784377 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-var-lib-openvswitch\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784395 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-ovn-node-metrics-cert\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784445 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caf8094f-b9d0-45bb-ac87-58ba04fabf80-cni-binary-copy\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784463 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-cni-dir\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvc42\" (UniqueName: \"kubernetes.io/projected/2c06ba15-50d4-43eb-ae03-7300a05215dc-kube-api-access-nvc42\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784510 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-conf-dir\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-ovnkube-script-lib\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784548 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-os-release\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784553 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-device-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784555 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-run-multus-certs\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784587 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b6c6f66-551a-4197-804f-77db8a93bde9-serviceca\") pod \"node-ca-982g9\" (UID: \"3b6c6f66-551a-4197-804f-77db8a93bde9\") " pod="openshift-image-registry/node-ca-982g9" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784613 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-var-lib-cni-multus\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.786749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784619 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-var-lib-kubelet\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784640 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5qxp\" (UniqueName: \"kubernetes.io/projected/b0449b8a-9354-485d-9abb-18111650b435-kube-api-access-w5qxp\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784663 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/454112e2-4faf-4b41-b786-441c631e8530-host-slash\") pod \"iptables-alerter-sf26w\" (UID: \"454112e2-4faf-4b41-b786-441c631e8530\") " pod="openshift-network-operator/iptables-alerter-sf26w" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784668 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784683 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-sysctl-conf\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784696 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-registration-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784736 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-etc-kubernetes\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784791 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784818 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-sysconfig\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784846 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/454112e2-4faf-4b41-b786-441c631e8530-iptables-alerter-script\") pod \"iptables-alerter-sf26w\" (UID: \"454112e2-4faf-4b41-b786-441c631e8530\") " pod="openshift-network-operator/iptables-alerter-sf26w" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784853 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-lib-modules\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784902 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-cni-bin\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784928 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-system-cni-dir\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784933 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-lib-modules\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784954 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-socket-dir-parent\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784971 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-device-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784980 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-env-overrides\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.787593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785005 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-cnibin\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785029 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-var-lib-kubelet\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785053 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-daemon-config\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785083 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dht55\" (UniqueName: \"kubernetes.io/projected/7cea5b32-464e-4339-b801-21ec0cc7358c-kube-api-access-dht55\") pod \"node-resolver-t5n9q\" (UID: \"7cea5b32-464e-4339-b801-21ec0cc7358c\") " pod="openshift-dns/node-resolver-t5n9q" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785152 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c06ba15-50d4-43eb-ae03-7300a05215dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.784272 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-sys\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785245 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785311 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-cnibin\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785324 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-cni-bin\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-etc-openvswitch\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785372 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-system-cni-dir\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785378 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785412 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b6c6f66-551a-4197-804f-77db8a93bde9-serviceca\") pod \"node-ca-982g9\" (UID: \"3b6c6f66-551a-4197-804f-77db8a93bde9\") " pod="openshift-image-registry/node-ca-982g9" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785475 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785693 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caf8094f-b9d0-45bb-ac87-58ba04fabf80-cni-binary-copy\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785701 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-var-lib-cni-multus\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785801 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-env-overrides\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785856 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-cnibin\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.788497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785893 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-var-lib-kubelet\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:13.785947 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:13.786051 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret podName:b9f1e451-881f-4c9e-a681-a7993f2ce583 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:14.286010754 +0000 UTC m=+3.153312567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret") pod "global-pull-secret-syncer-9rmms" (UID: "b9f1e451-881f-4c9e-a681-a7993f2ce583") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786250 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27f969ba-1c86-44a6-9f16-d84af67620b1-registration-dir\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786269 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-ovnkube-script-lib\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786313 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-etc-kubernetes\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:13.786390 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786394 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-etc-openvswitch\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786273 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-daemon-config\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:13.786446 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs podName:b0449b8a-9354-485d-9abb-18111650b435 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:14.286424957 +0000 UTC m=+3.153726735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs") pod "network-metrics-daemon-qdtm4" (UID: "b0449b8a-9354-485d-9abb-18111650b435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786463 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-host-run-netns\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.785421 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/caf8094f-b9d0-45bb-ac87-58ba04fabf80-multus-socket-dir-parent\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786492 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69985c88-2614-4138-92de-0e2b06c3711d-etc-sysconfig\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786521 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-kubelet\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786536 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c06ba15-50d4-43eb-ae03-7300a05215dc-cnibin\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786569 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786588 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-node-log\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.789314 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786705 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c06ba15-50d4-43eb-ae03-7300a05215dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.789918 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.786959 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-ovnkube-config\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.789918 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.789368 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69985c88-2614-4138-92de-0e2b06c3711d-tmp\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.789918 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.789419 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-ovn-node-metrics-cert\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.789918 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.789578 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34ef2afb-6a97-4c52-9fc5-f7814f417a54-agent-certs\") pod \"konnectivity-agent-j22wh\" (UID: \"34ef2afb-6a97-4c52-9fc5-f7814f417a54\") " pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:13.790115 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:13.790058 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:13.790115 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:13.790093 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:13.790115 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:13.790107 2555 projected.go:196] Error preparing data for projected volume kube-api-access-8m9zl for pod openshift-network-diagnostics/network-check-target-97m6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:13.790254 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:13.790197 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl podName:94aaaffa-3620-4a4c-8987-353ba4707936 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:14.29017694 +0000 UTC m=+3.157478714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8m9zl" (UniqueName: "kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl") pod "network-check-target-97m6z" (UID: "94aaaffa-3620-4a4c-8987-353ba4707936") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:13.792003 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.791978 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69985c88-2614-4138-92de-0e2b06c3711d-etc-tuned\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.795128 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.795096 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dht55\" (UniqueName: \"kubernetes.io/projected/7cea5b32-464e-4339-b801-21ec0cc7358c-kube-api-access-dht55\") pod \"node-resolver-t5n9q\" (UID: \"7cea5b32-464e-4339-b801-21ec0cc7358c\") " pod="openshift-dns/node-resolver-t5n9q" Jul 20 19:22:13.799979 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.799954 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvc42\" (UniqueName: \"kubernetes.io/projected/2c06ba15-50d4-43eb-ae03-7300a05215dc-kube-api-access-nvc42\") pod \"multus-additional-cni-plugins-82vjv\" (UID: \"2c06ba15-50d4-43eb-ae03-7300a05215dc\") " pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.800089 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.799955 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jv5\" (UniqueName: \"kubernetes.io/projected/caf8094f-b9d0-45bb-ac87-58ba04fabf80-kube-api-access-w5jv5\") pod \"multus-tl6sb\" (UID: \"caf8094f-b9d0-45bb-ac87-58ba04fabf80\") " pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.800593 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.800543 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs2p4\" (UniqueName: \"kubernetes.io/projected/69985c88-2614-4138-92de-0e2b06c3711d-kube-api-access-zs2p4\") pod \"tuned-r5vqz\" (UID: \"69985c88-2614-4138-92de-0e2b06c3711d\") " pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.801013 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.800705 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzzvf\" (UniqueName: \"kubernetes.io/projected/3b6c6f66-551a-4197-804f-77db8a93bde9-kube-api-access-rzzvf\") pod \"node-ca-982g9\" (UID: \"3b6c6f66-551a-4197-804f-77db8a93bde9\") " pod="openshift-image-registry/node-ca-982g9" Jul 20 19:22:13.801013 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.800984 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72wkn\" (UniqueName: \"kubernetes.io/projected/27f969ba-1c86-44a6-9f16-d84af67620b1-kube-api-access-72wkn\") pod \"aws-ebs-csi-driver-node-cf6q6\" (UID: \"27f969ba-1c86-44a6-9f16-d84af67620b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.801638 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.801609 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfl72\" (UniqueName: \"kubernetes.io/projected/ba4a2b0a-dbc8-47b5-8597-804413ead0ee-kube-api-access-nfl72\") pod \"ovnkube-node-pcpqx\" (UID: \"ba4a2b0a-dbc8-47b5-8597-804413ead0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.802031 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.802006 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2t7c\" (UniqueName: \"kubernetes.io/projected/454112e2-4faf-4b41-b786-441c631e8530-kube-api-access-h2t7c\") pod \"iptables-alerter-sf26w\" (UID: \"454112e2-4faf-4b41-b786-441c631e8530\") " pod="openshift-network-operator/iptables-alerter-sf26w" Jul 20 19:22:13.803389 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.803363 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5qxp\" (UniqueName: \"kubernetes.io/projected/b0449b8a-9354-485d-9abb-18111650b435-kube-api-access-w5qxp\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:13.843072 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.843023 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:13.851622 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.851587 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sf26w" Jul 20 19:22:13.855285 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:13.855260 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ef2afb_6a97_4c52_9fc5_f7814f417a54.slice/crio-ddd241bb0684426289c137d05c6f37fc65b4ba3ab92cbac528b31fb8c72910b6 WatchSource:0}: Error finding container ddd241bb0684426289c137d05c6f37fc65b4ba3ab92cbac528b31fb8c72910b6: Status 404 returned error can't find the container with id ddd241bb0684426289c137d05c6f37fc65b4ba3ab92cbac528b31fb8c72910b6 Jul 20 19:22:13.861144 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.861117 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5n9q" Jul 20 19:22:13.864343 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:13.864311 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454112e2_4faf_4b41_b786_441c631e8530.slice/crio-ac3b312cf319fdc949019a6b5dff238637e2e14df86c60b916c46cfc3d659fda WatchSource:0}: Error finding container ac3b312cf319fdc949019a6b5dff238637e2e14df86c60b916c46cfc3d659fda: Status 404 returned error can't find the container with id ac3b312cf319fdc949019a6b5dff238637e2e14df86c60b916c46cfc3d659fda Jul 20 19:22:13.866097 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.866070 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" Jul 20 19:22:13.871275 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:13.871244 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cea5b32_464e_4339_b801_21ec0cc7358c.slice/crio-ea16556f44329efcb9cfb86ed4c4c99cb28bcff958b5da92ffa3693cc3aba62f WatchSource:0}: Error finding container ea16556f44329efcb9cfb86ed4c4c99cb28bcff958b5da92ffa3693cc3aba62f: Status 404 returned error can't find the container with id ea16556f44329efcb9cfb86ed4c4c99cb28bcff958b5da92ffa3693cc3aba62f Jul 20 19:22:13.872799 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.872763 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" Jul 20 19:22:13.877087 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:13.877038 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69985c88_2614_4138_92de_0e2b06c3711d.slice/crio-d1f3b935b9f90d79defec6b48eae48783e48a3f5d629d6c410a6e1de59f641a2 WatchSource:0}: Error finding container d1f3b935b9f90d79defec6b48eae48783e48a3f5d629d6c410a6e1de59f641a2: Status 404 returned error can't find the container with id d1f3b935b9f90d79defec6b48eae48783e48a3f5d629d6c410a6e1de59f641a2 Jul 20 19:22:13.880973 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.880760 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-82vjv" Jul 20 19:22:13.884065 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:13.884031 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f969ba_1c86_44a6_9f16_d84af67620b1.slice/crio-9c879606b191fc343fa264854f9048c821531678c128804416fd62f6a982a782 WatchSource:0}: Error finding container 9c879606b191fc343fa264854f9048c821531678c128804416fd62f6a982a782: Status 404 returned error can't find the container with id 9c879606b191fc343fa264854f9048c821531678c128804416fd62f6a982a782 Jul 20 19:22:13.886349 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.886229 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" event={"ID":"69985c88-2614-4138-92de-0e2b06c3711d","Type":"ContainerStarted","Data":"d1f3b935b9f90d79defec6b48eae48783e48a3f5d629d6c410a6e1de59f641a2"} Jul 20 19:22:13.886941 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.886704 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-982g9" Jul 20 19:22:13.887821 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.887668 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5n9q" event={"ID":"7cea5b32-464e-4339-b801-21ec0cc7358c","Type":"ContainerStarted","Data":"ea16556f44329efcb9cfb86ed4c4c99cb28bcff958b5da92ffa3693cc3aba62f"} Jul 20 19:22:13.890368 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.890337 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sf26w" event={"ID":"454112e2-4faf-4b41-b786-441c631e8530","Type":"ContainerStarted","Data":"ac3b312cf319fdc949019a6b5dff238637e2e14df86c60b916c46cfc3d659fda"} Jul 20 19:22:13.892072 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.892031 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j22wh" event={"ID":"34ef2afb-6a97-4c52-9fc5-f7814f417a54","Type":"ContainerStarted","Data":"ddd241bb0684426289c137d05c6f37fc65b4ba3ab92cbac528b31fb8c72910b6"} Jul 20 19:22:13.892178 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:13.892104 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c06ba15_50d4_43eb_ae03_7300a05215dc.slice/crio-d6dc6d19d728b7b116fd04ed23f11c83867f0d93ec8753e407f9fabcb5ebd475 WatchSource:0}: Error finding container d6dc6d19d728b7b116fd04ed23f11c83867f0d93ec8753e407f9fabcb5ebd475: Status 404 returned error can't find the container with id d6dc6d19d728b7b116fd04ed23f11c83867f0d93ec8753e407f9fabcb5ebd475 Jul 20 19:22:13.893898 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.893866 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" event={"ID":"d1398e302ef95386d2a9d899ad51d74f","Type":"ContainerStarted","Data":"1de92ee533ed6dec6d1d3892ab558afaa0553958630e2155f69e59a18bdf99fc"} Jul 20 19:22:13.894240 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.894105 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tl6sb" Jul 20 19:22:13.896035 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.895968 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" event={"ID":"055b2da4f7f1fd6f00b0fe6f11d1c89c","Type":"ContainerStarted","Data":"b5bb8428da357907437c236d01b637f510ba95e0171c4256e403c1f21bf0faef"} Jul 20 19:22:13.899112 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:13.899083 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6c6f66_551a_4197_804f_77db8a93bde9.slice/crio-e8a13f6f6f7ba71170892993d04b123a8a8d146f43f2cf7c8ca5be38e6856eba WatchSource:0}: Error finding container e8a13f6f6f7ba71170892993d04b123a8a8d146f43f2cf7c8ca5be38e6856eba: Status 404 returned error can't find the container with id e8a13f6f6f7ba71170892993d04b123a8a8d146f43f2cf7c8ca5be38e6856eba Jul 20 19:22:13.900117 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:13.900094 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:13.905559 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:13.905529 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf8094f_b9d0_45bb_ac87_58ba04fabf80.slice/crio-31134e75f9007746c32b947329255b38595d485d56d76d6383d6d76e0004676e WatchSource:0}: Error finding container 31134e75f9007746c32b947329255b38595d485d56d76d6383d6d76e0004676e: Status 404 returned error can't find the container with id 31134e75f9007746c32b947329255b38595d485d56d76d6383d6d76e0004676e Jul 20 19:22:13.913554 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:13.913515 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4a2b0a_dbc8_47b5_8597_804413ead0ee.slice/crio-df90b194ed4a4bbe29f546a291f2ca958c5d073dd4ae5da610ce060c52b0e0a8 WatchSource:0}: Error finding container df90b194ed4a4bbe29f546a291f2ca958c5d073dd4ae5da610ce060c52b0e0a8: Status 404 returned error can't find the container with id df90b194ed4a4bbe29f546a291f2ca958c5d073dd4ae5da610ce060c52b0e0a8 Jul 20 19:22:14.289539 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.289490 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:14.289733 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.289560 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:14.289733 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:14.289626 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:14.289733 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:14.289691 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:14.289733 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:14.289712 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret podName:b9f1e451-881f-4c9e-a681-a7993f2ce583 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:15.289687686 +0000 UTC m=+4.156989459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret") pod "global-pull-secret-syncer-9rmms" (UID: "b9f1e451-881f-4c9e-a681-a7993f2ce583") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:14.289991 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:14.289742 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs podName:b0449b8a-9354-485d-9abb-18111650b435 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:15.289725415 +0000 UTC m=+4.157027189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs") pod "network-metrics-daemon-qdtm4" (UID: "b0449b8a-9354-485d-9abb-18111650b435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:14.390501 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.390451 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m9zl\" (UniqueName: \"kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl\") pod \"network-check-target-97m6z\" (UID: \"94aaaffa-3620-4a4c-8987-353ba4707936\") " pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:14.390696 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:14.390662 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:14.390696 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:14.390688 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:14.390804 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:14.390702 2555 projected.go:196] Error preparing data for projected volume kube-api-access-8m9zl for pod openshift-network-diagnostics/network-check-target-97m6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:14.390804 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:14.390772 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl podName:94aaaffa-3620-4a4c-8987-353ba4707936 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:15.39075092 +0000 UTC m=+4.258052711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m9zl" (UniqueName: "kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl") pod "network-check-target-97m6z" (UID: "94aaaffa-3620-4a4c-8987-353ba4707936") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:14.673957 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.673849 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:17:13 +0000 UTC" deadline="2027-12-31 10:13:37.47270172 +0000 UTC" Jul 20 19:22:14.673957 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.673902 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12686h51m22.798803909s" Jul 20 19:22:14.880360 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.880306 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:14.880558 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.880314 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:14.880558 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:14.880476 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:14.880667 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:14.880561 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:14.899904 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.899862 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tl6sb" event={"ID":"caf8094f-b9d0-45bb-ac87-58ba04fabf80","Type":"ContainerStarted","Data":"31134e75f9007746c32b947329255b38595d485d56d76d6383d6d76e0004676e"} Jul 20 19:22:14.901416 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.901385 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-982g9" event={"ID":"3b6c6f66-551a-4197-804f-77db8a93bde9","Type":"ContainerStarted","Data":"e8a13f6f6f7ba71170892993d04b123a8a8d146f43f2cf7c8ca5be38e6856eba"} Jul 20 19:22:14.903168 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.903132 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-82vjv" event={"ID":"2c06ba15-50d4-43eb-ae03-7300a05215dc","Type":"ContainerStarted","Data":"d6dc6d19d728b7b116fd04ed23f11c83867f0d93ec8753e407f9fabcb5ebd475"} Jul 20 19:22:14.904884 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.904854 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" event={"ID":"ba4a2b0a-dbc8-47b5-8597-804413ead0ee","Type":"ContainerStarted","Data":"df90b194ed4a4bbe29f546a291f2ca958c5d073dd4ae5da610ce060c52b0e0a8"} Jul 20 19:22:14.906191 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:14.906157 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" event={"ID":"27f969ba-1c86-44a6-9f16-d84af67620b1","Type":"ContainerStarted","Data":"9c879606b191fc343fa264854f9048c821531678c128804416fd62f6a982a782"} Jul 20 19:22:15.299578 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:15.299526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:15.299789 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:15.299592 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:15.299789 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:15.299759 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:15.299906 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:15.299822 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs podName:b0449b8a-9354-485d-9abb-18111650b435 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:17.299804204 +0000 UTC m=+6.167105984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs") pod "network-metrics-daemon-qdtm4" (UID: "b0449b8a-9354-485d-9abb-18111650b435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:15.300347 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:15.300251 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:15.300347 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:15.300333 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret podName:b9f1e451-881f-4c9e-a681-a7993f2ce583 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:17.300315411 +0000 UTC m=+6.167617185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret") pod "global-pull-secret-syncer-9rmms" (UID: "b9f1e451-881f-4c9e-a681-a7993f2ce583") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:15.400133 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:15.400095 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m9zl\" (UniqueName: \"kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl\") pod \"network-check-target-97m6z\" (UID: \"94aaaffa-3620-4a4c-8987-353ba4707936\") " pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:15.400373 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:15.400320 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:15.400373 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:15.400347 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:15.400373 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:15.400360 2555 projected.go:196] Error preparing data for projected volume kube-api-access-8m9zl for pod openshift-network-diagnostics/network-check-target-97m6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:15.400569 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:15.400487 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl podName:94aaaffa-3620-4a4c-8987-353ba4707936 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:17.400465513 +0000 UTC m=+6.267767311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m9zl" (UniqueName: "kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl") pod "network-check-target-97m6z" (UID: "94aaaffa-3620-4a4c-8987-353ba4707936") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:15.675177 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:15.675085 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:17:13 +0000 UTC" deadline="2028-01-09 09:59:45.494131548 +0000 UTC" Jul 20 19:22:15.675177 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:15.675151 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12902h37m29.818985746s" Jul 20 19:22:15.881128 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:15.880500 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:15.881128 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:15.880644 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:15.920566 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:15.920524 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" event={"ID":"055b2da4f7f1fd6f00b0fe6f11d1c89c","Type":"ContainerStarted","Data":"a26f96f1c8a6ae70307880d0eb47b5b62bb87123ea9637eded72bd29e1fff5ac"} Jul 20 19:22:15.937754 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:15.937688 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" podStartSLOduration=3.937667263 podStartE2EDuration="3.937667263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:15.936741551 +0000 UTC m=+4.804043368" watchObservedRunningTime="2026-07-20 19:22:15.937667263 +0000 UTC m=+4.804969059" Jul 20 19:22:16.879392 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:16.879350 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:16.879868 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:16.879508 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:16.879926 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:16.879909 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:16.882442 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:16.880005 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:16.939672 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:16.939608 2555 generic.go:356] "Generic (PLEG): container finished" podID="d1398e302ef95386d2a9d899ad51d74f" containerID="5c094d9cf083144f10248218e5d580ca087351ac1c2b737afde02c88f65b37b1" exitCode=0 Jul 20 19:22:16.940595 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:16.940563 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" event={"ID":"d1398e302ef95386d2a9d899ad51d74f","Type":"ContainerDied","Data":"5c094d9cf083144f10248218e5d580ca087351ac1c2b737afde02c88f65b37b1"} Jul 20 19:22:17.319910 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:17.319866 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:17.320109 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:17.319924 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:17.320109 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:17.320067 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:17.320207 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:17.320133 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs podName:b0449b8a-9354-485d-9abb-18111650b435 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:21.320113743 +0000 UTC m=+10.187415518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs") pod "network-metrics-daemon-qdtm4" (UID: "b0449b8a-9354-485d-9abb-18111650b435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:17.320604 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:17.320579 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:17.320717 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:17.320642 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret podName:b9f1e451-881f-4c9e-a681-a7993f2ce583 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:21.320625868 +0000 UTC m=+10.187927669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret") pod "global-pull-secret-syncer-9rmms" (UID: "b9f1e451-881f-4c9e-a681-a7993f2ce583") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:17.420929 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:17.420886 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m9zl\" (UniqueName: \"kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl\") pod \"network-check-target-97m6z\" (UID: \"94aaaffa-3620-4a4c-8987-353ba4707936\") " pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:17.421138 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:17.421116 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:17.421209 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:17.421146 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:17.421209 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:17.421159 2555 projected.go:196] Error preparing data for projected volume kube-api-access-8m9zl for pod openshift-network-diagnostics/network-check-target-97m6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:17.421339 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:17.421221 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl podName:94aaaffa-3620-4a4c-8987-353ba4707936 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:21.421199626 +0000 UTC m=+10.288501413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m9zl" (UniqueName: "kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl") pod "network-check-target-97m6z" (UID: "94aaaffa-3620-4a4c-8987-353ba4707936") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:17.880291 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:17.880256 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:17.880729 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:17.880407 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:18.879446 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:18.879405 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:18.879637 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:18.879553 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:18.879840 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:18.879811 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:18.879977 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:18.879952 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:19.880446 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:19.880400 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:19.880896 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:19.880569 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:20.879715 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:20.879678 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:20.879910 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:20.879822 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:20.879910 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:20.879883 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:20.880043 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:20.880020 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:21.351531 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:21.351483 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:21.351531 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:21.351536 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:21.352079 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:21.351653 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:21.352079 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:21.351676 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:21.352079 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:21.351728 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret podName:b9f1e451-881f-4c9e-a681-a7993f2ce583 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:29.351705474 +0000 UTC m=+18.219007248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret") pod "global-pull-secret-syncer-9rmms" (UID: "b9f1e451-881f-4c9e-a681-a7993f2ce583") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:21.352079 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:21.351749 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs podName:b0449b8a-9354-485d-9abb-18111650b435 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:29.351739308 +0000 UTC m=+18.219041089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs") pod "network-metrics-daemon-qdtm4" (UID: "b0449b8a-9354-485d-9abb-18111650b435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:21.452281 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:21.452240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m9zl\" (UniqueName: \"kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl\") pod \"network-check-target-97m6z\" (UID: \"94aaaffa-3620-4a4c-8987-353ba4707936\") " pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:21.452502 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:21.452459 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:21.452502 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:21.452487 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:21.452502 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:21.452500 2555 projected.go:196] Error preparing data for projected volume kube-api-access-8m9zl for pod openshift-network-diagnostics/network-check-target-97m6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:21.452679 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:21.452564 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl podName:94aaaffa-3620-4a4c-8987-353ba4707936 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:29.452544325 +0000 UTC m=+18.319846105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m9zl" (UniqueName: "kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl") pod "network-check-target-97m6z" (UID: "94aaaffa-3620-4a4c-8987-353ba4707936") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:21.880708 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:21.880654 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:21.880896 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:21.880776 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:22.880423 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:22.880319 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:22.880867 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:22.880498 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:22.880867 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:22.880547 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:22.880867 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:22.880657 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:23.879641 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:23.879598 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:23.879808 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:23.879747 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:24.880268 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:24.880235 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:24.880671 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:24.880235 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:24.880671 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:24.880391 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:24.880671 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:24.880498 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:24.959347 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:24.959261 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" event={"ID":"d1398e302ef95386d2a9d899ad51d74f","Type":"ContainerStarted","Data":"ade068fda6572e49c574f9255e42325d9fbd06311d9cb3d83caaf5a50c383aa3"} Jul 20 19:22:24.961274 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:24.961230 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" event={"ID":"27f969ba-1c86-44a6-9f16-d84af67620b1","Type":"ContainerStarted","Data":"9ab1eb30a6a00e50974310d746bb30dd90f4bd8e82458ce4cb0b425fcae91304"} Jul 20 19:22:24.974734 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:24.974668 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" podStartSLOduration=12.974652436 podStartE2EDuration="12.974652436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:24.974051831 +0000 UTC m=+13.841353629" watchObservedRunningTime="2026-07-20 19:22:24.974652436 +0000 UTC m=+13.841954229" Jul 20 19:22:25.879673 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:25.879639 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:25.879861 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:25.879772 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:25.966173 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:25.966134 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-82vjv" event={"ID":"2c06ba15-50d4-43eb-ae03-7300a05215dc","Type":"ContainerStarted","Data":"082a94129d9f70a0d41e9bbd2ce2e0964f200ffd3c5cc037aaabaaff0f206d0f"} Jul 20 19:22:25.967922 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:25.967880 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" event={"ID":"69985c88-2614-4138-92de-0e2b06c3711d","Type":"ContainerStarted","Data":"d522cbbf02a7fb2cad19ca711641d9a7db83d22d216c377dbdebf01fc3071740"} Jul 20 19:22:25.969841 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:25.969812 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5n9q" event={"ID":"7cea5b32-464e-4339-b801-21ec0cc7358c","Type":"ContainerStarted","Data":"cdee76879d2d2027201430030c6a39bc89cc053d5d5ee4af170ffe87139263a5"} Jul 20 19:22:25.971646 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:25.971549 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j22wh" event={"ID":"34ef2afb-6a97-4c52-9fc5-f7814f417a54","Type":"ContainerStarted","Data":"7da41096f06df266ae68094d0369db0d6dc55dc59eb97ffa4835a80f11a829bf"} Jul 20 19:22:25.973805 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:25.973766 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-982g9" event={"ID":"3b6c6f66-551a-4197-804f-77db8a93bde9","Type":"ContainerStarted","Data":"50a81cc2fdae37c9dd8bd48855501c695351c7eb59e251530d13a09f01cc88fb"} Jul 20 19:22:26.005027 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:26.004790 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r5vqz" podStartSLOduration=2.854306889 podStartE2EDuration="14.004766175s" totalImagesPullingTime="11.150459286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:26.003955621 +0000 UTC m=+14.871257460" watchObservedRunningTime="2026-07-20 19:22:26.004766175 +0000 UTC m=+14.872067970" Jul 20 19:22:26.018077 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:26.018010 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j22wh" podStartSLOduration=4.110578029 podStartE2EDuration="15.01799575s" totalImagesPullingTime="10.907417721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:26.01751427 +0000 UTC m=+14.884816086" watchObservedRunningTime="2026-07-20 19:22:26.01799575 +0000 UTC m=+14.885297540" Jul 20 19:22:26.043081 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:26.043029 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t5n9q" podStartSLOduration=4.150551659 podStartE2EDuration="15.043011582s" totalImagesPullingTime="10.892459923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:26.042630343 +0000 UTC m=+14.909932165" watchObservedRunningTime="2026-07-20 19:22:26.043011582 +0000 UTC m=+14.910313376" Jul 20 19:22:26.059172 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:26.059059 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-982g9" podStartSLOduration=3.193352469 podStartE2EDuration="14.059038685s" totalImagesPullingTime="10.865686216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:26.059038582 +0000 UTC m=+14.926340380" watchObservedRunningTime="2026-07-20 19:22:26.059038685 +0000 UTC m=+14.926340481" Jul 20 19:22:26.240792 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:26.240750 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:26.241457 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:26.241431 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:26.880191 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:26.880095 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:26.880367 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:26.880107 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:26.880367 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:26.880241 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:26.880367 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:26.880327 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:26.979059 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:26.978947 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sf26w" event={"ID":"454112e2-4faf-4b41-b786-441c631e8530","Type":"ContainerStarted","Data":"a04c076842b149e112ffff2acf508e0bd10c282b9d5703d07cfca5fa70906368"} Jul 20 19:22:26.996812 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:26.996755 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sf26w" podStartSLOduration=5.092696796 podStartE2EDuration="15.996739275s" totalImagesPullingTime="10.904042479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:26.99633688 +0000 UTC m=+15.863638719" watchObservedRunningTime="2026-07-20 19:22:26.996739275 +0000 UTC m=+15.864041069" Jul 20 19:22:27.880351 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:27.880317 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:27.880565 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:27.880449 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:27.981267 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:27.981240 2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 20 19:22:28.880387 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:28.880344 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:28.880387 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:28.880373 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:28.880692 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:28.880494 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:28.880692 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:28.880623 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:29.418427 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:29.418390 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:29.418427 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:29.418432 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:29.418993 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:29.418559 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:29.418993 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:29.418562 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:29.418993 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:29.418615 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs podName:b0449b8a-9354-485d-9abb-18111650b435 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:45.418598928 +0000 UTC m=+34.285900700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs") pod "network-metrics-daemon-qdtm4" (UID: "b0449b8a-9354-485d-9abb-18111650b435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:29.418993 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:29.418631 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret podName:b9f1e451-881f-4c9e-a681-a7993f2ce583 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:45.418623449 +0000 UTC m=+34.285925222 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret") pod "global-pull-secret-syncer-9rmms" (UID: "b9f1e451-881f-4c9e-a681-a7993f2ce583") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:29.519457 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:29.519413 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m9zl\" (UniqueName: \"kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl\") pod \"network-check-target-97m6z\" (UID: \"94aaaffa-3620-4a4c-8987-353ba4707936\") " pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:29.519638 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:29.519568 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:29.519638 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:29.519587 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:29.519638 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:29.519599 2555 projected.go:196] Error preparing data for projected volume kube-api-access-8m9zl for pod openshift-network-diagnostics/network-check-target-97m6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:29.519812 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:29.519672 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl podName:94aaaffa-3620-4a4c-8987-353ba4707936 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:45.519649133 +0000 UTC m=+34.386950930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m9zl" (UniqueName: "kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl") pod "network-check-target-97m6z" (UID: "94aaaffa-3620-4a4c-8987-353ba4707936") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:29.885881 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:29.885851 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:29.886036 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:29.885961 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:29.986287 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:29.986253 2555 generic.go:356] "Generic (PLEG): container finished" podID="2c06ba15-50d4-43eb-ae03-7300a05215dc" containerID="082a94129d9f70a0d41e9bbd2ce2e0964f200ffd3c5cc037aaabaaff0f206d0f" exitCode=0 Jul 20 19:22:29.986483 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:29.986335 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-82vjv" event={"ID":"2c06ba15-50d4-43eb-ae03-7300a05215dc","Type":"ContainerDied","Data":"082a94129d9f70a0d41e9bbd2ce2e0964f200ffd3c5cc037aaabaaff0f206d0f"} Jul 20 19:22:30.879700 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:30.879664 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:30.879700 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:30.879699 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:30.880401 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:30.879782 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:30.880401 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:30.879925 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:31.880692 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:31.880648 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:31.881322 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:31.880781 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:32.880082 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:32.880050 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:32.880274 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:32.880094 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:32.880274 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:32.880184 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:32.880414 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:32.880357 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:33.882904 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:33.882745 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:33.883246 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:33.883007 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:33.995630 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:33.995590 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" event={"ID":"ba4a2b0a-dbc8-47b5-8597-804413ead0ee","Type":"ContainerStarted","Data":"64c53bf9ba5a7f35a90432c7e56290a291e02caa129823b09381b37f5f17f5d5"} Jul 20 19:22:33.997143 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:33.997116 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tl6sb" event={"ID":"caf8094f-b9d0-45bb-ac87-58ba04fabf80","Type":"ContainerStarted","Data":"16470cde4d3ab5ad97137ea39d5aa6625b7c25b2e4e443a73c6ecf968eae6b06"} Jul 20 19:22:34.014482 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:34.014428 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tl6sb" podStartSLOduration=2.112831897 podStartE2EDuration="22.01441393s" totalImagesPullingTime="19.901582033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:34.013168194 +0000 UTC m=+22.880469989" watchObservedRunningTime="2026-07-20 19:22:34.01441393 +0000 UTC m=+22.881715724" Jul 20 19:22:34.223203 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:34.222962 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 19:22:34.815313 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:34.815190 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T19:22:34.223165382Z","UUID":"a5c0041e-4f1b-45c2-8628-dca448e99477","Handler":null,"Name":"","Endpoint":""} Jul 20 19:22:34.816772 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:34.816746 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 19:22:34.816869 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:34.816782 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 19:22:34.880270 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:34.880238 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:34.880517 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:34.880238 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:34.880517 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:34.880391 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:34.880517 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:34.880492 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:35.003602 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:35.003550 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" event={"ID":"ba4a2b0a-dbc8-47b5-8597-804413ead0ee","Type":"ContainerStarted","Data":"02cf995e6ccc4bef4bf3f6353f0f7fab38753a5f7af13af8ad1630b1160d51d0"} Jul 20 19:22:35.004099 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:35.003665 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" event={"ID":"ba4a2b0a-dbc8-47b5-8597-804413ead0ee","Type":"ContainerStarted","Data":"c3a15ff3ebad48bd814e61b76773c329f7161b086b7f881cb8efac12f4ca3f9f"} Jul 20 19:22:35.004099 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:35.003726 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" event={"ID":"ba4a2b0a-dbc8-47b5-8597-804413ead0ee","Type":"ContainerStarted","Data":"d71dfd15b5cc376fbce7f985dd82e0b2b3f402e6e602627fdd1c45da46c2e161"} Jul 20 19:22:35.004099 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:35.003773 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" event={"ID":"ba4a2b0a-dbc8-47b5-8597-804413ead0ee","Type":"ContainerStarted","Data":"7c8c1f82d679a1b605b2bddf75acf2dcbcfecba252acdc936da728ad8a020754"} Jul 20 19:22:35.004099 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:35.003821 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" event={"ID":"ba4a2b0a-dbc8-47b5-8597-804413ead0ee","Type":"ContainerStarted","Data":"9bdab526f3b9686509e59eaa823fee63f6f15b88dc967b386c8ff28454be6d2c"} Jul 20 19:22:35.005594 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:35.005562 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" event={"ID":"27f969ba-1c86-44a6-9f16-d84af67620b1","Type":"ContainerStarted","Data":"543af022bb3f7158a35d5a0034930fdb1eb32741932e3be33337089fb6f3a5ec"} Jul 20 19:22:35.275758 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:35.275713 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:35.276039 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:35.275908 2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 20 19:22:35.276508 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:35.276489 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j22wh" Jul 20 19:22:35.882867 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:35.882839 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:35.883026 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:35.882940 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:36.009661 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:36.009623 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" event={"ID":"27f969ba-1c86-44a6-9f16-d84af67620b1","Type":"ContainerStarted","Data":"bfc72e1c9c28e4486d51885fe4c4e0b4e61090dc0142fe5301da46fa3be96611"} Jul 20 19:22:36.025621 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:36.025573 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cf6q6" podStartSLOduration=2.631206364 podStartE2EDuration="24.025556954s" totalImagesPullingTime="21.39435059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:36.025448781 +0000 UTC m=+24.892750603" watchObservedRunningTime="2026-07-20 19:22:36.025556954 +0000 UTC m=+24.892858826" Jul 20 19:22:36.879789 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:36.879750 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:36.879979 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:36.879787 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:36.879979 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:36.879892 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:36.880098 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:36.880034 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:37.015552 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:37.015516 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" event={"ID":"ba4a2b0a-dbc8-47b5-8597-804413ead0ee","Type":"ContainerStarted","Data":"435b0bde5fce310333ed28216a6d697bb8e6374270ea3640664d0352b78c91cc"} Jul 20 19:22:37.883830 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:37.883791 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:37.884015 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:37.883927 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:38.880200 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:38.880162 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:38.880200 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:38.880198 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:38.880850 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:38.880320 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:38.880850 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:38.880402 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:39.879611 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:39.879433 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:39.879882 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:39.879707 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:40.024393 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:40.024357 2555 generic.go:356] "Generic (PLEG): container finished" podID="2c06ba15-50d4-43eb-ae03-7300a05215dc" containerID="535b531cc35e0cf7c8406737a85166f0e9eeb1ab6c0a9d561044134de206709d" exitCode=0 Jul 20 19:22:40.025151 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:40.024451 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-82vjv" event={"ID":"2c06ba15-50d4-43eb-ae03-7300a05215dc","Type":"ContainerDied","Data":"535b531cc35e0cf7c8406737a85166f0e9eeb1ab6c0a9d561044134de206709d"} Jul 20 19:22:40.030706 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:40.030676 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" event={"ID":"ba4a2b0a-dbc8-47b5-8597-804413ead0ee","Type":"ContainerStarted","Data":"c147955ac65eb73dc7d1a00880ae62b7103c535dd63bf3e520cfac9f7068cb67"} Jul 20 19:22:40.030993 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:40.030968 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:40.031116 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:40.031041 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:40.031116 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:40.031092 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:40.047248 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:40.047215 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:40.047413 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:40.047384 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:22:40.071358 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:40.071313 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" podStartSLOduration=8.178062956 podStartE2EDuration="28.071279357s" totalImagesPullingTime="19.893216401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:40.071049724 +0000 UTC m=+28.938351518" watchObservedRunningTime="2026-07-20 19:22:40.071279357 +0000 UTC m=+28.938581152" Jul 20 19:22:40.880527 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:40.880476 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:40.880748 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:40.880500 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:40.880748 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:40.880656 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:40.880748 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:40.880676 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:41.468966 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:41.468929 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9rmms"] Jul 20 19:22:41.469380 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:41.469044 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:41.469380 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:41.469143 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:41.471065 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:41.471036 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qdtm4"] Jul 20 19:22:41.471171 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:41.471154 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:41.471338 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:41.471278 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:41.474009 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:41.473986 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-97m6z"] Jul 20 19:22:41.474123 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:41.474090 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:41.474191 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:41.474173 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:42.036965 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:42.036931 2555 generic.go:356] "Generic (PLEG): container finished" podID="2c06ba15-50d4-43eb-ae03-7300a05215dc" containerID="3004fa799d58292bd95ac28ad614f45e4911cf1d21fa337dc7d23914b16108b8" exitCode=0 Jul 20 19:22:42.037159 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:42.036996 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-82vjv" event={"ID":"2c06ba15-50d4-43eb-ae03-7300a05215dc","Type":"ContainerDied","Data":"3004fa799d58292bd95ac28ad614f45e4911cf1d21fa337dc7d23914b16108b8"} Jul 20 19:22:42.879757 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:42.879712 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:42.879757 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:42.879735 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:42.880204 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:42.879837 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:42.880204 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:42.879961 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:43.879820 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:43.879782 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:43.880340 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:43.879885 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:44.043655 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:44.043621 2555 generic.go:356] "Generic (PLEG): container finished" podID="2c06ba15-50d4-43eb-ae03-7300a05215dc" containerID="914c0733d61184bfc33c0bff5f189d6f4787c0fc784bfa2393d6c1b98b92806e" exitCode=0 Jul 20 19:22:44.043823 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:44.043674 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-82vjv" event={"ID":"2c06ba15-50d4-43eb-ae03-7300a05215dc","Type":"ContainerDied","Data":"914c0733d61184bfc33c0bff5f189d6f4787c0fc784bfa2393d6c1b98b92806e"} Jul 20 19:22:44.879860 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:44.879822 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:44.880201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:44.879842 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:44.880201 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:44.880048 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:22:44.880201 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:44.880134 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmms" podUID="b9f1e451-881f-4c9e-a681-a7993f2ce583" Jul 20 19:22:45.432538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:45.432499 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:45.432538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:45.432539 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:45.432922 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:45.432690 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:45.432922 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:45.432776 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:45.432922 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:45.432780 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret podName:b9f1e451-881f-4c9e-a681-a7993f2ce583 nodeName:}" failed. No retries permitted until 2026-07-20 19:23:17.432754586 +0000 UTC m=+66.300056371 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret") pod "global-pull-secret-syncer-9rmms" (UID: "b9f1e451-881f-4c9e-a681-a7993f2ce583") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:45.432922 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:45.432845 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs podName:b0449b8a-9354-485d-9abb-18111650b435 nodeName:}" failed. No retries permitted until 2026-07-20 19:23:17.432830243 +0000 UTC m=+66.300132016 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs") pod "network-metrics-daemon-qdtm4" (UID: "b0449b8a-9354-485d-9abb-18111650b435") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:45.533133 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:45.533098 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m9zl\" (UniqueName: \"kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl\") pod \"network-check-target-97m6z\" (UID: \"94aaaffa-3620-4a4c-8987-353ba4707936\") " pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:45.533291 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:45.533236 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:45.533291 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:45.533254 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:45.533291 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:45.533264 2555 projected.go:196] Error preparing data for projected volume kube-api-access-8m9zl for pod openshift-network-diagnostics/network-check-target-97m6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:45.533445 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:45.533344 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl podName:94aaaffa-3620-4a4c-8987-353ba4707936 nodeName:}" failed. No retries permitted until 2026-07-20 19:23:17.533326476 +0000 UTC m=+66.400628252 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m9zl" (UniqueName: "kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl") pod "network-check-target-97m6z" (UID: "94aaaffa-3620-4a4c-8987-353ba4707936") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:45.879525 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:45.879487 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:45.879722 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:45.879632 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97m6z" podUID="94aaaffa-3620-4a4c-8987-353ba4707936" Jul 20 19:22:46.398249 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.398220 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeReady" Jul 20 19:22:46.398747 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.398385 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 19:22:46.433994 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.433953 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-vps65"] Jul 20 19:22:46.437391 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.437358 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:22:46.438221 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.438189 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fc756966-dzrkz"] Jul 20 19:22:46.440267 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.440220 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.440432 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.440270 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 20 19:22:46.440432 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.440350 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 20 19:22:46.440687 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.440625 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t6cd6\"" Jul 20 19:22:46.443357 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.443334 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 19:22:46.443357 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.443354 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 19:22:46.443669 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.443650 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 19:22:46.443808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.443731 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lct99\"" Jul 20 19:22:46.451418 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.451393 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 19:22:46.454035 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.454003 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-vps65"] Jul 20 19:22:46.454962 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.454938 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ts6j5"] Jul 20 19:22:46.458937 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.458905 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fc756966-dzrkz"] Jul 20 19:22:46.459083 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.458954 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-98l6w"] Jul 20 19:22:46.459083 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.458958 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ts6j5" Jul 20 19:22:46.461653 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.461621 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.462137 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.462109 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 19:22:46.462290 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.462155 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 19:22:46.462290 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.462243 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 19:22:46.462532 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.462389 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-46bg7\"" Jul 20 19:22:46.464120 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.464099 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 19:22:46.464412 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.464375 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 19:22:46.464538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.464474 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bsgbb\"" Jul 20 19:22:46.469342 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.469277 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ts6j5"] Jul 20 19:22:46.473204 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.473174 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-98l6w"] Jul 20 19:22:46.541653 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.541621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-installation-pull-secrets\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.541837 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.541670 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.541837 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.541705 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-bound-sa-token\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.541837 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.541731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2f70b15-063d-4c64-a98f-b354db566a4a-config-volume\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.541837 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.541802 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-image-registry-private-configuration\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.542019 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.541857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-trusted-ca\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.542019 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.541889 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4kzb\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-kube-api-access-f4kzb\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.542019 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.541918 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.542019 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.541949 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f70b15-063d-4c64-a98f-b354db566a4a-tmp-dir\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.542019 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.541979 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr4g7\" (UniqueName: \"kubernetes.io/projected/f6f87434-3b09-4f00-be21-45bde7552fe4-kube-api-access-nr4g7\") pod \"ingress-canary-ts6j5\" (UID: \"f6f87434-3b09-4f00-be21-45bde7552fe4\") " pod="openshift-ingress-canary/ingress-canary-ts6j5" Jul 20 19:22:46.542019 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.542006 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fe017135-8f68-479f-971d-ebe27c7b45ff-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:22:46.542387 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.542037 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-ca-trust-extracted\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.542387 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.542063 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6f87434-3b09-4f00-be21-45bde7552fe4-cert\") pod \"ingress-canary-ts6j5\" (UID: \"f6f87434-3b09-4f00-be21-45bde7552fe4\") " pod="openshift-ingress-canary/ingress-canary-ts6j5" Jul 20 19:22:46.542387 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.542140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:22:46.542387 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.542193 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-certificates\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.542387 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.542238 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hf2m\" (UniqueName: \"kubernetes.io/projected/a2f70b15-063d-4c64-a98f-b354db566a4a-kube-api-access-7hf2m\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.643250 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643206 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:22:46.643250 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643244 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-certificates\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.643478 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643267 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hf2m\" (UniqueName: \"kubernetes.io/projected/a2f70b15-063d-4c64-a98f-b354db566a4a-kube-api-access-7hf2m\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.643478 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:46.643388 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:22:46.643478 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643425 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-installation-pull-secrets\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.643478 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:46.643472 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert podName:fe017135-8f68-479f-971d-ebe27c7b45ff nodeName:}" failed. No retries permitted until 2026-07-20 19:22:47.143450749 +0000 UTC m=+36.010752525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vps65" (UID: "fe017135-8f68-479f-971d-ebe27c7b45ff") : secret "networking-console-plugin-cert" not found Jul 20 19:22:46.643704 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643513 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.643704 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643554 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-bound-sa-token\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.643704 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643587 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2f70b15-063d-4c64-a98f-b354db566a4a-config-volume\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.643704 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:46.643617 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:22:46.643704 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:46.643637 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fc756966-dzrkz: secret "image-registry-tls" not found Jul 20 19:22:46.643704 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643638 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-image-registry-private-configuration\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.643704 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643669 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-trusted-ca\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.643704 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:46.643685 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls podName:e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:47.143667385 +0000 UTC m=+36.010969175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls") pod "image-registry-6fc756966-dzrkz" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1") : secret "image-registry-tls" not found Jul 20 19:22:46.644091 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643802 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4kzb\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-kube-api-access-f4kzb\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.644091 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643835 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.644091 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643868 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f70b15-063d-4c64-a98f-b354db566a4a-tmp-dir\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.644091 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:46.643932 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:22:46.644091 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:46.643976 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls podName:a2f70b15-063d-4c64-a98f-b354db566a4a nodeName:}" failed. No retries permitted until 2026-07-20 19:22:47.143961479 +0000 UTC m=+36.011263254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls") pod "dns-default-98l6w" (UID: "a2f70b15-063d-4c64-a98f-b354db566a4a") : secret "dns-default-metrics-tls" not found Jul 20 19:22:46.644091 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.643994 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-certificates\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.644091 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.644064 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr4g7\" (UniqueName: \"kubernetes.io/projected/f6f87434-3b09-4f00-be21-45bde7552fe4-kube-api-access-nr4g7\") pod \"ingress-canary-ts6j5\" (UID: \"f6f87434-3b09-4f00-be21-45bde7552fe4\") " pod="openshift-ingress-canary/ingress-canary-ts6j5" Jul 20 19:22:46.644456 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.644101 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fe017135-8f68-479f-971d-ebe27c7b45ff-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:22:46.644456 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.644121 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f70b15-063d-4c64-a98f-b354db566a4a-tmp-dir\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.644456 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.644133 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-ca-trust-extracted\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.644456 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.644159 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6f87434-3b09-4f00-be21-45bde7552fe4-cert\") pod \"ingress-canary-ts6j5\" (UID: \"f6f87434-3b09-4f00-be21-45bde7552fe4\") " pod="openshift-ingress-canary/ingress-canary-ts6j5" Jul 20 19:22:46.644456 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.644213 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2f70b15-063d-4c64-a98f-b354db566a4a-config-volume\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.644672 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.644524 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-ca-trust-extracted\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.644672 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.644651 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-trusted-ca\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.644828 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.644787 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fe017135-8f68-479f-971d-ebe27c7b45ff-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:22:46.647869 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.647842 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-installation-pull-secrets\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.647869 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.647852 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-image-registry-private-configuration\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.648037 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.647900 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6f87434-3b09-4f00-be21-45bde7552fe4-cert\") pod \"ingress-canary-ts6j5\" (UID: \"f6f87434-3b09-4f00-be21-45bde7552fe4\") " pod="openshift-ingress-canary/ingress-canary-ts6j5" Jul 20 19:22:46.651882 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.651854 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hf2m\" (UniqueName: \"kubernetes.io/projected/a2f70b15-063d-4c64-a98f-b354db566a4a-kube-api-access-7hf2m\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:46.652133 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.652114 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4kzb\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-kube-api-access-f4kzb\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.652226 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.652204 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr4g7\" (UniqueName: \"kubernetes.io/projected/f6f87434-3b09-4f00-be21-45bde7552fe4-kube-api-access-nr4g7\") pod \"ingress-canary-ts6j5\" (UID: \"f6f87434-3b09-4f00-be21-45bde7552fe4\") " pod="openshift-ingress-canary/ingress-canary-ts6j5" Jul 20 19:22:46.652744 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.652717 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-bound-sa-token\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:46.773712 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.773664 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ts6j5" Jul 20 19:22:46.880113 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.879874 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:22:46.880244 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.879883 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:22:46.883871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.883674 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gzsbm\"" Jul 20 19:22:46.883871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.883786 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 19:22:46.884003 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.883922 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 19:22:46.934883 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:46.934847 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ts6j5"] Jul 20 19:22:46.939090 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:22:46.939057 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f87434_3b09_4f00_be21_45bde7552fe4.slice/crio-3ce02715abe723bd0b31c249b4aa627fc551717a2756d04012ea5813b546805f WatchSource:0}: Error finding container 3ce02715abe723bd0b31c249b4aa627fc551717a2756d04012ea5813b546805f: Status 404 returned error can't find the container with id 3ce02715abe723bd0b31c249b4aa627fc551717a2756d04012ea5813b546805f Jul 20 19:22:47.053629 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:47.053591 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ts6j5" event={"ID":"f6f87434-3b09-4f00-be21-45bde7552fe4","Type":"ContainerStarted","Data":"3ce02715abe723bd0b31c249b4aa627fc551717a2756d04012ea5813b546805f"} Jul 20 19:22:47.149074 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:47.148955 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:47.149074 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:47.149046 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:47.149318 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:47.149083 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:22:47.149318 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:47.149171 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:22:47.149318 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:47.149196 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fc756966-dzrkz: secret "image-registry-tls" not found Jul 20 19:22:47.149318 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:47.149207 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:22:47.149318 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:47.149218 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:22:47.149318 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:47.149269 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls podName:e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:48.149249537 +0000 UTC m=+37.016551313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls") pod "image-registry-6fc756966-dzrkz" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1") : secret "image-registry-tls" not found Jul 20 19:22:47.149318 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:47.149288 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls podName:a2f70b15-063d-4c64-a98f-b354db566a4a nodeName:}" failed. No retries permitted until 2026-07-20 19:22:48.149279124 +0000 UTC m=+37.016580902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls") pod "dns-default-98l6w" (UID: "a2f70b15-063d-4c64-a98f-b354db566a4a") : secret "dns-default-metrics-tls" not found Jul 20 19:22:47.149318 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:47.149319 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert podName:fe017135-8f68-479f-971d-ebe27c7b45ff nodeName:}" failed. No retries permitted until 2026-07-20 19:22:48.149310547 +0000 UTC m=+37.016612326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vps65" (UID: "fe017135-8f68-479f-971d-ebe27c7b45ff") : secret "networking-console-plugin-cert" not found Jul 20 19:22:47.880232 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:47.880195 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:22:47.882950 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:47.882922 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 19:22:47.883096 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:47.882969 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 19:22:47.883096 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:47.883022 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ctrm\"" Jul 20 19:22:48.156359 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:48.156235 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:48.156359 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:48.156353 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:48.156595 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:48.156411 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:22:48.156595 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:48.156421 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:22:48.156595 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:48.156473 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:22:48.156595 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:48.156537 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls podName:a2f70b15-063d-4c64-a98f-b354db566a4a nodeName:}" failed. No retries permitted until 2026-07-20 19:22:50.156522198 +0000 UTC m=+39.023823971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls") pod "dns-default-98l6w" (UID: "a2f70b15-063d-4c64-a98f-b354db566a4a") : secret "dns-default-metrics-tls" not found Jul 20 19:22:48.156595 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:48.156484 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fc756966-dzrkz: secret "image-registry-tls" not found Jul 20 19:22:48.156807 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:48.156630 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls podName:e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:50.15661028 +0000 UTC m=+39.023912069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls") pod "image-registry-6fc756966-dzrkz" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1") : secret "image-registry-tls" not found Jul 20 19:22:48.156807 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:48.156561 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:22:48.156807 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:48.156700 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert podName:fe017135-8f68-479f-971d-ebe27c7b45ff nodeName:}" failed. No retries permitted until 2026-07-20 19:22:50.156681673 +0000 UTC m=+39.023983458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vps65" (UID: "fe017135-8f68-479f-971d-ebe27c7b45ff") : secret "networking-console-plugin-cert" not found Jul 20 19:22:50.172964 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:50.172911 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:50.173448 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:50.173016 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:50.173448 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:50.173068 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:22:50.173448 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:50.173077 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:22:50.173448 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:50.173096 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fc756966-dzrkz: secret "image-registry-tls" not found Jul 20 19:22:50.173448 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:50.173162 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls podName:e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:54.173142705 +0000 UTC m=+43.040444497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls") pod "image-registry-6fc756966-dzrkz" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1") : secret "image-registry-tls" not found Jul 20 19:22:50.173448 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:50.173164 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:22:50.173448 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:50.173170 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:22:50.173448 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:50.173219 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert podName:fe017135-8f68-479f-971d-ebe27c7b45ff nodeName:}" failed. No retries permitted until 2026-07-20 19:22:54.173205513 +0000 UTC m=+43.040507286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vps65" (UID: "fe017135-8f68-479f-971d-ebe27c7b45ff") : secret "networking-console-plugin-cert" not found Jul 20 19:22:50.173448 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:50.173247 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls podName:a2f70b15-063d-4c64-a98f-b354db566a4a nodeName:}" failed. No retries permitted until 2026-07-20 19:22:54.173233939 +0000 UTC m=+43.040535725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls") pod "dns-default-98l6w" (UID: "a2f70b15-063d-4c64-a98f-b354db566a4a") : secret "dns-default-metrics-tls" not found Jul 20 19:22:50.842422 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:50.842389 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j22wh_34ef2afb-6a97-4c52-9fc5-f7814f417a54/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:50.957204 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:50.957170 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j22wh_34ef2afb-6a97-4c52-9fc5-f7814f417a54/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:51.057776 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:51.057696 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j22wh_34ef2afb-6a97-4c52-9fc5-f7814f417a54/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:51.067188 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:51.067158 2555 generic.go:356] "Generic (PLEG): container finished" podID="2c06ba15-50d4-43eb-ae03-7300a05215dc" containerID="2543dece1af7b87afc2ebb745c9eea03dfe5f7ce19ac1724c3b7e55dd24faa0d" exitCode=0 Jul 20 19:22:51.067397 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:51.067232 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-82vjv" event={"ID":"2c06ba15-50d4-43eb-ae03-7300a05215dc","Type":"ContainerDied","Data":"2543dece1af7b87afc2ebb745c9eea03dfe5f7ce19ac1724c3b7e55dd24faa0d"} Jul 20 19:22:51.068784 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:51.068761 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ts6j5" event={"ID":"f6f87434-3b09-4f00-be21-45bde7552fe4","Type":"ContainerStarted","Data":"0a5e209ca067e6910214c060744e003be17a5efa87621df25a7c05d69504baa5"} Jul 20 19:22:51.106390 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:51.106314 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ts6j5" podStartSLOduration=1.805510398 podStartE2EDuration="5.106275103s" totalImagesPullingTime="3.300764705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:51.104794302 +0000 UTC m=+39.972096118" watchObservedRunningTime="2026-07-20 19:22:51.106275103 +0000 UTC m=+39.973576941" Jul 20 19:22:51.809839 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:51.809804 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j22wh_34ef2afb-6a97-4c52-9fc5-f7814f417a54/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:51.866631 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:51.866448 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j22wh_34ef2afb-6a97-4c52-9fc5-f7814f417a54/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:52.074928 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:52.074844 2555 generic.go:356] "Generic (PLEG): container finished" podID="2c06ba15-50d4-43eb-ae03-7300a05215dc" containerID="0aee0be76a56a157e2445fbd0e2497edf909100209857054dd5dbd8277380f98" exitCode=0 Jul 20 19:22:52.074928 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:52.074915 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-82vjv" event={"ID":"2c06ba15-50d4-43eb-ae03-7300a05215dc","Type":"ContainerDied","Data":"0aee0be76a56a157e2445fbd0e2497edf909100209857054dd5dbd8277380f98"} Jul 20 19:22:52.769170 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:52.769131 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j22wh_34ef2afb-6a97-4c52-9fc5-f7814f417a54/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:53.080517 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:53.080440 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-82vjv" event={"ID":"2c06ba15-50d4-43eb-ae03-7300a05215dc","Type":"ContainerStarted","Data":"9e951114c3cbea3423b37b957539c7b25bd4707dfed2ae873eb8a97994343078"} Jul 20 19:22:53.104737 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:53.104682 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-82vjv" podStartSLOduration=12.303721457 podStartE2EDuration="41.104663905s" totalImagesPullingTime="28.800942448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:53.104068741 +0000 UTC m=+41.971370539" watchObservedRunningTime="2026-07-20 19:22:53.104663905 +0000 UTC m=+41.971965701" Jul 20 19:22:53.232463 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:53.232427 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j22wh_34ef2afb-6a97-4c52-9fc5-f7814f417a54/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:53.295106 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:53.295075 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j22wh_34ef2afb-6a97-4c52-9fc5-f7814f417a54/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:53.449500 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:53.449394 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j22wh_34ef2afb-6a97-4c52-9fc5-f7814f417a54/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:53.549608 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:53.549571 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j22wh_34ef2afb-6a97-4c52-9fc5-f7814f417a54/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:54.205225 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:54.205178 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:22:54.205225 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:54.205234 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:22:54.205695 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:22:54.205271 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:22:54.205695 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:54.205351 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:22:54.205695 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:54.205375 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:22:54.205695 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:54.205377 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:22:54.205695 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:54.205422 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fc756966-dzrkz: secret "image-registry-tls" not found Jul 20 19:22:54.205695 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:54.205413 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls podName:a2f70b15-063d-4c64-a98f-b354db566a4a nodeName:}" failed. No retries permitted until 2026-07-20 19:23:02.205397794 +0000 UTC m=+51.072699568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls") pod "dns-default-98l6w" (UID: "a2f70b15-063d-4c64-a98f-b354db566a4a") : secret "dns-default-metrics-tls" not found Jul 20 19:22:54.205695 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:54.205467 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert podName:fe017135-8f68-479f-971d-ebe27c7b45ff nodeName:}" failed. No retries permitted until 2026-07-20 19:23:02.205453355 +0000 UTC m=+51.072755127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vps65" (UID: "fe017135-8f68-479f-971d-ebe27c7b45ff") : secret "networking-console-plugin-cert" not found Jul 20 19:22:54.205695 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:22:54.205483 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls podName:e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1 nodeName:}" failed. No retries permitted until 2026-07-20 19:23:02.205476264 +0000 UTC m=+51.072778037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls") pod "image-registry-6fc756966-dzrkz" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1") : secret "image-registry-tls" not found Jul 20 19:23:02.267832 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:02.267786 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:23:02.267832 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:02.267846 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:23:02.268637 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:02.267890 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:23:02.268637 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:02.267957 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:23:02.268637 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:02.267980 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:23:02.268637 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:02.268010 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:23:02.268637 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:02.268029 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fc756966-dzrkz: secret "image-registry-tls" not found Jul 20 19:23:02.268637 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:02.268049 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert podName:fe017135-8f68-479f-971d-ebe27c7b45ff nodeName:}" failed. No retries permitted until 2026-07-20 19:23:18.268027776 +0000 UTC m=+67.135329550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vps65" (UID: "fe017135-8f68-479f-971d-ebe27c7b45ff") : secret "networking-console-plugin-cert" not found Jul 20 19:23:02.268637 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:02.268074 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls podName:e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1 nodeName:}" failed. No retries permitted until 2026-07-20 19:23:18.268059326 +0000 UTC m=+67.135361104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls") pod "image-registry-6fc756966-dzrkz" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1") : secret "image-registry-tls" not found Jul 20 19:23:02.268637 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:02.268090 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls podName:a2f70b15-063d-4c64-a98f-b354db566a4a nodeName:}" failed. No retries permitted until 2026-07-20 19:23:18.26808245 +0000 UTC m=+67.135384228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls") pod "dns-default-98l6w" (UID: "a2f70b15-063d-4c64-a98f-b354db566a4a") : secret "dns-default-metrics-tls" not found Jul 20 19:23:12.054912 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:12.054881 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcpqx" Jul 20 19:23:17.486128 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.486086 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:23:17.486128 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.486126 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:23:17.488671 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.488648 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 19:23:17.488763 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.488748 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 19:23:17.496877 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:17.496847 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 19:23:17.496966 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:17.496935 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs podName:b0449b8a-9354-485d-9abb-18111650b435 nodeName:}" failed. No retries permitted until 2026-07-20 19:24:21.496912017 +0000 UTC m=+130.364213790 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs") pod "network-metrics-daemon-qdtm4" (UID: "b0449b8a-9354-485d-9abb-18111650b435") : secret "metrics-daemon-secret" not found Jul 20 19:23:17.500773 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.500747 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9f1e451-881f-4c9e-a681-a7993f2ce583-original-pull-secret\") pod \"global-pull-secret-syncer-9rmms\" (UID: \"b9f1e451-881f-4c9e-a681-a7993f2ce583\") " pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:23:17.500905 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.500868 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmms" Jul 20 19:23:17.586778 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.586745 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m9zl\" (UniqueName: \"kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl\") pod \"network-check-target-97m6z\" (UID: \"94aaaffa-3620-4a4c-8987-353ba4707936\") " pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:23:17.589495 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.589473 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 19:23:17.600492 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.600454 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 19:23:17.611153 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.611124 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m9zl\" (UniqueName: \"kubernetes.io/projected/94aaaffa-3620-4a4c-8987-353ba4707936-kube-api-access-8m9zl\") pod \"network-check-target-97m6z\" (UID: \"94aaaffa-3620-4a4c-8987-353ba4707936\") " pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:23:17.632724 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.632690 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9rmms"] Jul 20 19:23:17.635765 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:23:17.635735 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f1e451_881f_4c9e_a681_a7993f2ce583.slice/crio-df10c15e930ac2eeffcff10b7d71d0959342d2cd08b10e7d2e28ab8e13461cdc WatchSource:0}: Error finding container df10c15e930ac2eeffcff10b7d71d0959342d2cd08b10e7d2e28ab8e13461cdc: Status 404 returned error can't find the container with id df10c15e930ac2eeffcff10b7d71d0959342d2cd08b10e7d2e28ab8e13461cdc Jul 20 19:23:17.896736 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.896698 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ctrm\"" Jul 20 19:23:17.904731 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:17.904700 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:23:18.029369 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:18.029331 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-97m6z"] Jul 20 19:23:18.032814 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:23:18.032785 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94aaaffa_3620_4a4c_8987_353ba4707936.slice/crio-b37c8f0955b1eccba2b6fea2860324cbb667237577be606cef2fb4831c384b43 WatchSource:0}: Error finding container b37c8f0955b1eccba2b6fea2860324cbb667237577be606cef2fb4831c384b43: Status 404 returned error can't find the container with id b37c8f0955b1eccba2b6fea2860324cbb667237577be606cef2fb4831c384b43 Jul 20 19:23:18.143366 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:18.143332 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-97m6z" event={"ID":"94aaaffa-3620-4a4c-8987-353ba4707936","Type":"ContainerStarted","Data":"b37c8f0955b1eccba2b6fea2860324cbb667237577be606cef2fb4831c384b43"} Jul 20 19:23:18.144425 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:18.144401 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9rmms" event={"ID":"b9f1e451-881f-4c9e-a681-a7993f2ce583","Type":"ContainerStarted","Data":"df10c15e930ac2eeffcff10b7d71d0959342d2cd08b10e7d2e28ab8e13461cdc"} Jul 20 19:23:18.291694 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:18.291654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:23:18.291866 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:18.291719 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:23:18.291866 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:18.291764 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:23:18.291866 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:18.291809 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:23:18.291866 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:18.291862 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:23:18.292068 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:18.291875 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:23:18.292068 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:18.291885 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert podName:fe017135-8f68-479f-971d-ebe27c7b45ff nodeName:}" failed. No retries permitted until 2026-07-20 19:23:50.291863445 +0000 UTC m=+99.159165223 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vps65" (UID: "fe017135-8f68-479f-971d-ebe27c7b45ff") : secret "networking-console-plugin-cert" not found Jul 20 19:23:18.292068 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:18.291892 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fc756966-dzrkz: secret "image-registry-tls" not found Jul 20 19:23:18.292068 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:18.291913 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls podName:a2f70b15-063d-4c64-a98f-b354db566a4a nodeName:}" failed. No retries permitted until 2026-07-20 19:23:50.291897507 +0000 UTC m=+99.159199329 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls") pod "dns-default-98l6w" (UID: "a2f70b15-063d-4c64-a98f-b354db566a4a") : secret "dns-default-metrics-tls" not found Jul 20 19:23:18.292068 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:18.291950 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls podName:e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1 nodeName:}" failed. No retries permitted until 2026-07-20 19:23:50.291933687 +0000 UTC m=+99.159235459 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls") pod "image-registry-6fc756966-dzrkz" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1") : secret "image-registry-tls" not found Jul 20 19:23:23.160171 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:23.160075 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-97m6z" event={"ID":"94aaaffa-3620-4a4c-8987-353ba4707936","Type":"ContainerStarted","Data":"4a4e5169a1c4f12ecaf194fd9743d84c3f74cc355c6ad2c7ecb3ee359ee44260"} Jul 20 19:23:23.160636 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:23.160208 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:23:23.161588 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:23.161567 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9rmms" event={"ID":"b9f1e451-881f-4c9e-a681-a7993f2ce583","Type":"ContainerStarted","Data":"328534ea58fdb2d5b91ed80683e21eaf0cae7a3c5af5759976307807f05a52fd"} Jul 20 19:23:23.175947 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:23.175889 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-97m6z" podStartSLOduration=66.303617068 podStartE2EDuration="1m11.17587381s" totalImagesPullingTime="4.872256742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:23.174434413 +0000 UTC m=+72.041736236" watchObservedRunningTime="2026-07-20 19:23:23.17587381 +0000 UTC m=+72.043175605" Jul 20 19:23:23.190031 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:23.189966 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9rmms" podStartSLOduration=65.915058 podStartE2EDuration="1m11.189949716s" totalImagesPullingTime="5.274891716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:23.189508068 +0000 UTC m=+72.056809862" watchObservedRunningTime="2026-07-20 19:23:23.189949716 +0000 UTC m=+72.057251511" Jul 20 19:23:50.336552 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:50.336410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:23:50.336552 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:50.336474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:23:50.336552 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:50.336502 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:23:50.337187 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:50.336587 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:23:50.337187 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:50.336623 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:23:50.337187 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:50.336590 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:23:50.337187 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:50.336675 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls podName:a2f70b15-063d-4c64-a98f-b354db566a4a nodeName:}" failed. No retries permitted until 2026-07-20 19:24:54.336656492 +0000 UTC m=+163.203958269 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls") pod "dns-default-98l6w" (UID: "a2f70b15-063d-4c64-a98f-b354db566a4a") : secret "dns-default-metrics-tls" not found Jul 20 19:23:50.337187 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:50.336677 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fc756966-dzrkz: secret "image-registry-tls" not found Jul 20 19:23:50.337187 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:50.336698 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert podName:fe017135-8f68-479f-971d-ebe27c7b45ff nodeName:}" failed. No retries permitted until 2026-07-20 19:24:54.336687183 +0000 UTC m=+163.203988959 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vps65" (UID: "fe017135-8f68-479f-971d-ebe27c7b45ff") : secret "networking-console-plugin-cert" not found Jul 20 19:23:50.337187 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:23:50.336712 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls podName:e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1 nodeName:}" failed. No retries permitted until 2026-07-20 19:24:54.336706475 +0000 UTC m=+163.204008252 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls") pod "image-registry-6fc756966-dzrkz" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1") : secret "image-registry-tls" not found Jul 20 19:23:54.167407 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:23:54.167369 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-97m6z" Jul 20 19:24:21.562687 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:24:21.562624 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:24:21.563185 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:21.562786 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 19:24:21.563185 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:21.562900 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs podName:b0449b8a-9354-485d-9abb-18111650b435 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:23.562884093 +0000 UTC m=+252.430185867 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs") pod "network-metrics-daemon-qdtm4" (UID: "b0449b8a-9354-485d-9abb-18111650b435") : secret "metrics-daemon-secret" not found Jul 20 19:24:49.451750 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:49.451700 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" podUID="fe017135-8f68-479f-971d-ebe27c7b45ff" Jul 20 19:24:49.459932 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:49.459881 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" podUID="e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" Jul 20 19:24:49.479362 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:49.479315 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-98l6w" podUID="a2f70b15-063d-4c64-a98f-b354db566a4a" Jul 20 19:24:49.894226 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:49.894175 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:24:50.365872 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:24:50.365841 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:24:50.366086 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:24:50.365840 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98l6w" Jul 20 19:24:50.366086 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:24:50.365841 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:24:54.404547 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:24:54.404503 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:24:54.404966 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:24:54.404564 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:24:54.404966 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:24:54.404594 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:24:54.404966 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:54.404673 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:24:54.404966 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:54.404698 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fc756966-dzrkz: secret "image-registry-tls" not found Jul 20 19:24:54.404966 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:54.404705 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:24:54.404966 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:54.404680 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:24:54.404966 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:54.404759 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls podName:e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:56.404742927 +0000 UTC m=+285.272044700 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls") pod "image-registry-6fc756966-dzrkz" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1") : secret "image-registry-tls" not found Jul 20 19:24:54.404966 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:54.404781 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert podName:fe017135-8f68-479f-971d-ebe27c7b45ff nodeName:}" failed. No retries permitted until 2026-07-20 19:26:56.404765833 +0000 UTC m=+285.272067607 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vps65" (UID: "fe017135-8f68-479f-971d-ebe27c7b45ff") : secret "networking-console-plugin-cert" not found Jul 20 19:24:54.404966 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:24:54.404794 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls podName:a2f70b15-063d-4c64-a98f-b354db566a4a nodeName:}" failed. No retries permitted until 2026-07-20 19:26:56.404788087 +0000 UTC m=+285.272089861 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls") pod "dns-default-98l6w" (UID: "a2f70b15-063d-4c64-a98f-b354db566a4a") : secret "dns-default-metrics-tls" not found Jul 20 19:25:00.880046 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:25:00.879991 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:26:23.638506 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:23.638460 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:26:23.638986 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:23.638586 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 19:26:23.638986 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:23.638649 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs podName:b0449b8a-9354-485d-9abb-18111650b435 nodeName:}" failed. No retries permitted until 2026-07-20 19:28:25.638632596 +0000 UTC m=+374.505934369 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs") pod "network-metrics-daemon-qdtm4" (UID: "b0449b8a-9354-485d-9abb-18111650b435") : secret "metrics-daemon-secret" not found Jul 20 19:26:31.444463 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.444414 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw"] Jul 20 19:26:31.446739 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.446712 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" Jul 20 19:26:31.449706 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.449679 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 20 19:26:31.450899 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.450868 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:26:31.451035 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.450876 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rhpgz\"" Jul 20 19:26:31.451035 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.450875 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 20 19:26:31.451035 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.450917 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 20 19:26:31.465948 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.465919 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8"] Jul 20 19:26:31.467960 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.467925 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw"] Jul 20 19:26:31.468100 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.467998 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" Jul 20 19:26:31.471312 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.471272 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 20 19:26:31.471466 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.471435 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 20 19:26:31.471540 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.471507 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 20 19:26:31.471596 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.471538 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4qfs7\"" Jul 20 19:26:31.472068 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.472053 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:26:31.479721 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.479693 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8"] Jul 20 19:26:31.496503 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.496467 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vksxh"] Jul 20 19:26:31.498498 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.498480 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vksxh" Jul 20 19:26:31.501094 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.501054 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 20 19:26:31.501256 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.501115 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hdm5k\"" Jul 20 19:26:31.501256 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.501249 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:26:31.508550 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.508517 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vksxh"] Jul 20 19:26:31.533273 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.533236 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-68drw"] Jul 20 19:26:31.535267 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.535245 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-68drw" Jul 20 19:26:31.537857 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.537825 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-846958b6c8-gnqdc"] Jul 20 19:26:31.539861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.539833 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-w2shv\"" Jul 20 19:26:31.540070 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.540052 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc"] Jul 20 19:26:31.540182 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.540169 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.542416 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.542393 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:31.543884 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.543861 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 20 19:26:31.545220 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.545202 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 20 19:26:31.546032 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.546013 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 19:26:31.546133 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.546048 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 19:26:31.546133 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.546118 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 20 19:26:31.546365 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.546350 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 20 19:26:31.546542 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.546528 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 20 19:26:31.547185 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.547169 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 20 19:26:31.547185 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.547180 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 19:26:31.547323 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.547184 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r9lpj\"" Jul 20 19:26:31.547323 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.547219 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4hzm2\"" Jul 20 19:26:31.551666 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.551640 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-68drw"] Jul 20 19:26:31.553073 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.553049 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 19:26:31.554990 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.554934 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc"] Jul 20 19:26:31.560692 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.560663 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-846958b6c8-gnqdc"] Jul 20 19:26:31.601997 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.601963 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfgqr\" (UniqueName: \"kubernetes.io/projected/79bfcd7c-58d2-4ab1-82e3-cc3786d8edde-kube-api-access-dfgqr\") pod \"kube-storage-version-migrator-operator-7658d9b749-p9chw\" (UID: \"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" Jul 20 19:26:31.602191 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.602056 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79bfcd7c-58d2-4ab1-82e3-cc3786d8edde-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-p9chw\" (UID: \"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" Jul 20 19:26:31.602191 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.602087 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6aefb65-64cd-43ee-9e25-12c2445da0a1-serving-cert\") pod \"service-ca-operator-5bcbc94c78-c6xg8\" (UID: \"b6aefb65-64cd-43ee-9e25-12c2445da0a1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" Jul 20 19:26:31.602191 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.602115 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w8l4\" (UniqueName: \"kubernetes.io/projected/906d399f-cf3a-4f34-bee4-a6dea5614606-kube-api-access-8w8l4\") pod \"volume-data-source-validator-78cf4c6f6-vksxh\" (UID: \"906d399f-cf3a-4f34-bee4-a6dea5614606\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vksxh" Jul 20 19:26:31.602344 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.602205 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79bfcd7c-58d2-4ab1-82e3-cc3786d8edde-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-p9chw\" (UID: \"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" Jul 20 19:26:31.602344 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.602235 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw6sq\" (UniqueName: \"kubernetes.io/projected/b6aefb65-64cd-43ee-9e25-12c2445da0a1-kube-api-access-tw6sq\") pod \"service-ca-operator-5bcbc94c78-c6xg8\" (UID: \"b6aefb65-64cd-43ee-9e25-12c2445da0a1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" Jul 20 19:26:31.602344 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.602317 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6aefb65-64cd-43ee-9e25-12c2445da0a1-config\") pod \"service-ca-operator-5bcbc94c78-c6xg8\" (UID: \"b6aefb65-64cd-43ee-9e25-12c2445da0a1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" Jul 20 19:26:31.702746 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.702651 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkfdn\" (UniqueName: \"kubernetes.io/projected/7891fd62-29a5-43c0-9dd8-f492b06b980f-kube-api-access-zkfdn\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:31.702746 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.702699 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79bfcd7c-58d2-4ab1-82e3-cc3786d8edde-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-p9chw\" (UID: \"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" Jul 20 19:26:31.702746 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.702723 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw6sq\" (UniqueName: \"kubernetes.io/projected/b6aefb65-64cd-43ee-9e25-12c2445da0a1-kube-api-access-tw6sq\") pod \"service-ca-operator-5bcbc94c78-c6xg8\" (UID: \"b6aefb65-64cd-43ee-9e25-12c2445da0a1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" Jul 20 19:26:31.703026 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.702751 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7891fd62-29a5-43c0-9dd8-f492b06b980f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:31.703026 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.702778 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.703026 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.702823 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:31.703026 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.702852 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clqtk\" (UniqueName: \"kubernetes.io/projected/fffba20a-a226-4290-b265-cbc38ba86c69-kube-api-access-clqtk\") pod \"network-check-source-7bc5b6bf85-68drw\" (UID: \"fffba20a-a226-4290-b265-cbc38ba86c69\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-68drw" Jul 20 19:26:31.703026 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.702876 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79bfcd7c-58d2-4ab1-82e3-cc3786d8edde-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-p9chw\" (UID: \"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" Jul 20 19:26:31.703026 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.702954 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.703026 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.703006 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6aefb65-64cd-43ee-9e25-12c2445da0a1-serving-cert\") pod \"service-ca-operator-5bcbc94c78-c6xg8\" (UID: \"b6aefb65-64cd-43ee-9e25-12c2445da0a1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" Jul 20 19:26:31.703451 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.703030 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w8l4\" (UniqueName: \"kubernetes.io/projected/906d399f-cf3a-4f34-bee4-a6dea5614606-kube-api-access-8w8l4\") pod \"volume-data-source-validator-78cf4c6f6-vksxh\" (UID: \"906d399f-cf3a-4f34-bee4-a6dea5614606\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vksxh" Jul 20 19:26:31.703451 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.703052 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxdfc\" (UniqueName: \"kubernetes.io/projected/ecb392a6-aa16-4f23-a6c0-716ab969d05e-kube-api-access-kxdfc\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.703451 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.703074 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6aefb65-64cd-43ee-9e25-12c2445da0a1-config\") pod \"service-ca-operator-5bcbc94c78-c6xg8\" (UID: \"b6aefb65-64cd-43ee-9e25-12c2445da0a1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" Jul 20 19:26:31.703451 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.703111 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgqr\" (UniqueName: \"kubernetes.io/projected/79bfcd7c-58d2-4ab1-82e3-cc3786d8edde-kube-api-access-dfgqr\") pod \"kube-storage-version-migrator-operator-7658d9b749-p9chw\" (UID: \"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" Jul 20 19:26:31.703451 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.703250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-default-certificate\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.703451 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.703290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-stats-auth\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.703451 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.703411 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79bfcd7c-58d2-4ab1-82e3-cc3786d8edde-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-p9chw\" (UID: \"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" Jul 20 19:26:31.703826 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.703806 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6aefb65-64cd-43ee-9e25-12c2445da0a1-config\") pod \"service-ca-operator-5bcbc94c78-c6xg8\" (UID: \"b6aefb65-64cd-43ee-9e25-12c2445da0a1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" Jul 20 19:26:31.705028 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.705006 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79bfcd7c-58d2-4ab1-82e3-cc3786d8edde-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-p9chw\" (UID: \"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" Jul 20 19:26:31.705238 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.705222 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6aefb65-64cd-43ee-9e25-12c2445da0a1-serving-cert\") pod \"service-ca-operator-5bcbc94c78-c6xg8\" (UID: \"b6aefb65-64cd-43ee-9e25-12c2445da0a1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" Jul 20 19:26:31.711602 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.711569 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfgqr\" (UniqueName: \"kubernetes.io/projected/79bfcd7c-58d2-4ab1-82e3-cc3786d8edde-kube-api-access-dfgqr\") pod \"kube-storage-version-migrator-operator-7658d9b749-p9chw\" (UID: \"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" Jul 20 19:26:31.711831 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.711809 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w8l4\" (UniqueName: \"kubernetes.io/projected/906d399f-cf3a-4f34-bee4-a6dea5614606-kube-api-access-8w8l4\") pod \"volume-data-source-validator-78cf4c6f6-vksxh\" (UID: \"906d399f-cf3a-4f34-bee4-a6dea5614606\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vksxh" Jul 20 19:26:31.713383 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.713358 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw6sq\" (UniqueName: \"kubernetes.io/projected/b6aefb65-64cd-43ee-9e25-12c2445da0a1-kube-api-access-tw6sq\") pod \"service-ca-operator-5bcbc94c78-c6xg8\" (UID: \"b6aefb65-64cd-43ee-9e25-12c2445da0a1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" Jul 20 19:26:31.756533 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.756465 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" Jul 20 19:26:31.777395 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.777360 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" Jul 20 19:26:31.804166 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.804111 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7891fd62-29a5-43c0-9dd8-f492b06b980f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:31.804398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.804174 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.804398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.804229 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:31.804398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.804261 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clqtk\" (UniqueName: \"kubernetes.io/projected/fffba20a-a226-4290-b265-cbc38ba86c69-kube-api-access-clqtk\") pod \"network-check-source-7bc5b6bf85-68drw\" (UID: \"fffba20a-a226-4290-b265-cbc38ba86c69\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-68drw" Jul 20 19:26:31.804398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.804337 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.804398 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:31.804369 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle podName:ecb392a6-aa16-4f23-a6c0-716ab969d05e nodeName:}" failed. No retries permitted until 2026-07-20 19:26:32.304347123 +0000 UTC m=+261.171648918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle") pod "router-default-846958b6c8-gnqdc" (UID: "ecb392a6-aa16-4f23-a6c0-716ab969d05e") : configmap references non-existent config key: service-ca.crt Jul 20 19:26:31.804735 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.804420 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxdfc\" (UniqueName: \"kubernetes.io/projected/ecb392a6-aa16-4f23-a6c0-716ab969d05e-kube-api-access-kxdfc\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.804735 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:31.804451 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 19:26:31.804735 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.804461 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-default-certificate\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.804735 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.804484 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-stats-auth\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.804980 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:31.804957 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:31.805243 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.805209 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkfdn\" (UniqueName: \"kubernetes.io/projected/7891fd62-29a5-43c0-9dd8-f492b06b980f-kube-api-access-zkfdn\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:31.806066 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:31.805360 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls podName:7891fd62-29a5-43c0-9dd8-f492b06b980f nodeName:}" failed. No retries permitted until 2026-07-20 19:26:32.305336057 +0000 UTC m=+261.172637844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-96ddc" (UID: "7891fd62-29a5-43c0-9dd8-f492b06b980f") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:31.806066 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:31.805492 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs podName:ecb392a6-aa16-4f23-a6c0-716ab969d05e nodeName:}" failed. No retries permitted until 2026-07-20 19:26:32.305465415 +0000 UTC m=+261.172767203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs") pod "router-default-846958b6c8-gnqdc" (UID: "ecb392a6-aa16-4f23-a6c0-716ab969d05e") : secret "router-metrics-certs-default" not found Jul 20 19:26:31.806642 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.806433 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7891fd62-29a5-43c0-9dd8-f492b06b980f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:31.814082 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.808697 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vksxh" Jul 20 19:26:31.814082 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.811189 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-default-certificate\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.815928 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.815397 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-stats-auth\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.819512 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.819389 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxdfc\" (UniqueName: \"kubernetes.io/projected/ecb392a6-aa16-4f23-a6c0-716ab969d05e-kube-api-access-kxdfc\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:31.820359 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.820268 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkfdn\" (UniqueName: \"kubernetes.io/projected/7891fd62-29a5-43c0-9dd8-f492b06b980f-kube-api-access-zkfdn\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:31.823104 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.823077 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clqtk\" (UniqueName: \"kubernetes.io/projected/fffba20a-a226-4290-b265-cbc38ba86c69-kube-api-access-clqtk\") pod \"network-check-source-7bc5b6bf85-68drw\" (UID: \"fffba20a-a226-4290-b265-cbc38ba86c69\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-68drw" Jul 20 19:26:31.846475 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.846433 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-68drw" Jul 20 19:26:31.917494 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.917457 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw"] Jul 20 19:26:31.926735 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:26:31.926691 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bfcd7c_58d2_4ab1_82e3_cc3786d8edde.slice/crio-4d3bad4a40bd2848303ea9c60ddc19a4f2d1201051132861b36b4729fb8c6d5f WatchSource:0}: Error finding container 4d3bad4a40bd2848303ea9c60ddc19a4f2d1201051132861b36b4729fb8c6d5f: Status 404 returned error can't find the container with id 4d3bad4a40bd2848303ea9c60ddc19a4f2d1201051132861b36b4729fb8c6d5f Jul 20 19:26:31.952442 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.952268 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8"] Jul 20 19:26:31.956970 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:26:31.956934 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6aefb65_64cd_43ee_9e25_12c2445da0a1.slice/crio-7e6e0300b774a80432b3146464b0c0cfa87ad495eeaffdcb1a392ed265813729 WatchSource:0}: Error finding container 7e6e0300b774a80432b3146464b0c0cfa87ad495eeaffdcb1a392ed265813729: Status 404 returned error can't find the container with id 7e6e0300b774a80432b3146464b0c0cfa87ad495eeaffdcb1a392ed265813729 Jul 20 19:26:31.983239 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:31.983195 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vksxh"] Jul 20 19:26:31.986777 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:26:31.986748 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906d399f_cf3a_4f34_bee4_a6dea5614606.slice/crio-9d10bd4d3f19175a346385ba2f82c5f495d73b289a94035a79c64619e51f4c13 WatchSource:0}: Error finding container 9d10bd4d3f19175a346385ba2f82c5f495d73b289a94035a79c64619e51f4c13: Status 404 returned error can't find the container with id 9d10bd4d3f19175a346385ba2f82c5f495d73b289a94035a79c64619e51f4c13 Jul 20 19:26:32.004920 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:32.004886 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-68drw"] Jul 20 19:26:32.008934 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:26:32.008905 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffba20a_a226_4290_b265_cbc38ba86c69.slice/crio-0d8da42448f17f97fcdb4d92d6da0740b4b9839d20f9bb44097f1f7984a0919a WatchSource:0}: Error finding container 0d8da42448f17f97fcdb4d92d6da0740b4b9839d20f9bb44097f1f7984a0919a: Status 404 returned error can't find the container with id 0d8da42448f17f97fcdb4d92d6da0740b4b9839d20f9bb44097f1f7984a0919a Jul 20 19:26:32.309676 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:32.309641 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:32.309880 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:32.309758 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:32.309880 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:32.309794 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 19:26:32.309880 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:32.309801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:32.309880 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:32.309864 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs podName:ecb392a6-aa16-4f23-a6c0-716ab969d05e nodeName:}" failed. No retries permitted until 2026-07-20 19:26:33.309844365 +0000 UTC m=+262.177146148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs") pod "router-default-846958b6c8-gnqdc" (UID: "ecb392a6-aa16-4f23-a6c0-716ab969d05e") : secret "router-metrics-certs-default" not found Jul 20 19:26:32.309880 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:32.309883 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle podName:ecb392a6-aa16-4f23-a6c0-716ab969d05e nodeName:}" failed. No retries permitted until 2026-07-20 19:26:33.309874293 +0000 UTC m=+262.177176080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle") pod "router-default-846958b6c8-gnqdc" (UID: "ecb392a6-aa16-4f23-a6c0-716ab969d05e") : configmap references non-existent config key: service-ca.crt Jul 20 19:26:32.310082 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:32.309891 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:32.310082 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:32.309920 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls podName:7891fd62-29a5-43c0-9dd8-f492b06b980f nodeName:}" failed. No retries permitted until 2026-07-20 19:26:33.309912016 +0000 UTC m=+262.177213788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-96ddc" (UID: "7891fd62-29a5-43c0-9dd8-f492b06b980f") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:32.615364 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:32.615226 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" event={"ID":"b6aefb65-64cd-43ee-9e25-12c2445da0a1","Type":"ContainerStarted","Data":"7e6e0300b774a80432b3146464b0c0cfa87ad495eeaffdcb1a392ed265813729"} Jul 20 19:26:32.617641 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:32.617603 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" event={"ID":"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde","Type":"ContainerStarted","Data":"4d3bad4a40bd2848303ea9c60ddc19a4f2d1201051132861b36b4729fb8c6d5f"} Jul 20 19:26:32.620547 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:32.620449 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-68drw" event={"ID":"fffba20a-a226-4290-b265-cbc38ba86c69","Type":"ContainerStarted","Data":"dcf66000430790250cc817731ec15c4880273aa53f21bdb7f47731ec974d72c5"} Jul 20 19:26:32.620547 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:32.620513 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-68drw" event={"ID":"fffba20a-a226-4290-b265-cbc38ba86c69","Type":"ContainerStarted","Data":"0d8da42448f17f97fcdb4d92d6da0740b4b9839d20f9bb44097f1f7984a0919a"} Jul 20 19:26:32.622635 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:32.622555 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vksxh" event={"ID":"906d399f-cf3a-4f34-bee4-a6dea5614606","Type":"ContainerStarted","Data":"9d10bd4d3f19175a346385ba2f82c5f495d73b289a94035a79c64619e51f4c13"} Jul 20 19:26:32.640024 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:32.639570 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-68drw" podStartSLOduration=1.639547037 podStartE2EDuration="1.639547037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:32.638237745 +0000 UTC m=+261.505539540" watchObservedRunningTime="2026-07-20 19:26:32.639547037 +0000 UTC m=+261.506848813" Jul 20 19:26:33.320383 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:33.320349 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:33.320488 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:33.320439 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:33.320547 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:33.320489 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:33.320547 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:33.320518 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle podName:ecb392a6-aa16-4f23-a6c0-716ab969d05e nodeName:}" failed. No retries permitted until 2026-07-20 19:26:35.320492517 +0000 UTC m=+264.187794308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle") pod "router-default-846958b6c8-gnqdc" (UID: "ecb392a6-aa16-4f23-a6c0-716ab969d05e") : configmap references non-existent config key: service-ca.crt Jul 20 19:26:33.320658 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:33.320579 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 19:26:33.320658 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:33.320607 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:33.320658 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:33.320631 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs podName:ecb392a6-aa16-4f23-a6c0-716ab969d05e nodeName:}" failed. No retries permitted until 2026-07-20 19:26:35.320614433 +0000 UTC m=+264.187916209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs") pod "router-default-846958b6c8-gnqdc" (UID: "ecb392a6-aa16-4f23-a6c0-716ab969d05e") : secret "router-metrics-certs-default" not found Jul 20 19:26:33.320658 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:33.320659 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls podName:7891fd62-29a5-43c0-9dd8-f492b06b980f nodeName:}" failed. No retries permitted until 2026-07-20 19:26:35.320646955 +0000 UTC m=+264.187948728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-96ddc" (UID: "7891fd62-29a5-43c0-9dd8-f492b06b980f") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:33.627210 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:33.627109 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vksxh" event={"ID":"906d399f-cf3a-4f34-bee4-a6dea5614606","Type":"ContainerStarted","Data":"523ee8f5424f3acf258a3e25c2161ac95aa69bd2cbf205285eaf404928e3fbe3"} Jul 20 19:26:33.648909 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:33.648839 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vksxh" podStartSLOduration=1.33612921 podStartE2EDuration="2.648818592s" totalImagesPullingTime="1.312689382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:33.64773624 +0000 UTC m=+262.515038047" watchObservedRunningTime="2026-07-20 19:26:33.648818592 +0000 UTC m=+262.516120389" Jul 20 19:26:35.336915 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:35.336873 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:35.337420 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:35.336935 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:35.337420 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:35.336979 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:35.337420 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:35.337113 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 19:26:35.337420 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:35.337114 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle podName:ecb392a6-aa16-4f23-a6c0-716ab969d05e nodeName:}" failed. No retries permitted until 2026-07-20 19:26:39.337090492 +0000 UTC m=+268.204392270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle") pod "router-default-846958b6c8-gnqdc" (UID: "ecb392a6-aa16-4f23-a6c0-716ab969d05e") : configmap references non-existent config key: service-ca.crt Jul 20 19:26:35.337420 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:35.337113 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:35.337420 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:35.337185 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs podName:ecb392a6-aa16-4f23-a6c0-716ab969d05e nodeName:}" failed. No retries permitted until 2026-07-20 19:26:39.337158476 +0000 UTC m=+268.204460256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs") pod "router-default-846958b6c8-gnqdc" (UID: "ecb392a6-aa16-4f23-a6c0-716ab969d05e") : secret "router-metrics-certs-default" not found Jul 20 19:26:35.337420 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:35.337238 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls podName:7891fd62-29a5-43c0-9dd8-f492b06b980f nodeName:}" failed. No retries permitted until 2026-07-20 19:26:39.337226095 +0000 UTC m=+268.204527870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-96ddc" (UID: "7891fd62-29a5-43c0-9dd8-f492b06b980f") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:35.635434 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:35.635331 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" event={"ID":"b6aefb65-64cd-43ee-9e25-12c2445da0a1","Type":"ContainerStarted","Data":"d9154ce2a1b72b603e618111c72a4e5389e67306fce276ed92ab69e2185d8ab8"} Jul 20 19:26:35.636862 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:35.636824 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" event={"ID":"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde","Type":"ContainerStarted","Data":"2337d51eb81b8fce22ef37a0e4ecee231a4ee736c65a350dcb96db74fa861ea5"} Jul 20 19:26:35.660656 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:35.660564 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" podStartSLOduration=1.8907496080000001 podStartE2EDuration="4.66053927s" totalImagesPullingTime="2.769789662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:35.660532042 +0000 UTC m=+264.527833838" watchObservedRunningTime="2026-07-20 19:26:35.66053927 +0000 UTC m=+264.527841066" Jul 20 19:26:36.413064 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.413003 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" podStartSLOduration=2.615028798 podStartE2EDuration="5.412983485s" totalImagesPullingTime="2.797954687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:35.691643721 +0000 UTC m=+264.558945516" watchObservedRunningTime="2026-07-20 19:26:36.412983485 +0000 UTC m=+265.280285310" Jul 20 19:26:36.413588 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.413536 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cm822"] Jul 20 19:26:36.416174 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.416150 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.418655 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.418633 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6cgzv\"" Jul 20 19:26:36.418939 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.418920 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 19:26:36.419619 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.419603 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 19:26:36.421733 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.421710 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 19:26:36.423173 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.423154 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 19:26:36.494272 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.494235 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cm822"] Jul 20 19:26:36.549205 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.549169 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.549407 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.549208 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-crio-socket\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.549407 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.549228 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-data-volume\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.549407 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.549315 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.549569 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.549442 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcsjl\" (UniqueName: \"kubernetes.io/projected/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-kube-api-access-bcsjl\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.650808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.650768 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.650808 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.650808 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-crio-socket\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.651038 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.650825 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-data-volume\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.651038 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.650868 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.651038 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:36.650896 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 19:26:36.651038 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.650909 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcsjl\" (UniqueName: \"kubernetes.io/projected/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-kube-api-access-bcsjl\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.651038 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.650899 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-crio-socket\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.651038 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:36.650993 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-kube-rbac-proxy-cm podName:c62deffc-5bfc-4ad1-b566-2f6d8a201bb1 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:37.150974253 +0000 UTC m=+266.018276032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cm822" (UID: "c62deffc-5bfc-4ad1-b566-2f6d8a201bb1") : configmap "kube-rbac-proxy" not found Jul 20 19:26:36.651038 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:36.651020 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:26:36.651252 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:36.651073 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls podName:c62deffc-5bfc-4ad1-b566-2f6d8a201bb1 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:37.151060567 +0000 UTC m=+266.018362353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cm822" (UID: "c62deffc-5bfc-4ad1-b566-2f6d8a201bb1") : secret "insights-runtime-extractor-tls" not found Jul 20 19:26:36.651252 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.651194 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-data-volume\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:36.661347 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:36.661314 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcsjl\" (UniqueName: \"kubernetes.io/projected/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-kube-api-access-bcsjl\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:37.155386 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:37.155343 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:37.155570 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:37.155507 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:26:37.155570 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:37.155526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:37.155663 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:37.155592 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls podName:c62deffc-5bfc-4ad1-b566-2f6d8a201bb1 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:38.15557456 +0000 UTC m=+267.022876337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cm822" (UID: "c62deffc-5bfc-4ad1-b566-2f6d8a201bb1") : secret "insights-runtime-extractor-tls" not found Jul 20 19:26:37.156154 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:37.156134 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:38.165493 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.165441 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:38.165951 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:38.165598 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:26:38.165951 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:38.165663 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls podName:c62deffc-5bfc-4ad1-b566-2f6d8a201bb1 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:40.165647061 +0000 UTC m=+269.032948835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cm822" (UID: "c62deffc-5bfc-4ad1-b566-2f6d8a201bb1") : secret "insights-runtime-extractor-tls" not found Jul 20 19:26:38.571883 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.571857 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5n9q_7cea5b32-464e-4339-b801-21ec0cc7358c/dns-node-resolver/0.log" Jul 20 19:26:38.841864 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.841766 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-r5dbv"] Jul 20 19:26:38.844234 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.844212 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-r5dbv" Jul 20 19:26:38.848906 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.848876 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 20 19:26:38.849049 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.848930 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 20 19:26:38.850185 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.850162 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 20 19:26:38.850317 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.850251 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 20 19:26:38.850317 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.850263 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mm8jm\"" Jul 20 19:26:38.856437 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.856409 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-r5dbv"] Jul 20 19:26:38.971701 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.971653 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2044f427-4bee-4fdc-84f5-424553ffef2b-signing-key\") pod \"service-ca-58598695f7-r5dbv\" (UID: \"2044f427-4bee-4fdc-84f5-424553ffef2b\") " pod="openshift-service-ca/service-ca-58598695f7-r5dbv" Jul 20 19:26:38.971948 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.971731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2044f427-4bee-4fdc-84f5-424553ffef2b-signing-cabundle\") pod \"service-ca-58598695f7-r5dbv\" (UID: \"2044f427-4bee-4fdc-84f5-424553ffef2b\") " pod="openshift-service-ca/service-ca-58598695f7-r5dbv" Jul 20 19:26:38.971948 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:38.971775 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxflz\" (UniqueName: \"kubernetes.io/projected/2044f427-4bee-4fdc-84f5-424553ffef2b-kube-api-access-qxflz\") pod \"service-ca-58598695f7-r5dbv\" (UID: \"2044f427-4bee-4fdc-84f5-424553ffef2b\") " pod="openshift-service-ca/service-ca-58598695f7-r5dbv" Jul 20 19:26:39.072269 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.072221 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2044f427-4bee-4fdc-84f5-424553ffef2b-signing-key\") pod \"service-ca-58598695f7-r5dbv\" (UID: \"2044f427-4bee-4fdc-84f5-424553ffef2b\") " pod="openshift-service-ca/service-ca-58598695f7-r5dbv" Jul 20 19:26:39.072494 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.072344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2044f427-4bee-4fdc-84f5-424553ffef2b-signing-cabundle\") pod \"service-ca-58598695f7-r5dbv\" (UID: \"2044f427-4bee-4fdc-84f5-424553ffef2b\") " pod="openshift-service-ca/service-ca-58598695f7-r5dbv" Jul 20 19:26:39.072494 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.072373 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxflz\" (UniqueName: \"kubernetes.io/projected/2044f427-4bee-4fdc-84f5-424553ffef2b-kube-api-access-qxflz\") pod \"service-ca-58598695f7-r5dbv\" (UID: \"2044f427-4bee-4fdc-84f5-424553ffef2b\") " pod="openshift-service-ca/service-ca-58598695f7-r5dbv" Jul 20 19:26:39.073069 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.073045 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2044f427-4bee-4fdc-84f5-424553ffef2b-signing-cabundle\") pod \"service-ca-58598695f7-r5dbv\" (UID: \"2044f427-4bee-4fdc-84f5-424553ffef2b\") " pod="openshift-service-ca/service-ca-58598695f7-r5dbv" Jul 20 19:26:39.074809 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.074787 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2044f427-4bee-4fdc-84f5-424553ffef2b-signing-key\") pod \"service-ca-58598695f7-r5dbv\" (UID: \"2044f427-4bee-4fdc-84f5-424553ffef2b\") " pod="openshift-service-ca/service-ca-58598695f7-r5dbv" Jul 20 19:26:39.084242 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.084207 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxflz\" (UniqueName: \"kubernetes.io/projected/2044f427-4bee-4fdc-84f5-424553ffef2b-kube-api-access-qxflz\") pod \"service-ca-58598695f7-r5dbv\" (UID: \"2044f427-4bee-4fdc-84f5-424553ffef2b\") " pod="openshift-service-ca/service-ca-58598695f7-r5dbv" Jul 20 19:26:39.154459 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.154383 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-r5dbv" Jul 20 19:26:39.293933 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.293894 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-r5dbv"] Jul 20 19:26:39.296964 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:26:39.296931 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2044f427_4bee_4fdc_84f5_424553ffef2b.slice/crio-29a9d8b79bcba591c25670e3949ad66add944575d78d2507ffdee117603b2011 WatchSource:0}: Error finding container 29a9d8b79bcba591c25670e3949ad66add944575d78d2507ffdee117603b2011: Status 404 returned error can't find the container with id 29a9d8b79bcba591c25670e3949ad66add944575d78d2507ffdee117603b2011 Jul 20 19:26:39.373845 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.373812 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-982g9_3b6c6f66-551a-4197-804f-77db8a93bde9/node-ca/0.log" Jul 20 19:26:39.376165 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.376133 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:39.376327 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.376192 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:39.376327 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.376239 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:39.376327 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:39.376313 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle podName:ecb392a6-aa16-4f23-a6c0-716ab969d05e nodeName:}" failed. No retries permitted until 2026-07-20 19:26:47.37627837 +0000 UTC m=+276.243580162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle") pod "router-default-846958b6c8-gnqdc" (UID: "ecb392a6-aa16-4f23-a6c0-716ab969d05e") : configmap references non-existent config key: service-ca.crt Jul 20 19:26:39.376487 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:39.376387 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:39.376487 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:39.376434 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls podName:7891fd62-29a5-43c0-9dd8-f492b06b980f nodeName:}" failed. No retries permitted until 2026-07-20 19:26:47.376422528 +0000 UTC m=+276.243724302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-96ddc" (UID: "7891fd62-29a5-43c0-9dd8-f492b06b980f") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:39.376487 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:39.376387 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 19:26:39.376487 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:39.376464 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs podName:ecb392a6-aa16-4f23-a6c0-716ab969d05e nodeName:}" failed. No retries permitted until 2026-07-20 19:26:47.376458237 +0000 UTC m=+276.243760010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs") pod "router-default-846958b6c8-gnqdc" (UID: "ecb392a6-aa16-4f23-a6c0-716ab969d05e") : secret "router-metrics-certs-default" not found Jul 20 19:26:39.654342 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.654291 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-r5dbv" event={"ID":"2044f427-4bee-4fdc-84f5-424553ffef2b","Type":"ContainerStarted","Data":"083a11f4bb16fdb50b81a9a13f1ffff1c8162ef3f494dbcf5ca7c14e45406f86"} Jul 20 19:26:39.654500 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.654381 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-r5dbv" event={"ID":"2044f427-4bee-4fdc-84f5-424553ffef2b","Type":"ContainerStarted","Data":"29a9d8b79bcba591c25670e3949ad66add944575d78d2507ffdee117603b2011"} Jul 20 19:26:39.682224 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:39.682170 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-r5dbv" podStartSLOduration=1.6821537100000001 podStartE2EDuration="1.68215371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:39.680469941 +0000 UTC m=+268.547771734" watchObservedRunningTime="2026-07-20 19:26:39.68215371 +0000 UTC m=+268.549455505" Jul 20 19:26:40.183599 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:40.183553 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:40.183811 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:40.183713 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:26:40.183811 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:40.183799 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls podName:c62deffc-5bfc-4ad1-b566-2f6d8a201bb1 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:44.183780548 +0000 UTC m=+273.051082324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cm822" (UID: "c62deffc-5bfc-4ad1-b566-2f6d8a201bb1") : secret "insights-runtime-extractor-tls" not found Jul 20 19:26:40.458557 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:40.458477 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ts6j5_f6f87434-3b09-4f00-be21-45bde7552fe4/serve-healthcheck-canary/0.log" Jul 20 19:26:44.222842 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:44.222801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:44.223409 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:44.222995 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:26:44.223409 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:44.223116 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls podName:c62deffc-5bfc-4ad1-b566-2f6d8a201bb1 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:52.223091398 +0000 UTC m=+281.090393187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cm822" (UID: "c62deffc-5bfc-4ad1-b566-2f6d8a201bb1") : secret "insights-runtime-extractor-tls" not found Jul 20 19:26:47.452705 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:47.452656 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:47.453183 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:47.452798 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:26:47.453183 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:47.452832 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:47.453183 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:47.452944 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:47.453183 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:47.453020 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls podName:7891fd62-29a5-43c0-9dd8-f492b06b980f nodeName:}" failed. No retries permitted until 2026-07-20 19:27:03.453004083 +0000 UTC m=+292.320305856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-96ddc" (UID: "7891fd62-29a5-43c0-9dd8-f492b06b980f") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:26:47.453430 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:47.453279 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb392a6-aa16-4f23-a6c0-716ab969d05e-service-ca-bundle\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:47.455256 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:47.455228 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb392a6-aa16-4f23-a6c0-716ab969d05e-metrics-certs\") pod \"router-default-846958b6c8-gnqdc\" (UID: \"ecb392a6-aa16-4f23-a6c0-716ab969d05e\") " pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:47.752972 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:47.752863 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:47.908500 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:47.908463 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-846958b6c8-gnqdc"] Jul 20 19:26:47.912220 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:26:47.912184 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb392a6_aa16_4f23_a6c0_716ab969d05e.slice/crio-50c5d5da415cdf54dfc93afd1f163ec962e6daa8e7343e21d9ca37dc18cd4980 WatchSource:0}: Error finding container 50c5d5da415cdf54dfc93afd1f163ec962e6daa8e7343e21d9ca37dc18cd4980: Status 404 returned error can't find the container with id 50c5d5da415cdf54dfc93afd1f163ec962e6daa8e7343e21d9ca37dc18cd4980 Jul 20 19:26:48.686536 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:48.686495 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-846958b6c8-gnqdc" event={"ID":"ecb392a6-aa16-4f23-a6c0-716ab969d05e","Type":"ContainerStarted","Data":"c43ee45153fb58143eccf2cd8508ff32c7740bd3560f67be280cb890d65b583f"} Jul 20 19:26:48.687037 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:48.686557 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-846958b6c8-gnqdc" event={"ID":"ecb392a6-aa16-4f23-a6c0-716ab969d05e","Type":"ContainerStarted","Data":"50c5d5da415cdf54dfc93afd1f163ec962e6daa8e7343e21d9ca37dc18cd4980"} Jul 20 19:26:48.709912 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:48.709852 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-846958b6c8-gnqdc" podStartSLOduration=17.709836555 podStartE2EDuration="17.709836555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:48.708254592 +0000 UTC m=+277.575556387" watchObservedRunningTime="2026-07-20 19:26:48.709836555 +0000 UTC m=+277.577138350" Jul 20 19:26:48.753916 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:48.753880 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:48.756389 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:48.756357 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:49.689449 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:49.689414 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:49.690764 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:49.690740 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-846958b6c8-gnqdc" Jul 20 19:26:52.292028 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:52.291983 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:52.294458 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:52.294425 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62deffc-5bfc-4ad1-b566-2f6d8a201bb1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm822\" (UID: \"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1\") " pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:52.325447 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:52.325408 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cm822" Jul 20 19:26:52.463672 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:52.463632 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cm822"] Jul 20 19:26:52.467013 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:26:52.466976 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62deffc_5bfc_4ad1_b566_2f6d8a201bb1.slice/crio-fcf7933371b77a07f595b69eea95e2ac5bb58009c74910f2a17043c7a31d35d9 WatchSource:0}: Error finding container fcf7933371b77a07f595b69eea95e2ac5bb58009c74910f2a17043c7a31d35d9: Status 404 returned error can't find the container with id fcf7933371b77a07f595b69eea95e2ac5bb58009c74910f2a17043c7a31d35d9 Jul 20 19:26:52.699726 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:52.699633 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cm822" event={"ID":"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1","Type":"ContainerStarted","Data":"fcf7933371b77a07f595b69eea95e2ac5bb58009c74910f2a17043c7a31d35d9"} Jul 20 19:26:53.367115 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:53.367069 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" podUID="fe017135-8f68-479f-971d-ebe27c7b45ff" Jul 20 19:26:53.367617 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:53.367069 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" podUID="e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" Jul 20 19:26:53.367617 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:26:53.367069 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-98l6w" podUID="a2f70b15-063d-4c64-a98f-b354db566a4a" Jul 20 19:26:53.703265 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:53.703181 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98l6w" Jul 20 19:26:53.703437 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:53.703181 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:26:53.703437 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:53.703195 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:26:56.432845 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.432802 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:26:56.433305 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.432856 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:26:56.433305 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.432905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:26:56.435793 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.435759 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe017135-8f68-479f-971d-ebe27c7b45ff-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vps65\" (UID: \"fe017135-8f68-479f-971d-ebe27c7b45ff\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:26:56.435931 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.435871 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2f70b15-063d-4c64-a98f-b354db566a4a-metrics-tls\") pod \"dns-default-98l6w\" (UID: \"a2f70b15-063d-4c64-a98f-b354db566a4a\") " pod="openshift-dns/dns-default-98l6w" Jul 20 19:26:56.436101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.436067 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"image-registry-6fc756966-dzrkz\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:26:56.708832 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.708749 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t6cd6\"" Jul 20 19:26:56.708832 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.708775 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bsgbb\"" Jul 20 19:26:56.708832 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.708750 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lct99\"" Jul 20 19:26:56.714041 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.714012 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" Jul 20 19:26:56.714218 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.714079 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98l6w" Jul 20 19:26:56.714218 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:56.714141 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:26:57.637112 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:57.637050 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-98l6w"] Jul 20 19:26:57.641087 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:26:57.641047 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f70b15_063d_4c64_a98f_b354db566a4a.slice/crio-e8e64b8a654e76193ceff7df225a11dad40b803654408c162e208f319f70bc61 WatchSource:0}: Error finding container e8e64b8a654e76193ceff7df225a11dad40b803654408c162e208f319f70bc61: Status 404 returned error can't find the container with id e8e64b8a654e76193ceff7df225a11dad40b803654408c162e208f319f70bc61 Jul 20 19:26:57.662629 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:57.662595 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-vps65"] Jul 20 19:26:57.665844 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:26:57.665808 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe017135_8f68_479f_971d_ebe27c7b45ff.slice/crio-e50c405c3d45db0665cda9642d8920ad223f72a41d265343cc8b85b4e6041891 WatchSource:0}: Error finding container e50c405c3d45db0665cda9642d8920ad223f72a41d265343cc8b85b4e6041891: Status 404 returned error can't find the container with id e50c405c3d45db0665cda9642d8920ad223f72a41d265343cc8b85b4e6041891 Jul 20 19:26:57.672607 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:57.669478 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fc756966-dzrkz"] Jul 20 19:26:57.721006 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:57.720960 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" event={"ID":"fe017135-8f68-479f-971d-ebe27c7b45ff","Type":"ContainerStarted","Data":"e50c405c3d45db0665cda9642d8920ad223f72a41d265343cc8b85b4e6041891"} Jul 20 19:26:57.722113 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:57.722088 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98l6w" event={"ID":"a2f70b15-063d-4c64-a98f-b354db566a4a","Type":"ContainerStarted","Data":"e8e64b8a654e76193ceff7df225a11dad40b803654408c162e208f319f70bc61"} Jul 20 19:26:57.723500 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:57.723471 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cm822" event={"ID":"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1","Type":"ContainerStarted","Data":"a945cf7e3c61a458507b18d23c4a4adf1a63cf04a28e8fdac19df0e7b6168f78"} Jul 20 19:26:57.725024 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:57.725000 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" event={"ID":"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1","Type":"ContainerStarted","Data":"8dc3af1db8a22ed36674d45650b3777a9f2a542f8a7bdedc4baa325209a4cda5"} Jul 20 19:26:58.732007 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:58.731962 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" event={"ID":"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1","Type":"ContainerStarted","Data":"bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a"} Jul 20 19:26:58.732576 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:58.732556 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:26:58.757576 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:58.757521 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" podStartSLOduration=286.757499307 podStartE2EDuration="4m46.757499307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:58.756668759 +0000 UTC m=+287.623970555" watchObservedRunningTime="2026-07-20 19:26:58.757499307 +0000 UTC m=+287.624801136" Jul 20 19:26:59.737777 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:59.737725 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" event={"ID":"fe017135-8f68-479f-971d-ebe27c7b45ff","Type":"ContainerStarted","Data":"0cdd7a605fb624c3df1e1f5ae54aba15b6f638a2c539b7d5ddb86d2a7771b466"} Jul 20 19:26:59.759630 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:26:59.759569 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vps65" podStartSLOduration=285.311999803 podStartE2EDuration="4m46.759548269s" totalImagesPullingTime="1.447548466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:59.757644649 +0000 UTC m=+288.624946443" watchObservedRunningTime="2026-07-20 19:26:59.759548269 +0000 UTC m=+288.626850064" Jul 20 19:27:01.748555 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:01.748461 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98l6w" event={"ID":"a2f70b15-063d-4c64-a98f-b354db566a4a","Type":"ContainerStarted","Data":"9582dcb93f9264fe21ea573e65d9879dd03339e975eb955c2a81dd7cf2353116"} Jul 20 19:27:02.754381 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:02.754327 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cm822" event={"ID":"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1","Type":"ContainerStarted","Data":"bc1adfd5143ede725c8ecc66ac2e3b2850e06b893b63de0733f58ad1ca6324b8"} Jul 20 19:27:02.756598 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:02.756558 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98l6w" event={"ID":"a2f70b15-063d-4c64-a98f-b354db566a4a","Type":"ContainerStarted","Data":"07512e35eaf4b610b3a23e21dc6a1dd0783da0623359394d265cbfef50c5f0cf"} Jul 20 19:27:02.756756 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:02.756715 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-98l6w" Jul 20 19:27:02.780185 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:02.780116 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-98l6w" podStartSLOduration=252.790534695 podStartE2EDuration="4m16.780091925s" totalImagesPullingTime="3.98955723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:02.779251748 +0000 UTC m=+291.646553774" watchObservedRunningTime="2026-07-20 19:27:02.780091925 +0000 UTC m=+291.647393720" Jul 20 19:27:03.500213 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:03.500164 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:27:03.502907 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:03.502877 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7891fd62-29a5-43c0-9dd8-f492b06b980f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-96ddc\" (UID: \"7891fd62-29a5-43c0-9dd8-f492b06b980f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:27:03.659847 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:03.659806 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" Jul 20 19:27:03.880877 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:27:03.880822 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qdtm4" podUID="b0449b8a-9354-485d-9abb-18111650b435" Jul 20 19:27:05.462890 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:05.462857 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc"] Jul 20 19:27:05.466327 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:27:05.466278 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7891fd62_29a5_43c0_9dd8_f492b06b980f.slice/crio-a68517643a90b9c2b995fffbcff1d118431a05729bf5eeed16332df55b264f78 WatchSource:0}: Error finding container a68517643a90b9c2b995fffbcff1d118431a05729bf5eeed16332df55b264f78: Status 404 returned error can't find the container with id a68517643a90b9c2b995fffbcff1d118431a05729bf5eeed16332df55b264f78 Jul 20 19:27:05.767357 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:05.767318 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" event={"ID":"7891fd62-29a5-43c0-9dd8-f492b06b980f","Type":"ContainerStarted","Data":"a68517643a90b9c2b995fffbcff1d118431a05729bf5eeed16332df55b264f78"} Jul 20 19:27:05.769289 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:05.769257 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cm822" event={"ID":"c62deffc-5bfc-4ad1-b566-2f6d8a201bb1","Type":"ContainerStarted","Data":"9d23b160b75a75a89fc605c3807a2c67070249817d72d2cd18d9b7a7169b6f28"} Jul 20 19:27:07.777995 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:07.777952 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" event={"ID":"7891fd62-29a5-43c0-9dd8-f492b06b980f","Type":"ContainerStarted","Data":"25a318b89a61af6979cf0f0dcd23692f2d2c40cd6b86471b52114ee83b5e2d8f"} Jul 20 19:27:07.804164 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:07.804099 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-96ddc" podStartSLOduration=35.33925923 podStartE2EDuration="36.804076559s" totalImagesPullingTime="1.464817329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:07.80244901 +0000 UTC m=+296.669750808" watchObservedRunningTime="2026-07-20 19:27:07.804076559 +0000 UTC m=+296.671378357" Jul 20 19:27:07.804525 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:07.804495 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cm822" podStartSLOduration=19.091356749 podStartE2EDuration="31.804488293s" totalImagesPullingTime="12.713131544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:26:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:05.807793318 +0000 UTC m=+294.675095112" watchObservedRunningTime="2026-07-20 19:27:07.804488293 +0000 UTC m=+296.671790091" Jul 20 19:27:10.955344 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:10.955290 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-785bc57899-m2hv5"] Jul 20 19:27:11.090942 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.090900 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785bc57899-m2hv5"] Jul 20 19:27:11.091129 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.091055 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.094024 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.093995 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 19:27:11.095023 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.094930 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 19:27:11.095023 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.094986 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jspd8\"" Jul 20 19:27:11.095023 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.095005 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 19:27:11.095023 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.094989 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 19:27:11.095332 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.094986 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 19:27:11.095332 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.095058 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 19:27:11.095332 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.095176 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 19:27:11.099783 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.099750 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 19:27:11.265891 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.265858 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-oauth-config\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.266045 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.265918 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-serving-cert\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.266045 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.265985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-oauth-serving-cert\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.266045 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.266034 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhmnn\" (UniqueName: \"kubernetes.io/projected/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-kube-api-access-zhmnn\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.266150 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.266068 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-service-ca\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.266150 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.266087 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-trusted-ca-bundle\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.266150 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.266106 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-config\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.367342 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.367275 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-serving-cert\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.367506 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.367361 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-oauth-serving-cert\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.367506 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.367384 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhmnn\" (UniqueName: \"kubernetes.io/projected/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-kube-api-access-zhmnn\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.367506 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.367424 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-service-ca\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.367506 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.367453 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-trusted-ca-bundle\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.367506 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.367477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-config\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.367736 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.367512 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-oauth-config\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.368167 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.368127 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-oauth-serving-cert\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.368280 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.368217 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-service-ca\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.368410 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.368374 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-config\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.368572 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.368556 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-trusted-ca-bundle\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.369858 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.369837 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-serving-cert\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.369952 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.369910 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-oauth-config\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.386095 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.386058 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhmnn\" (UniqueName: \"kubernetes.io/projected/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-kube-api-access-zhmnn\") pod \"console-785bc57899-m2hv5\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.402128 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.402087 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:11.528365 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.528313 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-brr44"] Jul 20 19:27:11.565374 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.565335 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-brr44"] Jul 20 19:27:11.565555 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.565412 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.568270 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.568242 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 20 19:27:11.568463 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.568242 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wzqzb\"" Jul 20 19:27:11.568463 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.568424 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 19:27:11.568606 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.568589 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 20 19:27:11.577041 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.577009 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785bc57899-m2hv5"] Jul 20 19:27:11.580095 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:27:11.580050 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f70910_baa8_44e1_9a1f_53cffe16f3fa.slice/crio-68b781bd8e72d9391d4f5b9ac53255361213f42a3012dcac0572dc7e2c533f80 WatchSource:0}: Error finding container 68b781bd8e72d9391d4f5b9ac53255361213f42a3012dcac0572dc7e2c533f80: Status 404 returned error can't find the container with id 68b781bd8e72d9391d4f5b9ac53255361213f42a3012dcac0572dc7e2c533f80 Jul 20 19:27:11.641703 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.641676 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 19:27:11.669855 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.669819 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2601efb3-b6b6-48ab-8a92-fb8d6c728907-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.670032 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.669875 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx9gm\" (UniqueName: \"kubernetes.io/projected/2601efb3-b6b6-48ab-8a92-fb8d6c728907-kube-api-access-zx9gm\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.670032 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.669963 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2601efb3-b6b6-48ab-8a92-fb8d6c728907-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.670032 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.669995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2601efb3-b6b6-48ab-8a92-fb8d6c728907-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.771087 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.770985 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2601efb3-b6b6-48ab-8a92-fb8d6c728907-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.771087 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.771045 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx9gm\" (UniqueName: \"kubernetes.io/projected/2601efb3-b6b6-48ab-8a92-fb8d6c728907-kube-api-access-zx9gm\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.771327 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.771097 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2601efb3-b6b6-48ab-8a92-fb8d6c728907-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.771327 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.771123 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2601efb3-b6b6-48ab-8a92-fb8d6c728907-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.771829 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.771804 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2601efb3-b6b6-48ab-8a92-fb8d6c728907-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.773477 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.773457 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2601efb3-b6b6-48ab-8a92-fb8d6c728907-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.773549 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.773530 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2601efb3-b6b6-48ab-8a92-fb8d6c728907-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.780929 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.780896 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx9gm\" (UniqueName: \"kubernetes.io/projected/2601efb3-b6b6-48ab-8a92-fb8d6c728907-kube-api-access-zx9gm\") pod \"prometheus-operator-5945b5cfd-brr44\" (UID: \"2601efb3-b6b6-48ab-8a92-fb8d6c728907\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:11.794618 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.794573 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785bc57899-m2hv5" event={"ID":"e4f70910-baa8-44e1-9a1f-53cffe16f3fa","Type":"ContainerStarted","Data":"68b781bd8e72d9391d4f5b9ac53255361213f42a3012dcac0572dc7e2c533f80"} Jul 20 19:27:11.875749 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:11.875572 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" Jul 20 19:27:12.036519 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:12.036428 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-brr44"] Jul 20 19:27:12.039437 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:27:12.039403 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2601efb3_b6b6_48ab_8a92_fb8d6c728907.slice/crio-c1cce765d33962ff5efc5c524a6987e65b5c872c8cef3920deb5796a80f5039e WatchSource:0}: Error finding container c1cce765d33962ff5efc5c524a6987e65b5c872c8cef3920deb5796a80f5039e: Status 404 returned error can't find the container with id c1cce765d33962ff5efc5c524a6987e65b5c872c8cef3920deb5796a80f5039e Jul 20 19:27:12.762266 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:12.762231 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-98l6w" Jul 20 19:27:12.801332 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:12.801240 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" event={"ID":"2601efb3-b6b6-48ab-8a92-fb8d6c728907","Type":"ContainerStarted","Data":"c1cce765d33962ff5efc5c524a6987e65b5c872c8cef3920deb5796a80f5039e"} Jul 20 19:27:15.814485 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:15.814442 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785bc57899-m2hv5" event={"ID":"e4f70910-baa8-44e1-9a1f-53cffe16f3fa","Type":"ContainerStarted","Data":"92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632"} Jul 20 19:27:15.816565 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:15.816534 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" event={"ID":"2601efb3-b6b6-48ab-8a92-fb8d6c728907","Type":"ContainerStarted","Data":"1c593cd31d85a2e28c46e8471084968db1ca8385b3195dc76d17dfa6f3697616"} Jul 20 19:27:15.816689 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:15.816589 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" event={"ID":"2601efb3-b6b6-48ab-8a92-fb8d6c728907","Type":"ContainerStarted","Data":"f5612a811934c063d716e15b37c8cd3266ae0917b74e5801c8bbc073b1e655ae"} Jul 20 19:27:15.833881 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:15.833827 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-785bc57899-m2hv5" podStartSLOduration=2.1657154 podStartE2EDuration="5.833809964s" totalImagesPullingTime="3.668094564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:15.832748577 +0000 UTC m=+304.700050372" watchObservedRunningTime="2026-07-20 19:27:15.833809964 +0000 UTC m=+304.701111760" Jul 20 19:27:15.851241 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:15.851183 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-brr44" podStartSLOduration=1.649323303 podStartE2EDuration="4.851163873s" totalImagesPullingTime="3.20184057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:15.850431906 +0000 UTC m=+304.717733713" watchObservedRunningTime="2026-07-20 19:27:15.851163873 +0000 UTC m=+304.718465929" Jul 20 19:27:16.718961 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:16.718925 2555 patch_prober.go:28] interesting pod/image-registry-6fc756966-dzrkz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 19:27:16.719128 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:16.718994 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" podUID="e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 19:27:17.971260 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:17.971209 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz"] Jul 20 19:27:17.974492 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:17.974467 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:17.977181 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:17.977154 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 20 19:27:17.977374 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:17.977194 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 20 19:27:17.977462 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:17.977323 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tm8bj\"" Jul 20 19:27:17.992494 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:17.992457 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz"] Jul 20 19:27:18.059162 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.059121 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mlrvq"] Jul 20 19:27:18.061679 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.061653 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.071252 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.071228 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sg4tx\"" Jul 20 19:27:18.071448 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.071228 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 19:27:18.071700 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.071680 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 19:27:18.071785 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.071771 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 19:27:18.127963 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.127923 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d541bdd3-b227-482e-b722-c9f6daece869-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.128122 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.128004 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6mr7\" (UniqueName: \"kubernetes.io/projected/d541bdd3-b227-482e-b722-c9f6daece869-kube-api-access-g6mr7\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.128122 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.128059 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d541bdd3-b227-482e-b722-c9f6daece869-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.128122 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.128109 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d541bdd3-b227-482e-b722-c9f6daece869-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.229619 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.229498 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-accelerators-collector-config\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.229619 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.229577 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d541bdd3-b227-482e-b722-c9f6daece869-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.229863 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.229621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-sys\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.229863 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.229647 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d541bdd3-b227-482e-b722-c9f6daece869-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.229863 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.229704 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-textfile\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.229863 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.229748 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6mr7\" (UniqueName: \"kubernetes.io/projected/d541bdd3-b227-482e-b722-c9f6daece869-kube-api-access-g6mr7\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.229863 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.229775 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-metrics-client-ca\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.229863 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.229836 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-wtmp\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.230152 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.229864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbd44\" (UniqueName: \"kubernetes.io/projected/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-kube-api-access-cbd44\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.230152 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.229897 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d541bdd3-b227-482e-b722-c9f6daece869-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.230152 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.229959 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.230152 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.230000 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-tls\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.230152 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.230051 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-root\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.230463 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.230438 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d541bdd3-b227-482e-b722-c9f6daece869-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.232274 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.232251 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d541bdd3-b227-482e-b722-c9f6daece869-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.232456 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.232434 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d541bdd3-b227-482e-b722-c9f6daece869-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.239063 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.239025 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6mr7\" (UniqueName: \"kubernetes.io/projected/d541bdd3-b227-482e-b722-c9f6daece869-kube-api-access-g6mr7\") pod \"openshift-state-metrics-79f6958cdf-tdlbz\" (UID: \"d541bdd3-b227-482e-b722-c9f6daece869\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.286670 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.286619 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" Jul 20 19:27:18.330596 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.330546 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-sys\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.330807 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.330641 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-textfile\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.330807 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.330695 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-metrics-client-ca\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.330807 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.330712 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-sys\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.330807 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.330733 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-wtmp\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.330807 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.330757 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbd44\" (UniqueName: \"kubernetes.io/projected/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-kube-api-access-cbd44\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.330807 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.330793 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.331037 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.330824 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-tls\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.331037 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.330851 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-root\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.331037 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.330887 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-accelerators-collector-config\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.331202 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.331175 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-textfile\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.331505 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.331456 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-metrics-client-ca\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.331505 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.331460 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-accelerators-collector-config\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.331704 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.331510 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-root\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.331704 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.331665 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-wtmp\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.333671 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.333636 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-tls\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.333837 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.333815 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.348838 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.348806 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbd44\" (UniqueName: \"kubernetes.io/projected/4828f6d9-66bb-43b7-8f44-8e70c8bc8a01-kube-api-access-cbd44\") pod \"node-exporter-mlrvq\" (UID: \"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01\") " pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.373738 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.373702 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mlrvq" Jul 20 19:27:18.390104 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:27:18.390053 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4828f6d9_66bb_43b7_8f44_8e70c8bc8a01.slice/crio-b5b587f70e30c20fe209f9d0e84d18c4a691ff17a0b2cd85e0fff8bcf8ce0c43 WatchSource:0}: Error finding container b5b587f70e30c20fe209f9d0e84d18c4a691ff17a0b2cd85e0fff8bcf8ce0c43: Status 404 returned error can't find the container with id b5b587f70e30c20fe209f9d0e84d18c4a691ff17a0b2cd85e0fff8bcf8ce0c43 Jul 20 19:27:18.393028 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.392983 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:27:18.446721 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.446683 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz"] Jul 20 19:27:18.449893 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:27:18.449865 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd541bdd3_b227_482e_b722_c9f6daece869.slice/crio-ad61cf5b11d9d991fc6c27994fc1fc541cb5e468e4fa7ace325aba6b27210787 WatchSource:0}: Error finding container ad61cf5b11d9d991fc6c27994fc1fc541cb5e468e4fa7ace325aba6b27210787: Status 404 returned error can't find the container with id ad61cf5b11d9d991fc6c27994fc1fc541cb5e468e4fa7ace325aba6b27210787 Jul 20 19:27:18.828389 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.828352 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlrvq" event={"ID":"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01","Type":"ContainerStarted","Data":"b5b587f70e30c20fe209f9d0e84d18c4a691ff17a0b2cd85e0fff8bcf8ce0c43"} Jul 20 19:27:18.830185 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.830153 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" event={"ID":"d541bdd3-b227-482e-b722-c9f6daece869","Type":"ContainerStarted","Data":"efb012060abe98ac23637974899c2de277eef0ca9a08a2538520afbb8389e52b"} Jul 20 19:27:18.830334 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.830217 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" event={"ID":"d541bdd3-b227-482e-b722-c9f6daece869","Type":"ContainerStarted","Data":"0fae997b18de9310e98f3b31a4eb99e161813bb5c60cc4dc83f09ddccd20f03a"} Jul 20 19:27:18.830334 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.830244 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" event={"ID":"d541bdd3-b227-482e-b722-c9f6daece869","Type":"ContainerStarted","Data":"ad61cf5b11d9d991fc6c27994fc1fc541cb5e468e4fa7ace325aba6b27210787"} Jul 20 19:27:18.879972 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:18.879931 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:27:19.743544 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:19.743461 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:27:19.835782 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:19.835741 2555 generic.go:356] "Generic (PLEG): container finished" podID="4828f6d9-66bb-43b7-8f44-8e70c8bc8a01" containerID="fb7bda6a18c4cee02b5ab315c228f9f5eb83df1dfecc5a18d1a3a5f224a39aa6" exitCode=0 Jul 20 19:27:19.835940 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:19.835821 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlrvq" event={"ID":"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01","Type":"ContainerDied","Data":"fb7bda6a18c4cee02b5ab315c228f9f5eb83df1dfecc5a18d1a3a5f224a39aa6"} Jul 20 19:27:20.841213 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.841175 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlrvq" event={"ID":"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01","Type":"ContainerStarted","Data":"c1f7acb15b631488587c1aba44b744d216d3883d88f4983431e76241494ea57a"} Jul 20 19:27:20.841726 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.841244 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlrvq" event={"ID":"4828f6d9-66bb-43b7-8f44-8e70c8bc8a01","Type":"ContainerStarted","Data":"6c481bd78d7f5ae7ccab3bbdab1c178ea3a8e0faace8dbc06ef1ac4b1ccf71c3"} Jul 20 19:27:20.843402 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.843372 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" event={"ID":"d541bdd3-b227-482e-b722-c9f6daece869","Type":"ContainerStarted","Data":"cf890a428b769c0b8b412bc908a7e5e9bbf0ba9570e860605d7a9f0f2d1f93df"} Jul 20 19:27:20.878903 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.878837 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mlrvq" podStartSLOduration=1.728164174 podStartE2EDuration="2.878815303s" totalImagesPullingTime="1.081242859s" totalInitContainerRuntime="69.40827ms" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:20.876868273 +0000 UTC m=+309.744170277" watchObservedRunningTime="2026-07-20 19:27:20.878815303 +0000 UTC m=+309.746117100" Jul 20 19:27:20.906931 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.906874 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tdlbz" podStartSLOduration=2.3529812740000002 podStartE2EDuration="3.906854956s" totalImagesPullingTime="1.553873682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:20.906107483 +0000 UTC m=+309.773409291" watchObservedRunningTime="2026-07-20 19:27:20.906854956 +0000 UTC m=+309.774156903" Jul 20 19:27:20.983632 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.983590 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-596ff8d6c5-br4j9"] Jul 20 19:27:20.986786 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.986758 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:20.991025 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.990990 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 20 19:27:20.991025 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.991018 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 20 19:27:20.991261 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.991046 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nkclt\"" Jul 20 19:27:20.991261 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.991101 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 20 19:27:20.991261 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.990999 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 20 19:27:20.991261 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.991176 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6i40e8ln70tb5\"" Jul 20 19:27:20.991429 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:20.991409 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 20 19:27:21.009373 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.009336 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-596ff8d6c5-br4j9"] Jul 20 19:27:21.155381 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.155272 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dbeec22-b8b4-46c0-9269-8afe134ab001-metrics-client-ca\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.155538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.155383 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.155538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.155430 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.155538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.155453 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.155538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.155481 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-tls\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.155538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.155530 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h48t8\" (UniqueName: \"kubernetes.io/projected/5dbeec22-b8b4-46c0-9269-8afe134ab001-kube-api-access-h48t8\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.155691 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.155564 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-grpc-tls\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.155691 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.155621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.256578 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.256541 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dbeec22-b8b4-46c0-9269-8afe134ab001-metrics-client-ca\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.256578 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.256593 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.256816 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.256694 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.256863 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.256812 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.256923 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.256865 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-tls\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.256923 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.256891 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h48t8\" (UniqueName: \"kubernetes.io/projected/5dbeec22-b8b4-46c0-9269-8afe134ab001-kube-api-access-h48t8\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.257032 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.256921 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-grpc-tls\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.257459 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.257140 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.257459 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.257430 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dbeec22-b8b4-46c0-9269-8afe134ab001-metrics-client-ca\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.259398 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.259373 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.259530 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.259507 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-tls\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.259646 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.259623 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.259939 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.259921 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.260001 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.259941 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-grpc-tls\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.260250 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.260229 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dbeec22-b8b4-46c0-9269-8afe134ab001-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.266623 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.266594 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h48t8\" (UniqueName: \"kubernetes.io/projected/5dbeec22-b8b4-46c0-9269-8afe134ab001-kube-api-access-h48t8\") pod \"thanos-querier-596ff8d6c5-br4j9\" (UID: \"5dbeec22-b8b4-46c0-9269-8afe134ab001\") " pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.297036 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.296991 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:21.402421 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.402385 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:21.402602 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.402463 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:21.407381 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.407282 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:21.438850 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.438809 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-596ff8d6c5-br4j9"] Jul 20 19:27:21.443812 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:27:21.443781 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbeec22_b8b4_46c0_9269_8afe134ab001.slice/crio-c0cf36cd499cc0075ac5df8a069fa739041ea82562da9930871dce704d36a79f WatchSource:0}: Error finding container c0cf36cd499cc0075ac5df8a069fa739041ea82562da9930871dce704d36a79f: Status 404 returned error can't find the container with id c0cf36cd499cc0075ac5df8a069fa739041ea82562da9930871dce704d36a79f Jul 20 19:27:21.847870 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.847824 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" event={"ID":"5dbeec22-b8b4-46c0-9269-8afe134ab001","Type":"ContainerStarted","Data":"c0cf36cd499cc0075ac5df8a069fa739041ea82562da9930871dce704d36a79f"} Jul 20 19:27:21.851738 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:21.851710 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:27:22.711542 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:22.711487 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq"] Jul 20 19:27:22.713938 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:22.713915 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" Jul 20 19:27:22.717046 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:22.717012 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hn2c5\"" Jul 20 19:27:22.717046 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:22.717036 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 20 19:27:22.727046 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:22.727015 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq"] Jul 20 19:27:22.767544 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:22.767496 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c34dfaca-fcf0-46d3-83b7-a28cc772572a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7gzhq\" (UID: \"c34dfaca-fcf0-46d3-83b7-a28cc772572a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" Jul 20 19:27:22.767544 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:22.767546 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh6lg\" (UniqueName: \"kubernetes.io/projected/c34dfaca-fcf0-46d3-83b7-a28cc772572a-kube-api-access-zh6lg\") pod \"monitoring-plugin-7b7b7bc8bf-7gzhq\" (UID: \"c34dfaca-fcf0-46d3-83b7-a28cc772572a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" Jul 20 19:27:22.869798 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:22.868418 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c34dfaca-fcf0-46d3-83b7-a28cc772572a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7gzhq\" (UID: \"c34dfaca-fcf0-46d3-83b7-a28cc772572a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" Jul 20 19:27:22.869798 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:22.868469 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh6lg\" (UniqueName: \"kubernetes.io/projected/c34dfaca-fcf0-46d3-83b7-a28cc772572a-kube-api-access-zh6lg\") pod \"monitoring-plugin-7b7b7bc8bf-7gzhq\" (UID: \"c34dfaca-fcf0-46d3-83b7-a28cc772572a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" Jul 20 19:27:22.871832 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:22.871801 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c34dfaca-fcf0-46d3-83b7-a28cc772572a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7gzhq\" (UID: \"c34dfaca-fcf0-46d3-83b7-a28cc772572a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" Jul 20 19:27:22.878905 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:22.878872 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh6lg\" (UniqueName: \"kubernetes.io/projected/c34dfaca-fcf0-46d3-83b7-a28cc772572a-kube-api-access-zh6lg\") pod \"monitoring-plugin-7b7b7bc8bf-7gzhq\" (UID: \"c34dfaca-fcf0-46d3-83b7-a28cc772572a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" Jul 20 19:27:23.023615 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:23.023573 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" Jul 20 19:27:23.184693 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:23.184655 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq"] Jul 20 19:27:23.188178 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:27:23.188143 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc34dfaca_fcf0_46d3_83b7_a28cc772572a.slice/crio-e20e0ed29257e64b2218a2da54dc8cc70d36f7fe62b0cb87585e105e8c7cc230 WatchSource:0}: Error finding container e20e0ed29257e64b2218a2da54dc8cc70d36f7fe62b0cb87585e105e8c7cc230: Status 404 returned error can't find the container with id e20e0ed29257e64b2218a2da54dc8cc70d36f7fe62b0cb87585e105e8c7cc230 Jul 20 19:27:23.857331 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:23.857280 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" event={"ID":"c34dfaca-fcf0-46d3-83b7-a28cc772572a","Type":"ContainerStarted","Data":"e20e0ed29257e64b2218a2da54dc8cc70d36f7fe62b0cb87585e105e8c7cc230"} Jul 20 19:27:24.304743 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.303035 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:27:24.307189 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.307155 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.312393 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.310892 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 19:27:24.312393 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.311120 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 19:27:24.312393 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.311838 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 19:27:24.312393 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.312082 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g4f5v\"" Jul 20 19:27:24.312393 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.312368 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 19:27:24.312784 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.312423 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 19:27:24.312784 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.312499 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 19:27:24.312784 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.312574 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 19:27:24.312784 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.312597 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 19:27:24.312784 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.312624 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 19:27:24.313028 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.312922 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-im2gogf51kjh\"" Jul 20 19:27:24.313028 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.312978 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 19:27:24.313107 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.313060 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 19:27:24.313189 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.313163 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 19:27:24.316712 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.316622 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 19:27:24.317242 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.317218 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 19:27:24.327363 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.325355 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 19:27:24.332828 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.332789 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:27:24.382136 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.382092 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.382406 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.382144 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-config\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.382406 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.382170 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.382406 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.382265 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.382406 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.382321 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.382406 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.382354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.382685 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.382411 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384280 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384234 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v9rn\" (UniqueName: \"kubernetes.io/projected/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-kube-api-access-7v9rn\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384404 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384284 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384404 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384336 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384404 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384373 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384404 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384402 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384635 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384439 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384635 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384635 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384506 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384635 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384635 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384564 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384876 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384664 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384876 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384701 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.384876 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.384752 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.486716 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.486669 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.486892 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.486729 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.486892 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.486769 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.486892 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.486799 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.486892 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.486826 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.486892 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.486850 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.486892 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.486884 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487212 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.486908 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487212 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.486955 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487212 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.486983 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487212 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.487016 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-config\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487212 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.487043 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487212 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.487075 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487212 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.487109 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487212 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.487135 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487212 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.487161 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487682 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.487249 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v9rn\" (UniqueName: \"kubernetes.io/projected/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-kube-api-access-7v9rn\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487682 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.487279 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487682 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.487326 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.487682 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.487356 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.488177 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.488143 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.488330 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.488281 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.488513 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.488486 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.488627 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.488603 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.488931 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.488896 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.490142 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.490110 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.490716 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.490688 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.493544 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.493786 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.494541 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.494931 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.495454 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.495714 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.496006 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.496107 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.496535 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-config\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.496922 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.497020 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.497201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.497021 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.502207 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.502174 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v9rn\" (UniqueName: \"kubernetes.io/projected/e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5-kube-api-access-7v9rn\") pod \"prometheus-k8s-0\" (UID: \"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.622411 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.622290 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:24.847990 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.847957 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:27:24.851672 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:27:24.851645 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3cb1e61_1bfc_4db5_82b8_0da5a6dd12c5.slice/crio-823c33a739ccac903472d7610192226a5e40e27624fdbdfdd761c802a355ea36 WatchSource:0}: Error finding container 823c33a739ccac903472d7610192226a5e40e27624fdbdfdd761c802a355ea36: Status 404 returned error can't find the container with id 823c33a739ccac903472d7610192226a5e40e27624fdbdfdd761c802a355ea36 Jul 20 19:27:24.863647 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.863606 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" event={"ID":"5dbeec22-b8b4-46c0-9269-8afe134ab001","Type":"ContainerStarted","Data":"cc5836048996c44c2757dbfab01b409081da6a71aa5cb581570117151a5465ec"} Jul 20 19:27:24.863799 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.863706 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" event={"ID":"5dbeec22-b8b4-46c0-9269-8afe134ab001","Type":"ContainerStarted","Data":"d2be98a22db330f5bf76eecd0486d9e6f512bc3dcf894a4d6712cce7cc59e052"} Jul 20 19:27:24.865514 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.865451 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" event={"ID":"c34dfaca-fcf0-46d3-83b7-a28cc772572a","Type":"ContainerStarted","Data":"09450daf20364b8ebae4e6760aa712dd684950daf22635fd9b247da8dec62fa5"} Jul 20 19:27:24.865689 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.865669 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" Jul 20 19:27:24.867196 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.867165 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5","Type":"ContainerStarted","Data":"823c33a739ccac903472d7610192226a5e40e27624fdbdfdd761c802a355ea36"} Jul 20 19:27:24.872078 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.872033 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" Jul 20 19:27:24.885574 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:24.885461 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7gzhq" podStartSLOduration=1.39042063 podStartE2EDuration="2.885444133s" totalImagesPullingTime="1.495023503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:24.884177855 +0000 UTC m=+313.751479674" watchObservedRunningTime="2026-07-20 19:27:24.885444133 +0000 UTC m=+313.752745928" Jul 20 19:27:25.874043 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:25.874005 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" event={"ID":"5dbeec22-b8b4-46c0-9269-8afe134ab001","Type":"ContainerStarted","Data":"807f41c120cb0a1242eef6e03186c3aadb3b4cc915b90ef33ea372041c4c2596"} Jul 20 19:27:26.094202 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:26.094166 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fc756966-dzrkz"] Jul 20 19:27:26.880829 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:26.880794 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" event={"ID":"5dbeec22-b8b4-46c0-9269-8afe134ab001","Type":"ContainerStarted","Data":"1f5a230569d77469ad2372762b50817971cb41e254dae09e3022388820642000"} Jul 20 19:27:26.881273 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:26.880872 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" event={"ID":"5dbeec22-b8b4-46c0-9269-8afe134ab001","Type":"ContainerStarted","Data":"40c7f85b0fefafde785f8e67df9e293b1b7cce8c6c8c449f941c98eba6dae5b0"} Jul 20 19:27:26.881273 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:26.880919 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" event={"ID":"5dbeec22-b8b4-46c0-9269-8afe134ab001","Type":"ContainerStarted","Data":"1f1659c604f5b67f96a6b368037855f86d29f5bfc0e54e65281951c7ad17ef17"} Jul 20 19:27:26.881273 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:26.880963 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:26.882447 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:26.882420 2555 generic.go:356] "Generic (PLEG): container finished" podID="e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5" containerID="e8535c3b8368a3788b592850e1ce286f031b01024813af42a6c91778abe87b2a" exitCode=0 Jul 20 19:27:26.882563 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:26.882500 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5","Type":"ContainerDied","Data":"e8535c3b8368a3788b592850e1ce286f031b01024813af42a6c91778abe87b2a"} Jul 20 19:27:26.911991 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:26.911825 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" podStartSLOduration=2.746524338 podStartE2EDuration="6.911776908s" totalImagesPullingTime="4.16525257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:26.905458378 +0000 UTC m=+315.772760193" watchObservedRunningTime="2026-07-20 19:27:26.911776908 +0000 UTC m=+315.779078703" Jul 20 19:27:30.910093 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:30.910045 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5","Type":"ContainerStarted","Data":"3a1e57db0e32dd94aa1d8472b18b194d260181ca16ecf98b5e80e8e1d2432ede"} Jul 20 19:27:30.910570 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:30.910187 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5","Type":"ContainerStarted","Data":"99b53881c57665d0940a34dcc2ecc0e92170f4128fced0071ef5c64e1807f449"} Jul 20 19:27:30.910570 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:30.910237 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5","Type":"ContainerStarted","Data":"a025a0db7b899cdbe0c99d26a52d643b9840cd0856c81e75157e29df8cb2a444"} Jul 20 19:27:31.917791 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:31.917751 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5","Type":"ContainerStarted","Data":"7004c57c1cd97d69cc6863b12b7154f6037f02032b4bfb8c7fc38da94035d1e2"} Jul 20 19:27:31.918274 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:31.917827 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5","Type":"ContainerStarted","Data":"1e0110ca13f48d6204c6dfb2cd8bd483092f7e9132fb759a68a26ee50743c86c"} Jul 20 19:27:31.918274 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:31.917867 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5","Type":"ContainerStarted","Data":"5cf941680de374524c9ce494b9db531fd3ad954240745598de1fba7ec3095e99"} Jul 20 19:27:31.949024 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:31.948926 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.163921354 podStartE2EDuration="7.948904072s" totalImagesPullingTime="4.762603388s" totalInitContainerRuntime="22.37933ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:31.946699589 +0000 UTC m=+320.814001384" watchObservedRunningTime="2026-07-20 19:27:31.948904072 +0000 UTC m=+320.816205868" Jul 20 19:27:32.895968 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:32.895935 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-596ff8d6c5-br4j9" Jul 20 19:27:34.623323 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:34.623260 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:27:36.663494 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:36.663450 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785bc57899-m2hv5"] Jul 20 19:27:40.962608 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:40.962566 2555 generic.go:356] "Generic (PLEG): container finished" podID="b6aefb65-64cd-43ee-9e25-12c2445da0a1" containerID="d9154ce2a1b72b603e618111c72a4e5389e67306fce276ed92ab69e2185d8ab8" exitCode=0 Jul 20 19:27:40.963071 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:40.962641 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" event={"ID":"b6aefb65-64cd-43ee-9e25-12c2445da0a1","Type":"ContainerDied","Data":"d9154ce2a1b72b603e618111c72a4e5389e67306fce276ed92ab69e2185d8ab8"} Jul 20 19:27:40.963071 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:40.963051 2555 scope.go:117] "RemoveContainer" containerID="d9154ce2a1b72b603e618111c72a4e5389e67306fce276ed92ab69e2185d8ab8" Jul 20 19:27:41.968104 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:41.968068 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-c6xg8" event={"ID":"b6aefb65-64cd-43ee-9e25-12c2445da0a1","Type":"ContainerStarted","Data":"9ba76c4562993345a49e68931f50a3d172d007801925867239c25d955b1f2f5c"} Jul 20 19:27:51.115748 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.115700 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" podUID="e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" containerName="registry" containerID="cri-o://bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a" gracePeriod=30 Jul 20 19:27:51.377014 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.376949 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:27:51.543555 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.543514 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-certificates\") pod \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " Jul 20 19:27:51.543744 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.543589 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-ca-trust-extracted\") pod \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " Jul 20 19:27:51.543744 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.543609 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4kzb\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-kube-api-access-f4kzb\") pod \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " Jul 20 19:27:51.543744 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.543628 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") pod \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " Jul 20 19:27:51.543744 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.543675 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-trusted-ca\") pod \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " Jul 20 19:27:51.543744 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.543696 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-image-registry-private-configuration\") pod \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " Jul 20 19:27:51.543744 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.543730 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-bound-sa-token\") pod \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " Jul 20 19:27:51.544101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.543766 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-installation-pull-secrets\") pod \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\" (UID: \"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1\") " Jul 20 19:27:51.544101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.544049 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:27:51.544204 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.544173 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:27:51.546418 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.546364 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-kube-api-access-f4kzb" (OuterVolumeSpecName: "kube-api-access-f4kzb") pod "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1"). InnerVolumeSpecName "kube-api-access-f4kzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:27:51.546568 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.546448 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:27:51.546568 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.546459 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:27:51.546568 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.546500 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:27:51.546568 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.546558 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:27:51.552145 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.552115 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" (UID: "e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:27:51.645001 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.644904 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-ca-trust-extracted\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:27:51.645001 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.644937 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4kzb\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-kube-api-access-f4kzb\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:27:51.645001 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.644949 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-tls\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:27:51.645001 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.644960 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-trusted-ca\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:27:51.645001 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.644969 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-image-registry-private-configuration\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:27:51.645001 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.644992 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-bound-sa-token\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:27:51.645001 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.645002 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-installation-pull-secrets\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:27:51.645386 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:51.645010 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1-registry-certificates\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:27:52.008947 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:52.008915 2555 generic.go:356] "Generic (PLEG): container finished" podID="e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" containerID="bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a" exitCode=0 Jul 20 19:27:52.009102 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:52.008962 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" Jul 20 19:27:52.009102 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:52.009005 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" event={"ID":"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1","Type":"ContainerDied","Data":"bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a"} Jul 20 19:27:52.009102 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:52.009066 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fc756966-dzrkz" event={"ID":"e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1","Type":"ContainerDied","Data":"8dc3af1db8a22ed36674d45650b3777a9f2a542f8a7bdedc4baa325209a4cda5"} Jul 20 19:27:52.009102 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:52.009087 2555 scope.go:117] "RemoveContainer" containerID="bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a" Jul 20 19:27:52.017827 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:52.017807 2555 scope.go:117] "RemoveContainer" containerID="bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a" Jul 20 19:27:52.018149 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:27:52.018128 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a\": container with ID starting with bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a not found: ID does not exist" containerID="bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a" Jul 20 19:27:52.018193 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:52.018158 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a"} err="failed to get container status \"bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a\": rpc error: code = NotFound desc = could not find container \"bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a\": container with ID starting with bf3840e55bb65b86eb2a0a6c0e425ae9f7c9d238f2519433a6f548f59a52dc0a not found: ID does not exist" Jul 20 19:27:52.027346 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:52.027291 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fc756966-dzrkz"] Jul 20 19:27:52.031556 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:52.031529 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fc756966-dzrkz"] Jul 20 19:27:53.885434 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:27:53.885398 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" path="/var/lib/kubelet/pods/e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1/volumes" Jul 20 19:28:01.047911 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:01.047874 2555 generic.go:356] "Generic (PLEG): container finished" podID="79bfcd7c-58d2-4ab1-82e3-cc3786d8edde" containerID="2337d51eb81b8fce22ef37a0e4ecee231a4ee736c65a350dcb96db74fa861ea5" exitCode=0 Jul 20 19:28:01.048362 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:01.047946 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" event={"ID":"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde","Type":"ContainerDied","Data":"2337d51eb81b8fce22ef37a0e4ecee231a4ee736c65a350dcb96db74fa861ea5"} Jul 20 19:28:01.048362 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:01.048261 2555 scope.go:117] "RemoveContainer" containerID="2337d51eb81b8fce22ef37a0e4ecee231a4ee736c65a350dcb96db74fa861ea5" Jul 20 19:28:01.694206 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:01.694165 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-785bc57899-m2hv5" podUID="e4f70910-baa8-44e1-9a1f-53cffe16f3fa" containerName="console" containerID="cri-o://92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632" gracePeriod=15 Jul 20 19:28:01.848268 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:01.848229 2555 patch_prober.go:28] interesting pod/console-785bc57899-m2hv5 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body= Jul 20 19:28:01.848486 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:01.848291 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-785bc57899-m2hv5" podUID="e4f70910-baa8-44e1-9a1f-53cffe16f3fa" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" Jul 20 19:28:01.996196 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:01.996156 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:28:02.039138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.039097 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-trusted-ca-bundle\") pod \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " Jul 20 19:28:02.039138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.039134 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-service-ca\") pod \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " Jul 20 19:28:02.039138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.039151 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-config\") pod \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " Jul 20 19:28:02.039487 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.039171 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-oauth-serving-cert\") pod \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " Jul 20 19:28:02.039487 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.039220 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhmnn\" (UniqueName: \"kubernetes.io/projected/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-kube-api-access-zhmnn\") pod \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " Jul 20 19:28:02.039487 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.039277 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-oauth-config\") pod \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " Jul 20 19:28:02.039487 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.039323 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-serving-cert\") pod \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\" (UID: \"e4f70910-baa8-44e1-9a1f-53cffe16f3fa\") " Jul 20 19:28:02.039692 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.039612 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e4f70910-baa8-44e1-9a1f-53cffe16f3fa" (UID: "e4f70910-baa8-44e1-9a1f-53cffe16f3fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:28:02.039692 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.039626 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "e4f70910-baa8-44e1-9a1f-53cffe16f3fa" (UID: "e4f70910-baa8-44e1-9a1f-53cffe16f3fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:28:02.040041 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.040013 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e4f70910-baa8-44e1-9a1f-53cffe16f3fa" (UID: "e4f70910-baa8-44e1-9a1f-53cffe16f3fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:28:02.040041 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.040034 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-config" (OuterVolumeSpecName: "console-config") pod "e4f70910-baa8-44e1-9a1f-53cffe16f3fa" (UID: "e4f70910-baa8-44e1-9a1f-53cffe16f3fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:28:02.041788 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.041757 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e4f70910-baa8-44e1-9a1f-53cffe16f3fa" (UID: "e4f70910-baa8-44e1-9a1f-53cffe16f3fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:28:02.041909 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.041842 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e4f70910-baa8-44e1-9a1f-53cffe16f3fa" (UID: "e4f70910-baa8-44e1-9a1f-53cffe16f3fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:28:02.041986 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.041958 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-kube-api-access-zhmnn" (OuterVolumeSpecName: "kube-api-access-zhmnn") pod "e4f70910-baa8-44e1-9a1f-53cffe16f3fa" (UID: "e4f70910-baa8-44e1-9a1f-53cffe16f3fa"). InnerVolumeSpecName "kube-api-access-zhmnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:28:02.054507 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.054476 2555 generic.go:356] "Generic (PLEG): container finished" podID="e4f70910-baa8-44e1-9a1f-53cffe16f3fa" containerID="92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632" exitCode=0 Jul 20 19:28:02.054962 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.054543 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785bc57899-m2hv5" Jul 20 19:28:02.054962 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.054558 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785bc57899-m2hv5" event={"ID":"e4f70910-baa8-44e1-9a1f-53cffe16f3fa","Type":"ContainerDied","Data":"92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632"} Jul 20 19:28:02.054962 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.054611 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785bc57899-m2hv5" event={"ID":"e4f70910-baa8-44e1-9a1f-53cffe16f3fa","Type":"ContainerDied","Data":"68b781bd8e72d9391d4f5b9ac53255361213f42a3012dcac0572dc7e2c533f80"} Jul 20 19:28:02.054962 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.054632 2555 scope.go:117] "RemoveContainer" containerID="92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632" Jul 20 19:28:02.056822 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.056798 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p9chw" event={"ID":"79bfcd7c-58d2-4ab1-82e3-cc3786d8edde","Type":"ContainerStarted","Data":"bdc3ccbf6a9581ee2ff3a02217139732454ef02f1bd96c6073f2c3704113424d"} Jul 20 19:28:02.063530 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.063510 2555 scope.go:117] "RemoveContainer" containerID="92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632" Jul 20 19:28:02.063890 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:28:02.063864 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632\": container with ID starting with 92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632 not found: ID does not exist" containerID="92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632" Jul 20 19:28:02.063944 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.063902 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632"} err="failed to get container status \"92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632\": rpc error: code = NotFound desc = could not find container \"92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632\": container with ID starting with 92167138acf65548844a6d3e330175cbb3d932b780aae453391c45f606ce3632 not found: ID does not exist" Jul 20 19:28:02.109588 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.109554 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785bc57899-m2hv5"] Jul 20 19:28:02.113562 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.113519 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-785bc57899-m2hv5"] Jul 20 19:28:02.140742 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.140700 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhmnn\" (UniqueName: \"kubernetes.io/projected/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-kube-api-access-zhmnn\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:28:02.140742 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.140735 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-oauth-config\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:28:02.140742 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.140752 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-serving-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:28:02.141036 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.140767 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-trusted-ca-bundle\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:28:02.141036 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.140781 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-service-ca\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:28:02.141036 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.140795 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-console-config\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:28:02.141036 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:02.140807 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4f70910-baa8-44e1-9a1f-53cffe16f3fa-oauth-serving-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:28:03.885392 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:03.885286 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4f70910-baa8-44e1-9a1f-53cffe16f3fa" path="/var/lib/kubelet/pods/e4f70910-baa8-44e1-9a1f-53cffe16f3fa/volumes" Jul 20 19:28:24.622860 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:24.622812 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:28:24.639705 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:24.639674 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:28:25.169705 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:25.169671 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:28:25.645703 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:25.645644 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:28:25.648142 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:25.648115 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0449b8a-9354-485d-9abb-18111650b435-metrics-certs\") pod \"network-metrics-daemon-qdtm4\" (UID: \"b0449b8a-9354-485d-9abb-18111650b435\") " pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:28:25.783167 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:25.783129 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gzsbm\"" Jul 20 19:28:25.790971 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:25.790943 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdtm4" Jul 20 19:28:25.934142 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:25.934059 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qdtm4"] Jul 20 19:28:25.937899 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:28:25.937867 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0449b8a_9354_485d_9abb_18111650b435.slice/crio-b5a81a58a8e91eece07bfe208da12ffa1f2e7b726ed45f669b9c8c44362795f9 WatchSource:0}: Error finding container b5a81a58a8e91eece07bfe208da12ffa1f2e7b726ed45f669b9c8c44362795f9: Status 404 returned error can't find the container with id b5a81a58a8e91eece07bfe208da12ffa1f2e7b726ed45f669b9c8c44362795f9 Jul 20 19:28:26.159396 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:26.159357 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdtm4" event={"ID":"b0449b8a-9354-485d-9abb-18111650b435","Type":"ContainerStarted","Data":"b5a81a58a8e91eece07bfe208da12ffa1f2e7b726ed45f669b9c8c44362795f9"} Jul 20 19:28:27.165370 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:27.165333 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdtm4" event={"ID":"b0449b8a-9354-485d-9abb-18111650b435","Type":"ContainerStarted","Data":"775b8d1d7afe4b44c123fe238de3d2febc3256a803968aa4a3d980ea5ef98099"} Jul 20 19:28:27.165788 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:27.165424 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdtm4" event={"ID":"b0449b8a-9354-485d-9abb-18111650b435","Type":"ContainerStarted","Data":"d3354aa97500e8fe691c8decef7eda6a629c94974d742ff7e7ccd3f49e492bd6"} Jul 20 19:28:27.183460 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:28:27.183399 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qdtm4" podStartSLOduration=374.173419411 podStartE2EDuration="6m15.183383151s" totalImagesPullingTime="1.00996374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:27.182028996 +0000 UTC m=+376.049330821" watchObservedRunningTime="2026-07-20 19:28:27.183383151 +0000 UTC m=+376.050684943" Jul 20 19:30:47.992479 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.992433 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr"] Jul 20 19:30:47.992982 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.992753 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f70910-baa8-44e1-9a1f-53cffe16f3fa" containerName="console" Jul 20 19:30:47.992982 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.992764 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f70910-baa8-44e1-9a1f-53cffe16f3fa" containerName="console" Jul 20 19:30:47.992982 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.992786 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" containerName="registry" Jul 20 19:30:47.992982 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.992792 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" containerName="registry" Jul 20 19:30:47.992982 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.992846 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4f70910-baa8-44e1-9a1f-53cffe16f3fa" containerName="console" Jul 20 19:30:47.992982 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.992854 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e65b3d91-1b40-4bab-a2e7-4378f1e2a7e1" containerName="registry" Jul 20 19:30:47.995858 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.995840 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:47.998939 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.998911 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 19:30:47.999140 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.999066 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2kwsn\"" Jul 20 19:30:47.999140 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.999072 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 19:30:47.999243 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.999143 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 19:30:47.999650 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:47.999590 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 19:30:48.017042 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.016993 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr"] Jul 20 19:30:48.053659 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.053608 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6716cc81-3e28-4ce0-a589-4d96891bbb36-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.053833 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.053669 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6716cc81-3e28-4ce0-a589-4d96891bbb36-manifests\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.053833 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.053710 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6716cc81-3e28-4ce0-a589-4d96891bbb36-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.053833 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.053735 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6716cc81-3e28-4ce0-a589-4d96891bbb36-tmp\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.053833 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.053784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgbt6\" (UniqueName: \"kubernetes.io/projected/6716cc81-3e28-4ce0-a589-4d96891bbb36-kube-api-access-xgbt6\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.154604 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.154562 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6716cc81-3e28-4ce0-a589-4d96891bbb36-manifests\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.154604 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.154606 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6716cc81-3e28-4ce0-a589-4d96891bbb36-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.154850 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.154631 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6716cc81-3e28-4ce0-a589-4d96891bbb36-tmp\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.154850 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.154656 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgbt6\" (UniqueName: \"kubernetes.io/projected/6716cc81-3e28-4ce0-a589-4d96891bbb36-kube-api-access-xgbt6\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.154850 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.154736 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6716cc81-3e28-4ce0-a589-4d96891bbb36-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.155015 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.154991 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6716cc81-3e28-4ce0-a589-4d96891bbb36-manifests\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.157003 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.156966 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6716cc81-3e28-4ce0-a589-4d96891bbb36-tmp\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.157211 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.157189 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6716cc81-3e28-4ce0-a589-4d96891bbb36-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.157361 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.157343 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6716cc81-3e28-4ce0-a589-4d96891bbb36-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.167704 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.167670 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgbt6\" (UniqueName: \"kubernetes.io/projected/6716cc81-3e28-4ce0-a589-4d96891bbb36-kube-api-access-xgbt6\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr\" (UID: \"6716cc81-3e28-4ce0-a589-4d96891bbb36\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.307595 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.307555 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:48.464791 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.464757 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr"] Jul 20 19:30:48.468147 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:30:48.468120 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6716cc81_3e28_4ce0_a589_4d96891bbb36.slice/crio-5be95ddf7424d20d917deaa92d02eb55ae3ddb375905fcf5c2135fd36dd7921b WatchSource:0}: Error finding container 5be95ddf7424d20d917deaa92d02eb55ae3ddb375905fcf5c2135fd36dd7921b: Status 404 returned error can't find the container with id 5be95ddf7424d20d917deaa92d02eb55ae3ddb375905fcf5c2135fd36dd7921b Jul 20 19:30:48.740521 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:48.740425 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" event={"ID":"6716cc81-3e28-4ce0-a589-4d96891bbb36","Type":"ContainerStarted","Data":"5be95ddf7424d20d917deaa92d02eb55ae3ddb375905fcf5c2135fd36dd7921b"} Jul 20 19:30:51.756495 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:51.756402 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" event={"ID":"6716cc81-3e28-4ce0-a589-4d96891bbb36","Type":"ContainerStarted","Data":"b995c5d39727caae41b5a7114685875dbdf92b03c19f7a87c17827e9b1eb086f"} Jul 20 19:30:52.763193 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:52.763154 2555 generic.go:356] "Generic (PLEG): container finished" podID="6716cc81-3e28-4ce0-a589-4d96891bbb36" containerID="b995c5d39727caae41b5a7114685875dbdf92b03c19f7a87c17827e9b1eb086f" exitCode=0 Jul 20 19:30:52.763695 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:52.763233 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" event={"ID":"6716cc81-3e28-4ce0-a589-4d96891bbb36","Type":"ContainerDied","Data":"b995c5d39727caae41b5a7114685875dbdf92b03c19f7a87c17827e9b1eb086f"} Jul 20 19:30:53.770035 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:53.769992 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" event={"ID":"6716cc81-3e28-4ce0-a589-4d96891bbb36","Type":"ContainerStarted","Data":"cc1e06a4f73b323fba30f6955b2cafd7183c914868bc36e94aee1b69c2c0fbce"} Jul 20 19:30:53.770484 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:53.770159 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:30:53.792246 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:30:53.792181 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" podStartSLOduration=2.190414082 podStartE2EDuration="6.792166274s" totalImagesPullingTime="3.471264849s" totalInitContainerRuntime="1.130487343s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:30:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:30:53.791977518 +0000 UTC m=+522.659279313" watchObservedRunningTime="2026-07-20 19:30:53.792166274 +0000 UTC m=+522.659468069" Jul 20 19:31:04.777170 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:04.777083 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr" Jul 20 19:31:08.310137 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.310096 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh"] Jul 20 19:31:08.315909 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.315873 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.318520 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.318490 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 20 19:31:08.318701 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.318490 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 19:31:08.319912 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.319888 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:31:08.320037 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.319949 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 20 19:31:08.320957 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.320938 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 20 19:31:08.321086 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.321009 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bz5bb\"" Jul 20 19:31:08.325812 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.325785 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh"] Jul 20 19:31:08.437861 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.437817 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-cert\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.438021 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.437886 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-manager-config\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.438021 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.437977 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-metrics-cert\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.438110 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.438026 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqvt7\" (UniqueName: \"kubernetes.io/projected/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-kube-api-access-sqvt7\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.538891 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.538844 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-manager-config\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.539108 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.538921 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-metrics-cert\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.539108 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.538946 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqvt7\" (UniqueName: \"kubernetes.io/projected/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-kube-api-access-sqvt7\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.539108 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.539000 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-cert\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.539559 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.539526 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-manager-config\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.541613 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.541577 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-metrics-cert\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.541725 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.541617 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-cert\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.550792 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.550757 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqvt7\" (UniqueName: \"kubernetes.io/projected/dcd52987-29d8-4dc9-8a8c-a25e35540bfb-kube-api-access-sqvt7\") pod \"lws-controller-manager-7c66c54875-4xmkh\" (UID: \"dcd52987-29d8-4dc9-8a8c-a25e35540bfb\") " pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.627629 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.627529 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:08.799245 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.799212 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh"] Jul 20 19:31:08.802250 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:31:08.802211 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd52987_29d8_4dc9_8a8c_a25e35540bfb.slice/crio-acc3cd742a4423eb603fcb3f60b63bec79fa1f0fa4b2b633f2f26ef26cf9ea63 WatchSource:0}: Error finding container acc3cd742a4423eb603fcb3f60b63bec79fa1f0fa4b2b633f2f26ef26cf9ea63: Status 404 returned error can't find the container with id acc3cd742a4423eb603fcb3f60b63bec79fa1f0fa4b2b633f2f26ef26cf9ea63 Jul 20 19:31:08.842247 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:08.842205 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" event={"ID":"dcd52987-29d8-4dc9-8a8c-a25e35540bfb","Type":"ContainerStarted","Data":"acc3cd742a4423eb603fcb3f60b63bec79fa1f0fa4b2b633f2f26ef26cf9ea63"} Jul 20 19:31:11.860798 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:11.860759 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" event={"ID":"dcd52987-29d8-4dc9-8a8c-a25e35540bfb","Type":"ContainerStarted","Data":"6f07e7557fc0ead843ca728cc9faf9e4db96494db8e8e8eae7725ca32bc3b755"} Jul 20 19:31:11.861291 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:11.860898 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:11.878187 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:11.878131 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" podStartSLOduration=1.395342226 podStartE2EDuration="3.8780863s" totalImagesPullingTime="2.482744074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:31:11.876669522 +0000 UTC m=+540.743971341" watchObservedRunningTime="2026-07-20 19:31:11.8780863 +0000 UTC m=+540.745388096" Jul 20 19:31:13.935199 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:13.935159 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms"] Jul 20 19:31:13.939104 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:13.939079 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:13.941711 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:13.941663 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 19:31:13.941886 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:13.941719 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-thdvr\"" Jul 20 19:31:13.949973 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:13.949897 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms"] Jul 20 19:31:14.092805 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.092755 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.092805 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.092800 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.093068 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.092831 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.093068 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.092882 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.093068 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.092915 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.093068 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.092946 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.093068 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.093016 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.093068 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.093033 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7gq8\" (UniqueName: \"kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-kube-api-access-p7gq8\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.093068 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.093053 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.194235 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.194135 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.194235 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.194184 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.194235 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.194206 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.194535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.194244 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.194535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.194328 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.194535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.194354 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7gq8\" (UniqueName: \"kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-kube-api-access-p7gq8\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.194535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.194382 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.194535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.194435 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.194535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.194463 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.194824 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.194632 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.195010 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.194983 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.195157 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.195138 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.195341 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.195289 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.195433 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.195388 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.196820 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.196787 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.197437 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.197416 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.200869 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.200842 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk"] Jul 20 19:31:14.204702 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.204672 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.209761 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.209727 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7gq8\" (UniqueName: \"kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-kube-api-access-p7gq8\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.210115 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.210095 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-z6dms\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.214568 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.214537 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk"] Jul 20 19:31:14.255619 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.255586 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:14.295720 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.295668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c804680d-78d7-4056-82a7-1eabf0bfeee5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.295928 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.295783 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.295928 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.295828 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.295928 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.295863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.295928 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.295890 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.296147 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.295931 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.296147 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.296037 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7m47\" (UniqueName: \"kubernetes.io/projected/c804680d-78d7-4056-82a7-1eabf0bfeee5-kube-api-access-g7m47\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.296147 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.296105 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.296289 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.296203 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.397456 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.397421 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.397621 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.397473 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c804680d-78d7-4056-82a7-1eabf0bfeee5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.397621 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.397502 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.397621 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.397520 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.397621 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.397538 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.397621 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.397554 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.397881 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.397704 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.397881 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.397768 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7m47\" (UniqueName: \"kubernetes.io/projected/c804680d-78d7-4056-82a7-1eabf0bfeee5-kube-api-access-g7m47\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.397881 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.397833 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.398039 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.397899 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.398039 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.397938 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.398150 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.398089 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.398150 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.398131 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.398277 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.398251 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c804680d-78d7-4056-82a7-1eabf0bfeee5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.400102 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.400073 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.400102 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.400092 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.408768 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.408732 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c804680d-78d7-4056-82a7-1eabf0bfeee5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.408768 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.408764 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7m47\" (UniqueName: \"kubernetes.io/projected/c804680d-78d7-4056-82a7-1eabf0bfeee5-kube-api-access-g7m47\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xtkpk\" (UID: \"c804680d-78d7-4056-82a7-1eabf0bfeee5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.417164 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.416988 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms"] Jul 20 19:31:14.419576 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:31:14.419545 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2efd8ffc_d27d_4d45_a2d9_f1471c9229d0.slice/crio-3a770f56189fd56fbabc8177f168705dd7cf2d9c7addc91d65dc6cf2bc0c18e8 WatchSource:0}: Error finding container 3a770f56189fd56fbabc8177f168705dd7cf2d9c7addc91d65dc6cf2bc0c18e8: Status 404 returned error can't find the container with id 3a770f56189fd56fbabc8177f168705dd7cf2d9c7addc91d65dc6cf2bc0c18e8 Jul 20 19:31:14.543235 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.543196 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:14.703037 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.702007 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk"] Jul 20 19:31:14.874849 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.874742 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" event={"ID":"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0","Type":"ContainerStarted","Data":"3a770f56189fd56fbabc8177f168705dd7cf2d9c7addc91d65dc6cf2bc0c18e8"} Jul 20 19:31:14.876132 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:14.876073 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" event={"ID":"c804680d-78d7-4056-82a7-1eabf0bfeee5","Type":"ContainerStarted","Data":"8cd27485273ce6c07a427ecd60653dc91efbc7bfeba8e5e613b296adab3b27d9"} Jul 20 19:31:16.562220 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.561993 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8"] Jul 20 19:31:16.569512 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.569474 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.572488 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.572446 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 20 19:31:16.572783 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.572749 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hffrt\"" Jul 20 19:31:16.572964 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.572905 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 20 19:31:16.573094 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.573077 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 20 19:31:16.580623 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.580594 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8"] Jul 20 19:31:16.723849 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.723805 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc0edf10-2e85-438a-b17a-bd69271b6f0d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.724043 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.723860 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.724043 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.723891 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.724043 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.723916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t42hz\" (UniqueName: \"kubernetes.io/projected/bc0edf10-2e85-438a-b17a-bd69271b6f0d-kube-api-access-t42hz\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.724224 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.724047 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.724224 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.724094 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.724224 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.724189 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0edf10-2e85-438a-b17a-bd69271b6f0d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.825246 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.825151 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.825246 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.825207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t42hz\" (UniqueName: \"kubernetes.io/projected/bc0edf10-2e85-438a-b17a-bd69271b6f0d-kube-api-access-t42hz\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.825517 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.825256 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.825517 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.825279 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.825517 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.825354 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0edf10-2e85-438a-b17a-bd69271b6f0d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.825517 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.825428 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc0edf10-2e85-438a-b17a-bd69271b6f0d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.825517 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.825450 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.826110 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.826076 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.828288 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.828251 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0edf10-2e85-438a-b17a-bd69271b6f0d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.828436 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.828279 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc0edf10-2e85-438a-b17a-bd69271b6f0d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.828497 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.828460 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.828539 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.828496 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.848505 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.848471 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0edf10-2e85-438a-b17a-bd69271b6f0d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.848660 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.848587 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t42hz\" (UniqueName: \"kubernetes.io/projected/bc0edf10-2e85-438a-b17a-bd69271b6f0d-kube-api-access-t42hz\") pod \"istiod-openshift-gateway-94bb8fbfd-k2zj8\" (UID: \"bc0edf10-2e85-438a-b17a-bd69271b6f0d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:16.883377 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:16.883342 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:17.580665 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:17.580618 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:31:17.581121 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:17.580703 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:31:17.581121 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:17.580734 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:31:17.589602 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:17.589537 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:31:17.589674 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:17.589625 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:31:17.589674 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:17.589668 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:31:17.664488 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:17.664449 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8"] Jul 20 19:31:17.667896 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:31:17.667854 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0edf10_2e85_438a_b17a_bd69271b6f0d.slice/crio-9f777bcd2e9270ed4e548c1d5ba88805cf6d18704452a51cf016d72964268c5a WatchSource:0}: Error finding container 9f777bcd2e9270ed4e548c1d5ba88805cf6d18704452a51cf016d72964268c5a: Status 404 returned error can't find the container with id 9f777bcd2e9270ed4e548c1d5ba88805cf6d18704452a51cf016d72964268c5a Jul 20 19:31:17.897258 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:17.897214 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" event={"ID":"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0","Type":"ContainerStarted","Data":"4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3"} Jul 20 19:31:17.899042 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:17.899009 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" event={"ID":"c804680d-78d7-4056-82a7-1eabf0bfeee5","Type":"ContainerStarted","Data":"c5b21da871ec8abd8e55691e8c6a927462f7404efcb227049271b4049c931c7f"} Jul 20 19:31:17.900425 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:17.900401 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" event={"ID":"bc0edf10-2e85-438a-b17a-bd69271b6f0d","Type":"ContainerStarted","Data":"9f777bcd2e9270ed4e548c1d5ba88805cf6d18704452a51cf016d72964268c5a"} Jul 20 19:31:17.964792 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:17.964734 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" podStartSLOduration=1.8061288279999999 podStartE2EDuration="4.964715588s" totalImagesPullingTime="3.15858676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:31:17.963200928 +0000 UTC m=+546.830502747" watchObservedRunningTime="2026-07-20 19:31:17.964715588 +0000 UTC m=+546.832017383" Jul 20 19:31:18.256710 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:18.256625 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:18.258202 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:18.258175 2555 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 20 19:31:18.258378 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:18.258227 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" podUID="2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 20 19:31:18.543671 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:18.543632 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:18.549900 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:18.549868 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:18.593126 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:18.593060 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" podStartSLOduration=1.712885828 podStartE2EDuration="4.593037187s" totalImagesPullingTime="2.880151359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:31:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:31:18.059191623 +0000 UTC m=+546.926493418" watchObservedRunningTime="2026-07-20 19:31:18.593037187 +0000 UTC m=+547.460338982" Jul 20 19:31:18.907710 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:18.907638 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:18.908934 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:18.908898 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xtkpk" Jul 20 19:31:18.982453 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:18.982420 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms"] Jul 20 19:31:19.256726 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:19.256639 2555 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 20 19:31:19.256726 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:19.256711 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" podUID="2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 20 19:31:20.093982 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:20.093946 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:31:20.094306 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:20.094010 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:31:20.256228 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:20.256186 2555 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 20 19:31:20.256460 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:20.256249 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" podUID="2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 20 19:31:20.919049 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:20.919008 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" event={"ID":"bc0edf10-2e85-438a-b17a-bd69271b6f0d","Type":"ContainerStarted","Data":"f5e0172c60210d07ca6d41542700537648da3c0478bee15ba4f7484cf69cb4c4"} Jul 20 19:31:20.919268 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:20.919249 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:20.919466 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:20.919417 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" podUID="2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" containerName="istio-proxy" containerID="cri-o://4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3" gracePeriod=30 Jul 20 19:31:20.941074 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:20.941011 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" podStartSLOduration=2.517554897 podStartE2EDuration="4.94099135s" totalImagesPullingTime="2.423436453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:31:20.940586048 +0000 UTC m=+549.807887880" watchObservedRunningTime="2026-07-20 19:31:20.94099135 +0000 UTC m=+549.808293146" Jul 20 19:31:21.924737 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:21.924699 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k2zj8" Jul 20 19:31:22.868368 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:22.868333 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c66c54875-4xmkh" Jul 20 19:31:26.171153 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.171123 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:26.228444 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228349 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7gq8\" (UniqueName: \"kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-kube-api-access-p7gq8\") pod \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " Jul 20 19:31:26.228444 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228395 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-credential-socket\") pod \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " Jul 20 19:31:26.228444 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228421 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-token\") pod \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " Jul 20 19:31:26.228716 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228456 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-envoy\") pod \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " Jul 20 19:31:26.228716 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228481 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-data\") pod \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " Jul 20 19:31:26.228716 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228525 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-socket\") pod \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " Jul 20 19:31:26.228716 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228568 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-certs\") pod \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " Jul 20 19:31:26.228716 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228658 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-podinfo\") pod \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " Jul 20 19:31:26.228716 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228671 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" (UID: "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:31:26.228716 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228706 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istiod-ca-cert\") pod \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\" (UID: \"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0\") " Jul 20 19:31:26.229084 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228853 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" (UID: "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:31:26.229084 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228883 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" (UID: "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:31:26.229084 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.228898 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" (UID: "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:31:26.229084 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.229042 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-credential-socket\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:31:26.229084 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.229062 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-data\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:31:26.229084 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.229075 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-socket\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:31:26.229431 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.229091 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-workload-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:31:26.229431 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.229178 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" (UID: "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:31:26.230910 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.230879 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" (UID: "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:31:26.230910 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.230893 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" (UID: "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:31:26.231076 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.230943 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-kube-api-access-p7gq8" (OuterVolumeSpecName: "kube-api-access-p7gq8") pod "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" (UID: "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0"). InnerVolumeSpecName "kube-api-access-p7gq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:31:26.231076 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.230981 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" (UID: "2efd8ffc-d27d-4d45-a2d9-f1471c9229d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:31:26.329538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.329490 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-podinfo\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:31:26.329538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.329527 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istiod-ca-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:31:26.329538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.329537 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7gq8\" (UniqueName: \"kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-kube-api-access-p7gq8\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:31:26.329538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.329546 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-token\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:31:26.329538 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.329556 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0-istio-envoy\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:31:26.947740 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.947703 2555 generic.go:356] "Generic (PLEG): container finished" podID="2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" containerID="4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3" exitCode=0 Jul 20 19:31:26.947938 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.947756 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" Jul 20 19:31:26.947938 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.947787 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" event={"ID":"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0","Type":"ContainerDied","Data":"4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3"} Jul 20 19:31:26.947938 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.947845 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms" event={"ID":"2efd8ffc-d27d-4d45-a2d9-f1471c9229d0","Type":"ContainerDied","Data":"3a770f56189fd56fbabc8177f168705dd7cf2d9c7addc91d65dc6cf2bc0c18e8"} Jul 20 19:31:26.947938 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.947870 2555 scope.go:117] "RemoveContainer" containerID="4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3" Jul 20 19:31:26.958506 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.958474 2555 scope.go:117] "RemoveContainer" containerID="4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3" Jul 20 19:31:26.958934 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:31:26.958906 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3\": container with ID starting with 4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3 not found: ID does not exist" containerID="4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3" Jul 20 19:31:26.959023 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.958950 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3"} err="failed to get container status \"4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3\": rpc error: code = NotFound desc = could not find container \"4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3\": container with ID starting with 4ccc98018b3758ef14e69f4c3eaedde8afa0cdaaee41d267da7931e07f3863d3 not found: ID does not exist" Jul 20 19:31:26.971522 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.971481 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms"] Jul 20 19:31:26.975767 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:26.975727 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-z6dms"] Jul 20 19:31:27.885442 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:31:27.885409 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" path="/var/lib/kubelet/pods/2efd8ffc-d27d-4d45-a2d9-f1471c9229d0/volumes" Jul 20 19:33:03.339342 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.339307 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v"] Jul 20 19:33:03.339796 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.339683 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" containerName="istio-proxy" Jul 20 19:33:03.339796 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.339695 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" containerName="istio-proxy" Jul 20 19:33:03.339796 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.339747 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2efd8ffc-d27d-4d45-a2d9-f1471c9229d0" containerName="istio-proxy" Jul 20 19:33:03.341951 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.341932 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:33:03.344993 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.344961 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jb89k\"" Jul 20 19:33:03.345144 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.345123 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 19:33:03.346909 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.346888 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 19:33:03.363550 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.363505 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v"] Jul 20 19:33:03.399254 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.399214 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tb4t\" (UniqueName: \"kubernetes.io/projected/3f655666-ce66-49e5-a026-233686c24657-kube-api-access-9tb4t\") pod \"kuadrant-operator-controller-manager-86878c769f-ghn5v\" (UID: \"3f655666-ce66-49e5-a026-233686c24657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:33:03.399473 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.399272 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f655666-ce66-49e5-a026-233686c24657-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ghn5v\" (UID: \"3f655666-ce66-49e5-a026-233686c24657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:33:03.499929 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.499879 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tb4t\" (UniqueName: \"kubernetes.io/projected/3f655666-ce66-49e5-a026-233686c24657-kube-api-access-9tb4t\") pod \"kuadrant-operator-controller-manager-86878c769f-ghn5v\" (UID: \"3f655666-ce66-49e5-a026-233686c24657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:33:03.499929 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.499937 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f655666-ce66-49e5-a026-233686c24657-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ghn5v\" (UID: \"3f655666-ce66-49e5-a026-233686c24657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:33:03.500430 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.500409 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f655666-ce66-49e5-a026-233686c24657-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ghn5v\" (UID: \"3f655666-ce66-49e5-a026-233686c24657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:33:03.515397 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.515363 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tb4t\" (UniqueName: \"kubernetes.io/projected/3f655666-ce66-49e5-a026-233686c24657-kube-api-access-9tb4t\") pod \"kuadrant-operator-controller-manager-86878c769f-ghn5v\" (UID: \"3f655666-ce66-49e5-a026-233686c24657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:33:03.652480 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.652365 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:33:03.811419 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.811386 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v"] Jul 20 19:33:03.814551 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:33:03.814508 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f655666_ce66_49e5_a026_233686c24657.slice/crio-8d390214c5fa21f8c1cc2a72c31bcaafb75eb6426a7f3f49601d51700f4a5a90 WatchSource:0}: Error finding container 8d390214c5fa21f8c1cc2a72c31bcaafb75eb6426a7f3f49601d51700f4a5a90: Status 404 returned error can't find the container with id 8d390214c5fa21f8c1cc2a72c31bcaafb75eb6426a7f3f49601d51700f4a5a90 Jul 20 19:33:03.817138 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:03.817116 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:33:04.408558 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:04.408520 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" event={"ID":"3f655666-ce66-49e5-a026-233686c24657","Type":"ContainerStarted","Data":"8d390214c5fa21f8c1cc2a72c31bcaafb75eb6426a7f3f49601d51700f4a5a90"} Jul 20 19:33:08.434005 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:08.433963 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" event={"ID":"3f655666-ce66-49e5-a026-233686c24657","Type":"ContainerStarted","Data":"a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c"} Jul 20 19:33:08.434540 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:08.434046 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:33:08.456415 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:08.456355 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" podStartSLOduration=0.9594208 podStartE2EDuration="5.456337051s" totalImagesPullingTime="4.496916251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:33:08.454499723 +0000 UTC m=+657.321801525" watchObservedRunningTime="2026-07-20 19:33:08.456337051 +0000 UTC m=+657.323638846" Jul 20 19:33:19.441211 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:33:19.441172 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:34:51.293569 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.293529 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fnctw"] Jul 20 19:34:51.297423 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.297391 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" Jul 20 19:34:51.300350 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.300288 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 20 19:34:51.300350 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.300342 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jb4t8\"" Jul 20 19:34:51.308535 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.308502 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fnctw"] Jul 20 19:34:51.444562 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.444518 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z8dw\" (UniqueName: \"kubernetes.io/projected/a13250b4-4f46-4268-9045-0c5cf1095640-kube-api-access-7z8dw\") pod \"payload-pre-processing-7677b774bb-fnctw\" (UID: \"a13250b4-4f46-4268-9045-0c5cf1095640\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" Jul 20 19:34:51.444755 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.444639 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a13250b4-4f46-4268-9045-0c5cf1095640-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fnctw\" (UID: \"a13250b4-4f46-4268-9045-0c5cf1095640\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" Jul 20 19:34:51.545763 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.545656 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z8dw\" (UniqueName: \"kubernetes.io/projected/a13250b4-4f46-4268-9045-0c5cf1095640-kube-api-access-7z8dw\") pod \"payload-pre-processing-7677b774bb-fnctw\" (UID: \"a13250b4-4f46-4268-9045-0c5cf1095640\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" Jul 20 19:34:51.545763 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.545742 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a13250b4-4f46-4268-9045-0c5cf1095640-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fnctw\" (UID: \"a13250b4-4f46-4268-9045-0c5cf1095640\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" Jul 20 19:34:51.546569 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.546540 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a13250b4-4f46-4268-9045-0c5cf1095640-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fnctw\" (UID: \"a13250b4-4f46-4268-9045-0c5cf1095640\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" Jul 20 19:34:51.556691 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.556649 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z8dw\" (UniqueName: \"kubernetes.io/projected/a13250b4-4f46-4268-9045-0c5cf1095640-kube-api-access-7z8dw\") pod \"payload-pre-processing-7677b774bb-fnctw\" (UID: \"a13250b4-4f46-4268-9045-0c5cf1095640\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" Jul 20 19:34:51.610629 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.610587 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" Jul 20 19:34:51.759289 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.759253 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fnctw"] Jul 20 19:34:51.762716 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:34:51.762678 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13250b4_4f46_4268_9045_0c5cf1095640.slice/crio-6d8dcaca39732d1113b3e4fd1223b715a367dd3d1ee59d7de7878fbf64664021 WatchSource:0}: Error finding container 6d8dcaca39732d1113b3e4fd1223b715a367dd3d1ee59d7de7878fbf64664021: Status 404 returned error can't find the container with id 6d8dcaca39732d1113b3e4fd1223b715a367dd3d1ee59d7de7878fbf64664021 Jul 20 19:34:51.920641 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:51.920555 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" event={"ID":"a13250b4-4f46-4268-9045-0c5cf1095640","Type":"ContainerStarted","Data":"6d8dcaca39732d1113b3e4fd1223b715a367dd3d1ee59d7de7878fbf64664021"} Jul 20 19:34:54.937140 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:54.937099 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" event={"ID":"a13250b4-4f46-4268-9045-0c5cf1095640","Type":"ContainerStarted","Data":"66789f479f13ee968b9a0b75dcda4654a08c7ff3452098a61aeedcbc8c46b676"} Jul 20 19:34:54.937583 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:54.937212 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" Jul 20 19:34:54.953951 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:34:54.953892 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" podStartSLOduration=1.7194097149999998 podStartE2EDuration="3.953873956s" totalImagesPullingTime="2.234464241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:34:54.95241519 +0000 UTC m=+763.819717012" watchObservedRunningTime="2026-07-20 19:34:54.953873956 +0000 UTC m=+763.821175751" Jul 20 19:35:05.944503 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:05.944461 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnctw" Jul 20 19:35:18.813160 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.813121 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s"] Jul 20 19:35:18.816242 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.816218 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.819943 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.819909 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dxpmb\"" Jul 20 19:35:18.819943 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.819929 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 20 19:35:18.820166 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.819912 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 20 19:35:18.820166 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.819933 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 20 19:35:18.827279 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.827249 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s"] Jul 20 19:35:18.892884 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.892842 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.892884 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.892887 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.893149 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.892922 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.893149 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.892962 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.893149 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.892996 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.893149 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.893061 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77srr\" (UniqueName: \"kubernetes.io/projected/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-kube-api-access-77srr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.994734 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.994686 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.994932 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.994754 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.994932 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.994822 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.994932 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.994877 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77srr\" (UniqueName: \"kubernetes.io/projected/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-kube-api-access-77srr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.994932 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.994928 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.995116 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.994963 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.995180 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.995155 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.995316 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.995270 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.995631 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.995613 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.997236 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.997209 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:18.997635 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:18.997614 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:19.003592 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:19.003562 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77srr\" (UniqueName: \"kubernetes.io/projected/7de428e5-17cb-4bf2-a8cd-efaa86e7345d-kube-api-access-77srr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hj4s\" (UID: \"7de428e5-17cb-4bf2-a8cd-efaa86e7345d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:19.128751 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:19.128661 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:19.269523 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:19.269484 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s"] Jul 20 19:35:19.272440 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:35:19.272400 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de428e5_17cb_4bf2_a8cd_efaa86e7345d.slice/crio-b11ba73c4e78348fe69f7cde6f830db8168e2bafdd47da45180ac2940c3f10ad WatchSource:0}: Error finding container b11ba73c4e78348fe69f7cde6f830db8168e2bafdd47da45180ac2940c3f10ad: Status 404 returned error can't find the container with id b11ba73c4e78348fe69f7cde6f830db8168e2bafdd47da45180ac2940c3f10ad Jul 20 19:35:20.063714 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:20.063669 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" event={"ID":"7de428e5-17cb-4bf2-a8cd-efaa86e7345d","Type":"ContainerStarted","Data":"b11ba73c4e78348fe69f7cde6f830db8168e2bafdd47da45180ac2940c3f10ad"} Jul 20 19:35:21.070031 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:21.069992 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" event={"ID":"7de428e5-17cb-4bf2-a8cd-efaa86e7345d","Type":"ContainerStarted","Data":"0cfcb7ea7e2937fc4b3489f3f7b72af3916417d22016a73742a2ebc5a6bf135c"} Jul 20 19:35:21.087013 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:21.086741 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" podStartSLOduration=2.05420886 podStartE2EDuration="3.086717403s" totalImagesPullingTime="1.032508543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:35:21.086168001 +0000 UTC m=+789.953469810" watchObservedRunningTime="2026-07-20 19:35:21.086717403 +0000 UTC m=+789.954019198" Jul 20 19:35:29.129384 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:29.129337 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:29.129825 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:29.129421 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:29.142039 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:29.142002 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:35:30.123788 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:35:30.123754 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hj4s" Jul 20 19:36:12.414852 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.414809 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm"] Jul 20 19:36:12.418440 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.418412 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.420838 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.420811 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 20 19:36:12.430405 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.430367 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm"] Jul 20 19:36:12.488991 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.488950 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.489202 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.489015 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.489202 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.489133 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg9kl\" (UniqueName: \"kubernetes.io/projected/8387c152-0847-4345-a865-fd54add8cfbd-kube-api-access-dg9kl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.489374 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.489209 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.489374 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.489287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.489374 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.489351 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8387c152-0847-4345-a865-fd54add8cfbd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.590744 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.590708 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.590744 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.590748 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8387c152-0847-4345-a865-fd54add8cfbd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.591008 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.590778 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.591008 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.590881 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.591008 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.590969 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg9kl\" (UniqueName: \"kubernetes.io/projected/8387c152-0847-4345-a865-fd54add8cfbd-kube-api-access-dg9kl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.591152 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.591034 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.591207 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.591188 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.591413 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.591393 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.591508 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.591460 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.593793 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.593742 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8387c152-0847-4345-a865-fd54add8cfbd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.594004 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.593935 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8387c152-0847-4345-a865-fd54add8cfbd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.599830 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.599803 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg9kl\" (UniqueName: \"kubernetes.io/projected/8387c152-0847-4345-a865-fd54add8cfbd-kube-api-access-dg9kl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqrwm\" (UID: \"8387c152-0847-4345-a865-fd54add8cfbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.732402 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.732307 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:12.880269 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:12.880242 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm"] Jul 20 19:36:12.883026 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:36:12.882995 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8387c152_0847_4345_a865_fd54add8cfbd.slice/crio-61b2f2c715d37ca3d4912d5d68f1a8da6b1bbc223a0eaf181dd89f2bf2bfbe19 WatchSource:0}: Error finding container 61b2f2c715d37ca3d4912d5d68f1a8da6b1bbc223a0eaf181dd89f2bf2bfbe19: Status 404 returned error can't find the container with id 61b2f2c715d37ca3d4912d5d68f1a8da6b1bbc223a0eaf181dd89f2bf2bfbe19 Jul 20 19:36:13.318069 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:13.318030 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" event={"ID":"8387c152-0847-4345-a865-fd54add8cfbd","Type":"ContainerStarted","Data":"6fa5e65baa9b2465b74922175594e4378910c4ee53f2e626eefd4054d74e6a68"} Jul 20 19:36:13.318252 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:13.318088 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" event={"ID":"8387c152-0847-4345-a865-fd54add8cfbd","Type":"ContainerStarted","Data":"61b2f2c715d37ca3d4912d5d68f1a8da6b1bbc223a0eaf181dd89f2bf2bfbe19"} Jul 20 19:36:13.336210 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:13.336150 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" podStartSLOduration=1.063415658 podStartE2EDuration="1.336128789s" totalImagesPullingTime="272.713131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:36:13.334488112 +0000 UTC m=+842.201789944" watchObservedRunningTime="2026-07-20 19:36:13.336128789 +0000 UTC m=+842.203430584" Jul 20 19:36:22.733489 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:22.733437 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:22.733954 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:22.733524 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:22.746403 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:22.746369 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:23.378722 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:23.378691 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqrwm" Jul 20 19:36:27.512780 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.512743 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd"] Jul 20 19:36:27.516641 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.516611 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.519074 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.519046 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 20 19:36:27.526107 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.526074 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd"] Jul 20 19:36:27.632066 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.632020 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.632251 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.632074 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.632251 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.632148 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca9fc68-6062-4f22-966d-86ca4d21a330-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.632251 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.632171 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8v6w\" (UniqueName: \"kubernetes.io/projected/eca9fc68-6062-4f22-966d-86ca4d21a330-kube-api-access-r8v6w\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.632251 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.632212 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.632432 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.632349 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.733101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.733054 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.733101 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.733100 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.733408 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.733136 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca9fc68-6062-4f22-966d-86ca4d21a330-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.733408 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.733155 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8v6w\" (UniqueName: \"kubernetes.io/projected/eca9fc68-6062-4f22-966d-86ca4d21a330-kube-api-access-r8v6w\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.733408 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.733189 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.733408 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.733348 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.733683 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.733661 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.733752 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.733668 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.733752 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.733718 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.735436 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.735412 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca9fc68-6062-4f22-966d-86ca4d21a330-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.735783 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.735764 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca9fc68-6062-4f22-966d-86ca4d21a330-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.741370 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.741341 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8v6w\" (UniqueName: \"kubernetes.io/projected/eca9fc68-6062-4f22-966d-86ca4d21a330-kube-api-access-r8v6w\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd\" (UID: \"eca9fc68-6062-4f22-966d-86ca4d21a330\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.836287 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.836194 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:27.984758 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:27.984558 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd"] Jul 20 19:36:27.987639 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:36:27.987603 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeca9fc68_6062_4f22_966d_86ca4d21a330.slice/crio-c5e435d6b27e44f223cd95f3b6d674a7a0315e80a04f52e486294d169ce6e6d8 WatchSource:0}: Error finding container c5e435d6b27e44f223cd95f3b6d674a7a0315e80a04f52e486294d169ce6e6d8: Status 404 returned error can't find the container with id c5e435d6b27e44f223cd95f3b6d674a7a0315e80a04f52e486294d169ce6e6d8 Jul 20 19:36:28.392689 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:28.392640 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" event={"ID":"eca9fc68-6062-4f22-966d-86ca4d21a330","Type":"ContainerStarted","Data":"bfbcfa60d27b35dae7d50f595537af4cdc11811728ef64da746f117ea215273e"} Jul 20 19:36:28.392868 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:28.392698 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" event={"ID":"eca9fc68-6062-4f22-966d-86ca4d21a330","Type":"ContainerStarted","Data":"c5e435d6b27e44f223cd95f3b6d674a7a0315e80a04f52e486294d169ce6e6d8"} Jul 20 19:36:28.413659 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:28.413599 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" podStartSLOduration=1.186062127 podStartE2EDuration="1.413580156s" totalImagesPullingTime="227.518029ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:36:28.409508027 +0000 UTC m=+857.276809841" watchObservedRunningTime="2026-07-20 19:36:28.413580156 +0000 UTC m=+857.280881951" Jul 20 19:36:37.836639 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:37.836596 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:37.836639 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:37.836645 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:37.849435 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:37.849408 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:36:38.459255 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:36:38.459220 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd" Jul 20 19:44:31.596913 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:31.596872 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v"] Jul 20 19:44:31.599772 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:31.597076 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" podUID="3f655666-ce66-49e5-a026-233686c24657" containerName="manager" containerID="cri-o://a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c" gracePeriod=10 Jul 20 19:44:35.365375 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.365345 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:44:35.518625 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.518585 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f655666-ce66-49e5-a026-233686c24657-extensions-socket-volume\") pod \"3f655666-ce66-49e5-a026-233686c24657\" (UID: \"3f655666-ce66-49e5-a026-233686c24657\") " Jul 20 19:44:35.518814 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.518716 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tb4t\" (UniqueName: \"kubernetes.io/projected/3f655666-ce66-49e5-a026-233686c24657-kube-api-access-9tb4t\") pod \"3f655666-ce66-49e5-a026-233686c24657\" (UID: \"3f655666-ce66-49e5-a026-233686c24657\") " Jul 20 19:44:35.518984 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.518960 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f655666-ce66-49e5-a026-233686c24657-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3f655666-ce66-49e5-a026-233686c24657" (UID: "3f655666-ce66-49e5-a026-233686c24657"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:44:35.520871 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.520837 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f655666-ce66-49e5-a026-233686c24657-kube-api-access-9tb4t" (OuterVolumeSpecName: "kube-api-access-9tb4t") pod "3f655666-ce66-49e5-a026-233686c24657" (UID: "3f655666-ce66-49e5-a026-233686c24657"). InnerVolumeSpecName "kube-api-access-9tb4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:44:35.619496 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.619442 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tb4t\" (UniqueName: \"kubernetes.io/projected/3f655666-ce66-49e5-a026-233686c24657-kube-api-access-9tb4t\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:44:35.619496 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.619488 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f655666-ce66-49e5-a026-233686c24657-extensions-socket-volume\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:44:35.846001 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.845909 2555 generic.go:356] "Generic (PLEG): container finished" podID="3f655666-ce66-49e5-a026-233686c24657" containerID="a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c" exitCode=0 Jul 20 19:44:35.846001 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.845966 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" Jul 20 19:44:35.846234 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.845995 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" event={"ID":"3f655666-ce66-49e5-a026-233686c24657","Type":"ContainerDied","Data":"a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c"} Jul 20 19:44:35.846234 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.846096 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v" event={"ID":"3f655666-ce66-49e5-a026-233686c24657","Type":"ContainerDied","Data":"8d390214c5fa21f8c1cc2a72c31bcaafb75eb6426a7f3f49601d51700f4a5a90"} Jul 20 19:44:35.846234 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.846127 2555 scope.go:117] "RemoveContainer" containerID="a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c" Jul 20 19:44:35.856565 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.856539 2555 scope.go:117] "RemoveContainer" containerID="a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c" Jul 20 19:44:35.856926 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:44:35.856904 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c\": container with ID starting with a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c not found: ID does not exist" containerID="a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c" Jul 20 19:44:35.856976 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.856938 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c"} err="failed to get container status \"a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c\": rpc error: code = NotFound desc = could not find container \"a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c\": container with ID starting with a083a8eb218937ba886b72726d0aa7458e790872cb756ff87d8ad5692b2ba60c not found: ID does not exist" Jul 20 19:44:35.868681 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.868615 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v"] Jul 20 19:44:35.876611 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.873676 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ghn5v"] Jul 20 19:44:35.885886 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:44:35.885849 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f655666-ce66-49e5-a026-233686c24657" path="/var/lib/kubelet/pods/3f655666-ce66-49e5-a026-233686c24657/volumes" Jul 20 19:45:00.145387 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:00.145342 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-dcmqf"] Jul 20 19:45:00.145806 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:00.145772 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f655666-ce66-49e5-a026-233686c24657" containerName="manager" Jul 20 19:45:00.145806 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:00.145784 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f655666-ce66-49e5-a026-233686c24657" containerName="manager" Jul 20 19:45:00.145885 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:00.145845 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f655666-ce66-49e5-a026-233686c24657" containerName="manager" Jul 20 19:45:00.148983 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:00.148964 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-dcmqf" Jul 20 19:45:00.151548 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:00.151524 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 19:45:00.156102 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:00.156063 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-dcmqf"] Jul 20 19:45:00.161619 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:00.161591 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-dcmqf" Jul 20 19:45:00.306954 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:00.306917 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-dcmqf"] Jul 20 19:45:00.309786 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:45:00.309745 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c9ae1d_d8ce_422a_b4be_cbcbe2738d16.slice/crio-03df1a061d4b21b283ffadd4296feea9d4e082246e27b767e4293e7be5ea01fa WatchSource:0}: Error finding container 03df1a061d4b21b283ffadd4296feea9d4e082246e27b767e4293e7be5ea01fa: Status 404 returned error can't find the container with id 03df1a061d4b21b283ffadd4296feea9d4e082246e27b767e4293e7be5ea01fa Jul 20 19:45:00.311730 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:00.311713 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:45:00.981736 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:00.981690 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-dcmqf" event={"ID":"96c9ae1d-d8ce-422a-b4be-cbcbe2738d16","Type":"ContainerStarted","Data":"03df1a061d4b21b283ffadd4296feea9d4e082246e27b767e4293e7be5ea01fa"} Jul 20 19:45:04.000531 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:04.000437 2555 generic.go:356] "Generic (PLEG): container finished" podID="96c9ae1d-d8ce-422a-b4be-cbcbe2738d16" containerID="b0e7b0022dc36b9ca36e8a73ce4663bff97c2c72f9d9a1a231fa6ea88facb5a2" exitCode=0 Jul 20 19:45:04.000898 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:04.000528 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-dcmqf" event={"ID":"96c9ae1d-d8ce-422a-b4be-cbcbe2738d16","Type":"ContainerDied","Data":"b0e7b0022dc36b9ca36e8a73ce4663bff97c2c72f9d9a1a231fa6ea88facb5a2"} Jul 20 19:45:05.140851 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:05.140814 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-dcmqf" Jul 20 19:45:06.012057 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:06.012024 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-dcmqf" Jul 20 19:45:06.012225 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:06.012054 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-dcmqf" event={"ID":"96c9ae1d-d8ce-422a-b4be-cbcbe2738d16","Type":"ContainerDied","Data":"03df1a061d4b21b283ffadd4296feea9d4e082246e27b767e4293e7be5ea01fa"} Jul 20 19:45:06.012225 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:06.012101 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03df1a061d4b21b283ffadd4296feea9d4e082246e27b767e4293e7be5ea01fa" Jul 20 19:45:32.757163 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.757124 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz"] Jul 20 19:45:32.757632 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.757587 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c9ae1d-d8ce-422a-b4be-cbcbe2738d16" containerName="cleanup" Jul 20 19:45:32.757632 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.757603 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c9ae1d-d8ce-422a-b4be-cbcbe2738d16" containerName="cleanup" Jul 20 19:45:32.757710 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.757671 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c9ae1d-d8ce-422a-b4be-cbcbe2738d16" containerName="cleanup" Jul 20 19:45:32.766141 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.766111 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" Jul 20 19:45:32.768661 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.768628 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 19:45:32.768803 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.768628 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 19:45:32.768803 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.768675 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jb89k\"" Jul 20 19:45:32.774457 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.774431 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz"] Jul 20 19:45:32.858528 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.858477 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t6ql\" (UniqueName: \"kubernetes.io/projected/b4cab0bd-2eee-47ea-a18b-897b31ae8f32-kube-api-access-9t6ql\") pod \"kuadrant-operator-controller-manager-86878c769f-k7khz\" (UID: \"b4cab0bd-2eee-47ea-a18b-897b31ae8f32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" Jul 20 19:45:32.858743 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.858649 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4cab0bd-2eee-47ea-a18b-897b31ae8f32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k7khz\" (UID: \"b4cab0bd-2eee-47ea-a18b-897b31ae8f32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" Jul 20 19:45:32.959534 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.959492 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t6ql\" (UniqueName: \"kubernetes.io/projected/b4cab0bd-2eee-47ea-a18b-897b31ae8f32-kube-api-access-9t6ql\") pod \"kuadrant-operator-controller-manager-86878c769f-k7khz\" (UID: \"b4cab0bd-2eee-47ea-a18b-897b31ae8f32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" Jul 20 19:45:32.959717 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.959587 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4cab0bd-2eee-47ea-a18b-897b31ae8f32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k7khz\" (UID: \"b4cab0bd-2eee-47ea-a18b-897b31ae8f32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" Jul 20 19:45:32.959984 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.959957 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4cab0bd-2eee-47ea-a18b-897b31ae8f32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k7khz\" (UID: \"b4cab0bd-2eee-47ea-a18b-897b31ae8f32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" Jul 20 19:45:32.968610 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:32.968574 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t6ql\" (UniqueName: \"kubernetes.io/projected/b4cab0bd-2eee-47ea-a18b-897b31ae8f32-kube-api-access-9t6ql\") pod \"kuadrant-operator-controller-manager-86878c769f-k7khz\" (UID: \"b4cab0bd-2eee-47ea-a18b-897b31ae8f32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" Jul 20 19:45:33.078773 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:33.078731 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" Jul 20 19:45:33.256567 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:33.256538 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz"] Jul 20 19:45:33.260511 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:45:33.260450 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4cab0bd_2eee_47ea_a18b_897b31ae8f32.slice/crio-8261d867560fadc7479f3c7de204b00f398660fa489b6abf57cd7cddc11923e7 WatchSource:0}: Error finding container 8261d867560fadc7479f3c7de204b00f398660fa489b6abf57cd7cddc11923e7: Status 404 returned error can't find the container with id 8261d867560fadc7479f3c7de204b00f398660fa489b6abf57cd7cddc11923e7 Jul 20 19:45:34.159628 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:34.159580 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" event={"ID":"b4cab0bd-2eee-47ea-a18b-897b31ae8f32","Type":"ContainerStarted","Data":"610f2cdd3b718ceeeadd0ff38ccdc956b21138d376fe19d47b81d4bee1379d4d"} Jul 20 19:45:34.160034 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:34.159650 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" event={"ID":"b4cab0bd-2eee-47ea-a18b-897b31ae8f32","Type":"ContainerStarted","Data":"8261d867560fadc7479f3c7de204b00f398660fa489b6abf57cd7cddc11923e7"} Jul 20 19:45:34.160034 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:34.159678 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" Jul 20 19:45:34.180365 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:34.180272 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" podStartSLOduration=2.180248454 podStartE2EDuration="2.180248454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:45:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:45:34.176939612 +0000 UTC m=+1403.044241408" watchObservedRunningTime="2026-07-20 19:45:34.180248454 +0000 UTC m=+1403.047550241" Jul 20 19:45:45.166854 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:45:45.166817 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7khz" Jul 20 19:52:35.998776 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:35.998727 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m"] Jul 20 19:52:36.002641 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.002608 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.005521 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.005492 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4d9731fc-openshift-default-dockercfg-jhgl9\"" Jul 20 19:52:36.022478 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.022435 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m"] Jul 20 19:52:36.118745 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.118697 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f02909c8-b499-49c2-a651-44e82bc1b1ae-istiod-ca-cert\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.118980 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.118754 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-data\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.118980 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.118787 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wphdc\" (UniqueName: \"kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-kube-api-access-wphdc\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.118980 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.118864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-podinfo\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.118980 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.118924 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-credential-socket\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.119191 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.118993 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-token\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.119191 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.119056 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-envoy\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.119191 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.119159 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-socket\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.119329 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.119200 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-certs\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.219867 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.219825 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f02909c8-b499-49c2-a651-44e82bc1b1ae-istiod-ca-cert\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.219867 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.219869 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-data\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220130 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.219890 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wphdc\" (UniqueName: \"kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-kube-api-access-wphdc\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220130 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.219914 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-podinfo\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220130 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.219951 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-credential-socket\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220130 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.219993 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-token\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220130 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.220044 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-envoy\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220130 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.220094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-socket\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220504 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.220134 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-certs\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220504 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.220376 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-data\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220673 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.220653 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-certs\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220750 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.220729 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-socket\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220810 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.220758 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f02909c8-b499-49c2-a651-44e82bc1b1ae-istiod-ca-cert\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.220810 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.220730 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-credential-socket\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.222628 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.222601 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-podinfo\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.222628 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.222617 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-envoy\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.228201 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.228172 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-token\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.228438 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.228413 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wphdc\" (UniqueName: \"kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-kube-api-access-wphdc\") pod \"e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.315720 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.315669 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:36.480483 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.480438 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m"] Jul 20 19:52:36.482559 ip-10-0-143-187 kubenswrapper[2555]: W0720 19:52:36.482530 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02909c8_b499_49c2_a651_44e82bc1b1ae.slice/crio-0d43689ba6cd982f7c5e167a251f8f38b89d241d93799e1309f4eece2673efeb WatchSource:0}: Error finding container 0d43689ba6cd982f7c5e167a251f8f38b89d241d93799e1309f4eece2673efeb: Status 404 returned error can't find the container with id 0d43689ba6cd982f7c5e167a251f8f38b89d241d93799e1309f4eece2673efeb Jul 20 19:52:36.485100 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.485068 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:52:36.485213 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.485153 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:52:36.485213 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:36.485201 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:52:37.295787 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:37.295746 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" event={"ID":"f02909c8-b499-49c2-a651-44e82bc1b1ae","Type":"ContainerStarted","Data":"4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8"} Jul 20 19:52:37.296160 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:37.295806 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" event={"ID":"f02909c8-b499-49c2-a651-44e82bc1b1ae","Type":"ContainerStarted","Data":"0d43689ba6cd982f7c5e167a251f8f38b89d241d93799e1309f4eece2673efeb"} Jul 20 19:52:37.316076 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:37.315999 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:37.318734 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:37.318677 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" podStartSLOduration=2.318656349 podStartE2EDuration="2.318656349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:52:37.316048432 +0000 UTC m=+1826.183350241" watchObservedRunningTime="2026-07-20 19:52:37.318656349 +0000 UTC m=+1826.185958144" Jul 20 19:52:37.321424 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:37.321395 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:38.301585 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:38.301541 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:38.302705 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:38.302683 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:54.344546 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:54.344499 2555 patch_prober.go:28] interesting pod/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 19:52:54.344998 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:54.344571 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 20 19:52:55.389399 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:55.389360 2555 generic.go:356] "Generic (PLEG): container finished" podID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerID="4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8" exitCode=0 Jul 20 19:52:55.389855 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:55.389436 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" event={"ID":"f02909c8-b499-49c2-a651-44e82bc1b1ae","Type":"ContainerDied","Data":"4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8"} Jul 20 19:52:55.389954 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:55.389934 2555 scope.go:117] "RemoveContainer" containerID="4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8" Jul 20 19:52:55.391042 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:55.391008 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:52:55.391143 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:55.391076 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:52:55.391143 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:55.391128 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:52:56.404390 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:56.404330 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" event={"ID":"f02909c8-b499-49c2-a651-44e82bc1b1ae","Type":"ContainerStarted","Data":"a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e"} Jul 20 19:52:57.316561 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:57.316509 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:52:57.317114 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:57.317078 2555 patch_prober.go:28] interesting pod/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 20 19:52:57.317242 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:57.317162 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 20 19:52:58.316940 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:58.316899 2555 patch_prober.go:28] interesting pod/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 20 19:52:58.317365 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:58.316955 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 20 19:52:59.317172 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:59.317129 2555 patch_prober.go:28] interesting pod/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 20 19:52:59.317600 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:52:59.317195 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 20 19:53:00.319778 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:00.319741 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:53:00.320155 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:00.320088 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:53:00.320904 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:00.320884 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:53:19.473052 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:19.473004 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m"] Jul 20 19:53:19.473743 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:19.473285 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerName="istio-proxy" containerID="cri-o://a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e" gracePeriod=30 Jul 20 19:53:24.732343 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.732312 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:53:24.898024 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.897983 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wphdc\" (UniqueName: \"kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-kube-api-access-wphdc\") pod \"f02909c8-b499-49c2-a651-44e82bc1b1ae\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " Jul 20 19:53:24.898247 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898060 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-socket\") pod \"f02909c8-b499-49c2-a651-44e82bc1b1ae\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " Jul 20 19:53:24.898247 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898169 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-podinfo\") pod \"f02909c8-b499-49c2-a651-44e82bc1b1ae\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " Jul 20 19:53:24.898406 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898272 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f02909c8-b499-49c2-a651-44e82bc1b1ae-istiod-ca-cert\") pod \"f02909c8-b499-49c2-a651-44e82bc1b1ae\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " Jul 20 19:53:24.898406 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898321 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-credential-socket\") pod \"f02909c8-b499-49c2-a651-44e82bc1b1ae\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " Jul 20 19:53:24.898406 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898336 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f02909c8-b499-49c2-a651-44e82bc1b1ae" (UID: "f02909c8-b499-49c2-a651-44e82bc1b1ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:53:24.898406 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898358 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-token\") pod \"f02909c8-b499-49c2-a651-44e82bc1b1ae\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " Jul 20 19:53:24.898406 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898389 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-certs\") pod \"f02909c8-b499-49c2-a651-44e82bc1b1ae\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " Jul 20 19:53:24.898649 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898475 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-data\") pod \"f02909c8-b499-49c2-a651-44e82bc1b1ae\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " Jul 20 19:53:24.898649 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898506 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-envoy\") pod \"f02909c8-b499-49c2-a651-44e82bc1b1ae\" (UID: \"f02909c8-b499-49c2-a651-44e82bc1b1ae\") " Jul 20 19:53:24.898872 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898851 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-socket\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:53:24.898941 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898503 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f02909c8-b499-49c2-a651-44e82bc1b1ae" (UID: "f02909c8-b499-49c2-a651-44e82bc1b1ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:53:24.898941 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898639 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f02909c8-b499-49c2-a651-44e82bc1b1ae" (UID: "f02909c8-b499-49c2-a651-44e82bc1b1ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:53:24.898941 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.898710 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f02909c8-b499-49c2-a651-44e82bc1b1ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f02909c8-b499-49c2-a651-44e82bc1b1ae" (UID: "f02909c8-b499-49c2-a651-44e82bc1b1ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:53:24.899394 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.899355 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "f02909c8-b499-49c2-a651-44e82bc1b1ae" (UID: "f02909c8-b499-49c2-a651-44e82bc1b1ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:53:24.900580 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.900544 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f02909c8-b499-49c2-a651-44e82bc1b1ae" (UID: "f02909c8-b499-49c2-a651-44e82bc1b1ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:53:24.900580 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.900548 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-kube-api-access-wphdc" (OuterVolumeSpecName: "kube-api-access-wphdc") pod "f02909c8-b499-49c2-a651-44e82bc1b1ae" (UID: "f02909c8-b499-49c2-a651-44e82bc1b1ae"). InnerVolumeSpecName "kube-api-access-wphdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:53:24.900765 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.900620 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "f02909c8-b499-49c2-a651-44e82bc1b1ae" (UID: "f02909c8-b499-49c2-a651-44e82bc1b1ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:53:24.900827 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:24.900813 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f02909c8-b499-49c2-a651-44e82bc1b1ae" (UID: "f02909c8-b499-49c2-a651-44e82bc1b1ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:53:25.000265 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.000228 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-data\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:53:25.000265 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.000260 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-envoy\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:53:25.000265 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.000270 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wphdc\" (UniqueName: \"kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-kube-api-access-wphdc\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:53:25.000600 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.000281 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-podinfo\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:53:25.000600 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.000290 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f02909c8-b499-49c2-a651-44e82bc1b1ae-istiod-ca-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:53:25.000600 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.000323 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-credential-socket\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:53:25.000600 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.000331 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f02909c8-b499-49c2-a651-44e82bc1b1ae-istio-token\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:53:25.000600 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.000340 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f02909c8-b499-49c2-a651-44e82bc1b1ae-workload-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 19:53:25.557155 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.557116 2555 generic.go:356] "Generic (PLEG): container finished" podID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerID="a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e" exitCode=0 Jul 20 19:53:25.557388 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.557168 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" Jul 20 19:53:25.557388 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.557206 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" event={"ID":"f02909c8-b499-49c2-a651-44e82bc1b1ae","Type":"ContainerDied","Data":"a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e"} Jul 20 19:53:25.557388 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.557274 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m" event={"ID":"f02909c8-b499-49c2-a651-44e82bc1b1ae","Type":"ContainerDied","Data":"0d43689ba6cd982f7c5e167a251f8f38b89d241d93799e1309f4eece2673efeb"} Jul 20 19:53:25.557388 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.557332 2555 scope.go:117] "RemoveContainer" containerID="a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e" Jul 20 19:53:25.566896 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.566873 2555 scope.go:117] "RemoveContainer" containerID="4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8" Jul 20 19:53:25.575764 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.575741 2555 scope.go:117] "RemoveContainer" containerID="a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e" Jul 20 19:53:25.576095 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:53:25.576078 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e\": container with ID starting with a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e not found: ID does not exist" containerID="a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e" Jul 20 19:53:25.576150 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.576103 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e"} err="failed to get container status \"a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e\": rpc error: code = NotFound desc = could not find container \"a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e\": container with ID starting with a1c728c710b0fae971054f9ea76b479b8f93ba066d91b411fd9efb276921a03e not found: ID does not exist" Jul 20 19:53:25.576150 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.576121 2555 scope.go:117] "RemoveContainer" containerID="4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8" Jul 20 19:53:25.576419 ip-10-0-143-187 kubenswrapper[2555]: E0720 19:53:25.576398 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8\": container with ID starting with 4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8 not found: ID does not exist" containerID="4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8" Jul 20 19:53:25.576474 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.576426 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8"} err="failed to get container status \"4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8\": rpc error: code = NotFound desc = could not find container \"4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8\": container with ID starting with 4c9c17aefaca0f644eb4da7605dc11a30473fb0d50ef44425bc9a6272dce4de8 not found: ID does not exist" Jul 20 19:53:25.600108 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.600066 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m"] Jul 20 19:53:25.607822 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.607781 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4d9731fc-openshift-default-f96d5dc89-ln57m"] Jul 20 19:53:25.886549 ip-10-0-143-187 kubenswrapper[2555]: I0720 19:53:25.886462 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" path="/var/lib/kubelet/pods/f02909c8-b499-49c2-a651-44e82bc1b1ae/volumes" Jul 20 20:01:11.193657 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.193449 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg"] Jul 20 20:01:11.194842 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.194816 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerName="istio-proxy" Jul 20 20:01:11.194985 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.194974 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerName="istio-proxy" Jul 20 20:01:11.195099 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.195089 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerName="istio-proxy" Jul 20 20:01:11.195188 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.195179 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerName="istio-proxy" Jul 20 20:01:11.195956 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.195926 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerName="istio-proxy" Jul 20 20:01:11.195956 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.195955 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f02909c8-b499-49c2-a651-44e82bc1b1ae" containerName="istio-proxy" Jul 20 20:01:11.200178 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.200142 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.203007 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.202975 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-dc9964-openshift-default-dockercfg-rbf9f\"" Jul 20 20:01:11.212053 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.212021 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg"] Jul 20 20:01:11.249684 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.249643 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-certs\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.249684 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.249688 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istiod-ca-cert\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.249911 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.249712 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-token\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.249911 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.249732 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-envoy\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.249911 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.249785 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c22x7\" (UniqueName: \"kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-kube-api-access-c22x7\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.249911 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.249805 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-credential-socket\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.249911 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.249885 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-podinfo\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.250072 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.249931 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-data\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.250072 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.250002 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-socket\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.351187 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.351141 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c22x7\" (UniqueName: \"kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-kube-api-access-c22x7\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.351567 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.351534 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-credential-socket\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.351691 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.351625 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-podinfo\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.351691 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.351673 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-data\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.351829 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.351799 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-socket\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.351892 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.351878 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-certs\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.351947 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.351917 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istiod-ca-cert\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.352000 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.351948 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-token\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.352000 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.351984 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-envoy\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.352102 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.352030 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-credential-socket\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.352102 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.352074 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-data\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.352199 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.352152 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-socket\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.352580 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.352549 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-certs\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.352753 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.352734 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istiod-ca-cert\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.354286 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.354266 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-envoy\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.354475 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.354456 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-podinfo\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.363523 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.363489 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-token\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.363894 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.363869 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c22x7\" (UniqueName: \"kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-kube-api-access-c22x7\") pod \"e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.514271 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.514225 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:11.667677 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.667648 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg"] Jul 20 20:01:11.670098 ip-10-0-143-187 kubenswrapper[2555]: W0720 20:01:11.670070 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85898db0_4dab_4ea0_beb0_5ac5c4ae0fba.slice/crio-a4aab215a672f505b99761b323ae489647107fa080bb374cc772e4b0ab6f334b WatchSource:0}: Error finding container a4aab215a672f505b99761b323ae489647107fa080bb374cc772e4b0ab6f334b: Status 404 returned error can't find the container with id a4aab215a672f505b99761b323ae489647107fa080bb374cc772e4b0ab6f334b Jul 20 20:01:11.672412 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.672377 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:01:11.672499 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.672477 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:01:11.672540 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.672519 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:01:11.896826 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.896718 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" event={"ID":"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba","Type":"ContainerStarted","Data":"3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c"} Jul 20 20:01:11.896826 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.896799 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" event={"ID":"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba","Type":"ContainerStarted","Data":"a4aab215a672f505b99761b323ae489647107fa080bb374cc772e4b0ab6f334b"} Jul 20 20:01:11.924549 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:11.924485 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" podStartSLOduration=0.924454765 podStartE2EDuration="924.454765ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:01:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:01:11.921580054 +0000 UTC m=+2340.788881878" watchObservedRunningTime="2026-07-20 20:01:11.924454765 +0000 UTC m=+2340.791756559" Jul 20 20:01:12.515381 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:12.515335 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:12.520626 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:12.520591 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:12.901911 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:12.901830 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:12.902710 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:12.902690 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:25.968343 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:25.968278 2555 generic.go:356] "Generic (PLEG): container finished" podID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerID="3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c" exitCode=0 Jul 20 20:01:25.968758 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:25.968429 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" event={"ID":"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba","Type":"ContainerDied","Data":"3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c"} Jul 20 20:01:25.968947 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:25.968928 2555 scope.go:117] "RemoveContainer" containerID="3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c" Jul 20 20:01:25.970137 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:25.970105 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:01:25.970214 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:25.970192 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:01:25.970257 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:25.970242 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:01:26.975331 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:26.975280 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" event={"ID":"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba","Type":"ContainerStarted","Data":"38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44"} Jul 20 20:01:27.514741 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:27.514690 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:27.516270 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:27.516229 2555 patch_prober.go:28] interesting pod/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 20 20:01:27.516456 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:27.516321 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 20 20:01:27.902187 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:27.902089 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:28.515035 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:28.514985 2555 patch_prober.go:28] interesting pod/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 20 20:01:28.515576 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:28.515060 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 20 20:01:29.515467 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:29.515436 2555 patch_prober.go:28] interesting pod/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 20 20:01:29.516139 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:29.516113 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 20 20:01:30.515717 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:30.515663 2555 patch_prober.go:28] interesting pod/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 20 20:01:30.516249 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:30.515744 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 20 20:01:31.520157 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:31.520121 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:01:31.521362 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:01:31.521337 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:03:24.202863 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:24.202811 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg"] Jul 20 20:03:24.203418 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:24.203118 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerName="istio-proxy" containerID="cri-o://38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44" gracePeriod=30 Jul 20 20:03:29.459284 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.459246 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:03:29.607591 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.607512 2555 generic.go:356] "Generic (PLEG): container finished" podID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerID="38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44" exitCode=0 Jul 20 20:03:29.607591 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.607569 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" Jul 20 20:03:29.607864 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.607593 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" event={"ID":"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba","Type":"ContainerDied","Data":"38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44"} Jul 20 20:03:29.607864 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.607682 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg" event={"ID":"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba","Type":"ContainerDied","Data":"a4aab215a672f505b99761b323ae489647107fa080bb374cc772e4b0ab6f334b"} Jul 20 20:03:29.607864 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.607741 2555 scope.go:117] "RemoveContainer" containerID="38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44" Jul 20 20:03:29.611563 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.611529 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-podinfo\") pod \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " Jul 20 20:03:29.611714 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.611584 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istiod-ca-cert\") pod \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " Jul 20 20:03:29.611714 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.611642 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-certs\") pod \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " Jul 20 20:03:29.611714 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.611686 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-socket\") pod \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " Jul 20 20:03:29.611873 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.611721 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c22x7\" (UniqueName: \"kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-kube-api-access-c22x7\") pod \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " Jul 20 20:03:29.611873 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.611768 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-data\") pod \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " Jul 20 20:03:29.611873 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.611833 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-envoy\") pod \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " Jul 20 20:03:29.611873 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.611868 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-credential-socket\") pod \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " Jul 20 20:03:29.612079 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.611908 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-token\") pod \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\" (UID: \"85898db0-4dab-4ea0-beb0-5ac5c4ae0fba\") " Jul 20 20:03:29.612079 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.612024 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" (UID: "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:03:29.612368 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.612244 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" (UID: "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:03:29.612368 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.612258 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-socket\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:03:29.612523 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.612367 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" (UID: "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:03:29.612945 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.612884 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-data" (OuterVolumeSpecName: "istio-data") pod "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" (UID: "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:03:29.614062 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.614020 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" (UID: "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:03:29.614915 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.614893 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" (UID: "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:03:29.614915 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.614903 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-token" (OuterVolumeSpecName: "istio-token") pod "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" (UID: "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:03:29.614915 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.614889 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-kube-api-access-c22x7" (OuterVolumeSpecName: "kube-api-access-c22x7") pod "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" (UID: "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba"). InnerVolumeSpecName "kube-api-access-c22x7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:03:29.615261 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.615243 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" (UID: "85898db0-4dab-4ea0-beb0-5ac5c4ae0fba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 20:03:29.618718 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.618694 2555 scope.go:117] "RemoveContainer" containerID="3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c" Jul 20 20:03:29.635458 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.635429 2555 scope.go:117] "RemoveContainer" containerID="38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44" Jul 20 20:03:29.635822 ip-10-0-143-187 kubenswrapper[2555]: E0720 20:03:29.635799 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44\": container with ID starting with 38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44 not found: ID does not exist" containerID="38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44" Jul 20 20:03:29.635924 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.635836 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44"} err="failed to get container status \"38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44\": rpc error: code = NotFound desc = could not find container \"38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44\": container with ID starting with 38b67cc3d8c9466e64d63a1ee0d6c7450bac43b3ed841ca2f9817e6137be6f44 not found: ID does not exist" Jul 20 20:03:29.635924 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.635863 2555 scope.go:117] "RemoveContainer" containerID="3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c" Jul 20 20:03:29.636210 ip-10-0-143-187 kubenswrapper[2555]: E0720 20:03:29.636187 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c\": container with ID starting with 3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c not found: ID does not exist" containerID="3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c" Jul 20 20:03:29.636254 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.636219 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c"} err="failed to get container status \"3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c\": rpc error: code = NotFound desc = could not find container \"3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c\": container with ID starting with 3afb6054c7d4e525a205160ba7049cdc3c47a11e06d7384f726324259156e77c not found: ID does not exist" Jul 20 20:03:29.712940 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.712898 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-envoy\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:03:29.712940 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.712933 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-credential-socket\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:03:29.713151 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.712964 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-token\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:03:29.713151 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.712973 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-podinfo\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:03:29.713151 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.712981 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istiod-ca-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:03:29.713151 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.712991 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-workload-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:03:29.713151 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.712999 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c22x7\" (UniqueName: \"kubernetes.io/projected/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-kube-api-access-c22x7\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:03:29.713151 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.713009 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba-istio-data\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:03:29.924675 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.924638 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg"] Jul 20 20:03:29.928628 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:29.928594 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-dc9964-openshift-default-7dcf958c97-q8ksg"] Jul 20 20:03:31.885513 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:03:31.885467 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" path="/var/lib/kubelet/pods/85898db0-4dab-4ea0-beb0-5ac5c4ae0fba/volumes" Jul 20 20:04:51.209497 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.209449 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm"] Jul 20 20:04:51.210141 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.210097 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerName="istio-proxy" Jul 20 20:04:51.210141 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.210120 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerName="istio-proxy" Jul 20 20:04:51.210266 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.210221 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerName="istio-proxy" Jul 20 20:04:51.213332 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.213308 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.216033 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.216007 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-6fb9c1-openshift-default-dockercfg-6f8fx\"" Jul 20 20:04:51.237484 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.237415 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm"] Jul 20 20:04:51.294974 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.294936 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-data\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.295166 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.294983 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgh92\" (UniqueName: \"kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-kube-api-access-fgh92\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.295166 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.295057 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-envoy\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.295166 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.295147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-token\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.295356 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.295198 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-credential-socket\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.295356 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.295252 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-certs\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.295356 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.295315 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-socket\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.295356 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.295344 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istiod-ca-cert\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.295547 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.295376 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-podinfo\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.396551 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.396505 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-data\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.396739 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.396569 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgh92\" (UniqueName: \"kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-kube-api-access-fgh92\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.396739 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.396623 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-envoy\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.396739 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.396664 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-token\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.396739 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.396693 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-credential-socket\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.396739 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.396737 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-certs\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.397002 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.396782 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-socket\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.397002 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.396813 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istiod-ca-cert\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.397002 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.396857 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-podinfo\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.397169 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.397133 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-certs\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.397229 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.397169 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-credential-socket\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.397229 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.397214 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-socket\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.397377 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.397354 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-data\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.397781 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.397720 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istiod-ca-cert\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.399085 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.399058 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-envoy\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.399552 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.399530 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-podinfo\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.406500 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.406469 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgh92\" (UniqueName: \"kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-kube-api-access-fgh92\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.406764 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.406741 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-token\") pod \"e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.523987 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.523946 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:51.684509 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.684460 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm"] Jul 20 20:04:51.687892 ip-10-0-143-187 kubenswrapper[2555]: W0720 20:04:51.687859 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c3ff6c_104e_4ae5_a055_3fa03c1c70bb.slice/crio-d3247f9c43850ded1ee0e73fe2c8eebdedda2f91464d7aead4024a1bd61a351a WatchSource:0}: Error finding container d3247f9c43850ded1ee0e73fe2c8eebdedda2f91464d7aead4024a1bd61a351a: Status 404 returned error can't find the container with id d3247f9c43850ded1ee0e73fe2c8eebdedda2f91464d7aead4024a1bd61a351a Jul 20 20:04:51.690175 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.690138 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:04:51.690277 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.690212 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:04:51.690354 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:51.690274 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:04:52.030496 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:52.030445 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" event={"ID":"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb","Type":"ContainerStarted","Data":"589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2"} Jul 20 20:04:52.030688 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:52.030520 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" event={"ID":"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb","Type":"ContainerStarted","Data":"d3247f9c43850ded1ee0e73fe2c8eebdedda2f91464d7aead4024a1bd61a351a"} Jul 20 20:04:52.051835 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:52.051776 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" podStartSLOduration=1.051756073 podStartE2EDuration="1.051756073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:04:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:04:52.050281382 +0000 UTC m=+2560.917583192" watchObservedRunningTime="2026-07-20 20:04:52.051756073 +0000 UTC m=+2560.919057943" Jul 20 20:04:52.524440 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:52.524396 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:52.529811 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:52.529783 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:53.035918 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:53.035883 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:04:53.037054 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:04:53.037030 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:05:08.281275 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:08.281193 2555 patch_prober.go:28] interesting pod/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:34202->10.132.0.38:15021: read: connection reset by peer" start-of-body= Jul 20 20:05:08.281769 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:08.281415 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:34202->10.132.0.38:15021: read: connection reset by peer" Jul 20 20:05:09.124385 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:09.124338 2555 generic.go:356] "Generic (PLEG): container finished" podID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerID="589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2" exitCode=0 Jul 20 20:05:09.124586 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:09.124411 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" event={"ID":"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb","Type":"ContainerDied","Data":"589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2"} Jul 20 20:05:09.124898 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:09.124883 2555 scope.go:117] "RemoveContainer" containerID="589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2" Jul 20 20:05:09.126015 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:09.125987 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:05:09.126129 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:09.126059 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:05:09.126129 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:09.126100 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 20:05:10.133516 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:10.133477 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" event={"ID":"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb","Type":"ContainerStarted","Data":"b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b"} Jul 20 20:05:10.524537 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:10.524485 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:05:10.524774 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:10.524750 2555 patch_prober.go:28] interesting pod/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 20 20:05:10.524818 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:10.524802 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 20 20:05:11.524413 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:11.524369 2555 patch_prober.go:28] interesting pod/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 20 20:05:11.524837 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:11.524426 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 20 20:05:12.524273 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:12.524236 2555 patch_prober.go:28] interesting pod/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 20 20:05:12.524492 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:12.524328 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 20 20:05:13.524851 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:13.524810 2555 patch_prober.go:28] interesting pod/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 20 20:05:13.525246 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:13.524875 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 20 20:05:14.528021 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:14.527985 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:05:14.528420 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:14.528291 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:05:14.529049 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:05:14.529031 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:12:05.161780 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:05.161741 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm"] Jul 20 20:12:05.162429 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:05.161954 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerName="istio-proxy" containerID="cri-o://b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b" gracePeriod=30 Jul 20 20:12:10.424099 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.424022 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:12:10.517902 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.517855 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-certs\") pod \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " Jul 20 20:12:10.518079 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.517945 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-token\") pod \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " Jul 20 20:12:10.518079 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.517972 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-envoy\") pod \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " Jul 20 20:12:10.518079 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518026 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-podinfo\") pod \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " Jul 20 20:12:10.518637 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518077 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgh92\" (UniqueName: \"kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-kube-api-access-fgh92\") pod \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " Jul 20 20:12:10.518637 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518113 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-socket\") pod \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " Jul 20 20:12:10.518637 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518174 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-data\") pod \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " Jul 20 20:12:10.518637 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518189 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" (UID: "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:12:10.518637 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518214 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istiod-ca-cert\") pod \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " Jul 20 20:12:10.518637 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518264 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-credential-socket\") pod \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\" (UID: \"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb\") " Jul 20 20:12:10.518637 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518487 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" (UID: "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:12:10.519009 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518674 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:12:10.519009 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518696 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-workload-socket\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:12:10.519009 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518812 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" (UID: "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:12:10.519009 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.518909 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" (UID: "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:12:10.519143 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.519089 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" (UID: "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:12:10.520475 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.520447 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" (UID: "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 20:12:10.520581 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.520498 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" (UID: "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:12:10.520757 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.520727 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-kube-api-access-fgh92" (OuterVolumeSpecName: "kube-api-access-fgh92") pod "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" (UID: "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb"). InnerVolumeSpecName "kube-api-access-fgh92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:12:10.520757 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.520727 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" (UID: "07c3ff6c-104e-4ae5-a055-3fa03c1c70bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:12:10.619721 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.619679 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-envoy\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:12:10.619721 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.619713 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-podinfo\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:12:10.619721 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.619724 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgh92\" (UniqueName: \"kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-kube-api-access-fgh92\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:12:10.619960 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.619736 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-data\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:12:10.619960 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.619745 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istiod-ca-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:12:10.619960 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.619755 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-credential-socket\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:12:10.619960 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:10.619764 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb-istio-token\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Jul 20 20:12:11.267311 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.267271 2555 generic.go:356] "Generic (PLEG): container finished" podID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerID="b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b" exitCode=0 Jul 20 20:12:11.267530 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.267343 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" Jul 20 20:12:11.267530 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.267372 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" event={"ID":"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb","Type":"ContainerDied","Data":"b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b"} Jul 20 20:12:11.267530 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.267444 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm" event={"ID":"07c3ff6c-104e-4ae5-a055-3fa03c1c70bb","Type":"ContainerDied","Data":"d3247f9c43850ded1ee0e73fe2c8eebdedda2f91464d7aead4024a1bd61a351a"} Jul 20 20:12:11.267530 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.267486 2555 scope.go:117] "RemoveContainer" containerID="b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b" Jul 20 20:12:11.279266 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.279111 2555 scope.go:117] "RemoveContainer" containerID="589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2" Jul 20 20:12:11.292157 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.291988 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm"] Jul 20 20:12:11.292246 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.292198 2555 scope.go:117] "RemoveContainer" containerID="b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b" Jul 20 20:12:11.292685 ip-10-0-143-187 kubenswrapper[2555]: E0720 20:12:11.292660 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b\": container with ID starting with b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b not found: ID does not exist" containerID="b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b" Jul 20 20:12:11.292781 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.292690 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b"} err="failed to get container status \"b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b\": rpc error: code = NotFound desc = could not find container \"b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b\": container with ID starting with b89df59639e1ac68d6604b2896272624fb57073841b88ab591d031346532881b not found: ID does not exist" Jul 20 20:12:11.292781 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.292712 2555 scope.go:117] "RemoveContainer" containerID="589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2" Jul 20 20:12:11.293020 ip-10-0-143-187 kubenswrapper[2555]: E0720 20:12:11.292998 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2\": container with ID starting with 589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2 not found: ID does not exist" containerID="589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2" Jul 20 20:12:11.293062 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.293029 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2"} err="failed to get container status \"589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2\": rpc error: code = NotFound desc = could not find container \"589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2\": container with ID starting with 589529a7e5f6b2387e9db6c557de71dfa97640caddb434d09d7fec3ce82fe6a2 not found: ID does not exist" Jul 20 20:12:11.296962 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.296932 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-6fb9c1-openshift-default-5c6fc7b95-lpxdm"] Jul 20 20:12:11.886749 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:11.886706 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" path="/var/lib/kubelet/pods/07c3ff6c-104e-4ae5-a055-3fa03c1c70bb/volumes" Jul 20 20:12:12.191519 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:12.191426 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr_6716cc81-3e28-4ce0-a589-4d96891bbb36/copy-manifests/0.log" Jul 20 20:12:12.205200 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:12.205167 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr_6716cc81-3e28-4ce0-a589-4d96891bbb36/manager/0.log" Jul 20 20:12:12.791190 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:12.791162 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742945-dcmqf_96c9ae1d-d8ce-422a-b4be-cbcbe2738d16/cleanup/0.log" Jul 20 20:12:14.980983 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:14.980953 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-k7khz_b4cab0bd-2eee-47ea-a18b-897b31ae8f32/manager/0.log" Jul 20 20:12:15.597571 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:15.597539 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xtkpk_c804680d-78d7-4056-82a7-1eabf0bfeee5/istio-proxy/0.log" Jul 20 20:12:15.737699 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:15.737661 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k2zj8_bc0edf10-2e85-438a-b17a-bd69271b6f0d/discovery/0.log" Jul 20 20:12:16.213127 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:16.213089 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fnctw_a13250b4-4f46-4268-9045-0c5cf1095640/payload-pre-processing/0.log" Jul 20 20:12:16.450220 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:16.450190 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-846958b6c8-gnqdc_ecb392a6-aa16-4f23-a6c0-716ab969d05e/router/0.log" Jul 20 20:12:16.898801 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:16.898772 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-5hj4s_7de428e5-17cb-4bf2-a8cd-efaa86e7345d/main/0.log" Jul 20 20:12:17.261800 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:17.261774 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rqrwm_8387c152-0847-4345-a865-fd54add8cfbd/main/0.log" Jul 20 20:12:17.376228 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:17.376197 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-ljpfd_eca9fc68-6062-4f22-966d-86ca4d21a330/main/0.log" Jul 20 20:12:26.047142 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:26.047105 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9rmms_b9f1e451-881f-4c9e-a681-a7993f2ce583/global-pull-secret-syncer/0.log" Jul 20 20:12:26.223062 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:26.223028 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j22wh_34ef2afb-6a97-4c52-9fc5-f7814f417a54/konnectivity-agent/0.log" Jul 20 20:12:26.329320 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:26.329214 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-187.ec2.internal_055b2da4f7f1fd6f00b0fe6f11d1c89c/haproxy/0.log" Jul 20 20:12:31.861384 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:31.861341 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-k7khz_b4cab0bd-2eee-47ea-a18b-897b31ae8f32/manager/0.log" Jul 20 20:12:33.919357 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:33.919291 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-96ddc_7891fd62-29a5-43c0-9dd8-f492b06b980f/cluster-monitoring-operator/0.log" Jul 20 20:12:34.058726 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.058699 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-7gzhq_c34dfaca-fcf0-46d3-83b7-a28cc772572a/monitoring-plugin/0.log" Jul 20 20:12:34.183118 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.183087 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mlrvq_4828f6d9-66bb-43b7-8f44-8e70c8bc8a01/node-exporter/0.log" Jul 20 20:12:34.206384 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.206334 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mlrvq_4828f6d9-66bb-43b7-8f44-8e70c8bc8a01/kube-rbac-proxy/0.log" Jul 20 20:12:34.235880 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.235851 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mlrvq_4828f6d9-66bb-43b7-8f44-8e70c8bc8a01/init-textfile/0.log" Jul 20 20:12:34.342108 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.342027 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-tdlbz_d541bdd3-b227-482e-b722-c9f6daece869/kube-rbac-proxy-main/0.log" Jul 20 20:12:34.385886 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.385859 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-tdlbz_d541bdd3-b227-482e-b722-c9f6daece869/kube-rbac-proxy-self/0.log" Jul 20 20:12:34.411883 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.411839 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-tdlbz_d541bdd3-b227-482e-b722-c9f6daece869/openshift-state-metrics/0.log" Jul 20 20:12:34.461825 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.461800 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5/prometheus/0.log" Jul 20 20:12:34.492340 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.492282 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5/config-reloader/0.log" Jul 20 20:12:34.520082 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.520041 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5/thanos-sidecar/0.log" Jul 20 20:12:34.545426 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.545398 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5/kube-rbac-proxy-web/0.log" Jul 20 20:12:34.568800 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.568771 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5/kube-rbac-proxy/0.log" Jul 20 20:12:34.591684 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.591650 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5/kube-rbac-proxy-thanos/0.log" Jul 20 20:12:34.617855 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.617773 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cb1e61-1bfc-4db5-82b8-0da5a6dd12c5/init-config-reloader/0.log" Jul 20 20:12:34.648314 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.648264 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-brr44_2601efb3-b6b6-48ab-8a92-fb8d6c728907/prometheus-operator/0.log" Jul 20 20:12:34.669730 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.669684 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-brr44_2601efb3-b6b6-48ab-8a92-fb8d6c728907/kube-rbac-proxy/0.log" Jul 20 20:12:34.867042 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.867011 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-596ff8d6c5-br4j9_5dbeec22-b8b4-46c0-9269-8afe134ab001/thanos-query/0.log" Jul 20 20:12:34.890146 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.890024 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-596ff8d6c5-br4j9_5dbeec22-b8b4-46c0-9269-8afe134ab001/kube-rbac-proxy-web/0.log" Jul 20 20:12:34.912366 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.912335 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-596ff8d6c5-br4j9_5dbeec22-b8b4-46c0-9269-8afe134ab001/kube-rbac-proxy/0.log" Jul 20 20:12:34.934550 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.934522 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-596ff8d6c5-br4j9_5dbeec22-b8b4-46c0-9269-8afe134ab001/prom-label-proxy/0.log" Jul 20 20:12:34.959083 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.959052 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-596ff8d6c5-br4j9_5dbeec22-b8b4-46c0-9269-8afe134ab001/kube-rbac-proxy-rules/0.log" Jul 20 20:12:34.981539 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:34.981512 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-596ff8d6c5-br4j9_5dbeec22-b8b4-46c0-9269-8afe134ab001/kube-rbac-proxy-metrics/0.log" Jul 20 20:12:36.106074 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.106045 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-vps65_fe017135-8f68-479f-971d-ebe27c7b45ff/networking-console-plugin/0.log" Jul 20 20:12:36.713445 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.713410 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx"] Jul 20 20:12:36.713780 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.713767 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerName="istio-proxy" Jul 20 20:12:36.713824 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.713783 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerName="istio-proxy" Jul 20 20:12:36.713824 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.713792 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerName="istio-proxy" Jul 20 20:12:36.713824 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.713798 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerName="istio-proxy" Jul 20 20:12:36.713824 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.713821 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerName="istio-proxy" Jul 20 20:12:36.713959 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.713827 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerName="istio-proxy" Jul 20 20:12:36.713959 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.713880 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="07c3ff6c-104e-4ae5-a055-3fa03c1c70bb" containerName="istio-proxy" Jul 20 20:12:36.713959 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.713889 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="85898db0-4dab-4ea0-beb0-5ac5c4ae0fba" containerName="istio-proxy" Jul 20 20:12:36.717165 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.717140 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.719871 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.719849 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87kz5\"/\"openshift-service-ca.crt\"" Jul 20 20:12:36.720779 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.720760 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87kz5\"/\"kube-root-ca.crt\"" Jul 20 20:12:36.721795 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.721779 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-87kz5\"/\"default-dockercfg-n49t4\"" Jul 20 20:12:36.728770 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.728744 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx"] Jul 20 20:12:36.767863 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.767821 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-sys\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.768063 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.767883 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-lib-modules\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.768063 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.767920 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-podres\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.768063 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.767944 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-proc\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.768063 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.767999 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7cp6\" (UniqueName: \"kubernetes.io/projected/662a82f8-399b-4390-8881-6ed555d49a75-kube-api-access-z7cp6\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.869052 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.869013 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-lib-modules\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.869258 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.869067 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-podres\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.869258 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.869095 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-proc\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.869258 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.869126 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7cp6\" (UniqueName: \"kubernetes.io/projected/662a82f8-399b-4390-8881-6ed555d49a75-kube-api-access-z7cp6\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.869258 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.869176 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-sys\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.869258 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.869217 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-podres\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.869258 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.869218 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-lib-modules\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.869526 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.869224 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-proc\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.869526 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.869335 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/662a82f8-399b-4390-8881-6ed555d49a75-sys\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:36.878553 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:36.878527 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7cp6\" (UniqueName: \"kubernetes.io/projected/662a82f8-399b-4390-8881-6ed555d49a75-kube-api-access-z7cp6\") pod \"perf-node-gather-daemonset-8x5zx\" (UID: \"662a82f8-399b-4390-8881-6ed555d49a75\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:37.028270 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:37.028219 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:37.168085 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:37.168055 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx"] Jul 20 20:12:37.170446 ip-10-0-143-187 kubenswrapper[2555]: W0720 20:12:37.170405 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod662a82f8_399b_4390_8881_6ed555d49a75.slice/crio-ae0b04c3a85505ce36aa3f17acb2b92451dec5716157f990030b579e3b324697 WatchSource:0}: Error finding container ae0b04c3a85505ce36aa3f17acb2b92451dec5716157f990030b579e3b324697: Status 404 returned error can't find the container with id ae0b04c3a85505ce36aa3f17acb2b92451dec5716157f990030b579e3b324697 Jul 20 20:12:37.397497 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:37.397455 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" event={"ID":"662a82f8-399b-4390-8881-6ed555d49a75","Type":"ContainerStarted","Data":"33adc8ea46ad46fd1b637c058d0c77bf79de9fd7b14bea63ac5a18655d2f27f6"} Jul 20 20:12:37.397696 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:37.397518 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" event={"ID":"662a82f8-399b-4390-8881-6ed555d49a75","Type":"ContainerStarted","Data":"ae0b04c3a85505ce36aa3f17acb2b92451dec5716157f990030b579e3b324697"} Jul 20 20:12:37.397696 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:37.397666 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:37.427814 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:37.421893 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" podStartSLOduration=1.421872352 podStartE2EDuration="1.421872352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 20:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:12:37.418876172 +0000 UTC m=+3026.286177967" watchObservedRunningTime="2026-07-20 20:12:37.421872352 +0000 UTC m=+3026.289174149" Jul 20 20:12:37.979905 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:37.979872 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-vksxh_906d399f-cf3a-4f34-bee4-a6dea5614606/volume-data-source-validator/0.log" Jul 20 20:12:39.000179 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:39.000147 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-98l6w_a2f70b15-063d-4c64-a98f-b354db566a4a/dns/0.log" Jul 20 20:12:39.035451 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:39.035423 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-98l6w_a2f70b15-063d-4c64-a98f-b354db566a4a/kube-rbac-proxy/0.log" Jul 20 20:12:39.279113 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:39.279086 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5n9q_7cea5b32-464e-4339-b801-21ec0cc7358c/dns-node-resolver/0.log" Jul 20 20:12:39.894326 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:39.894283 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-982g9_3b6c6f66-551a-4197-804f-77db8a93bde9/node-ca/0.log" Jul 20 20:12:40.930642 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:40.930607 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xtkpk_c804680d-78d7-4056-82a7-1eabf0bfeee5/istio-proxy/0.log" Jul 20 20:12:41.068429 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:41.068397 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k2zj8_bc0edf10-2e85-438a-b17a-bd69271b6f0d/discovery/0.log" Jul 20 20:12:41.308713 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:41.308672 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fnctw_a13250b4-4f46-4268-9045-0c5cf1095640/payload-pre-processing/0.log" Jul 20 20:12:41.374128 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:41.374096 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-846958b6c8-gnqdc_ecb392a6-aa16-4f23-a6c0-716ab969d05e/router/0.log" Jul 20 20:12:42.113652 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:42.113622 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ts6j5_f6f87434-3b09-4f00-be21-45bde7552fe4/serve-healthcheck-canary/0.log" Jul 20 20:12:42.720290 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:42.720260 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cm822_c62deffc-5bfc-4ad1-b566-2f6d8a201bb1/kube-rbac-proxy/0.log" Jul 20 20:12:42.743519 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:42.743481 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cm822_c62deffc-5bfc-4ad1-b566-2f6d8a201bb1/exporter/0.log" Jul 20 20:12:42.769857 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:42.769824 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cm822_c62deffc-5bfc-4ad1-b566-2f6d8a201bb1/extractor/0.log" Jul 20 20:12:43.414599 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:43.414570 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-8x5zx" Jul 20 20:12:45.801878 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:45.801841 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr_6716cc81-3e28-4ce0-a589-4d96891bbb36/manager/0.log" Jul 20 20:12:45.823406 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:45.823380 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6d57ff7c-dhnbr_6716cc81-3e28-4ce0-a589-4d96891bbb36/copy-manifests/0.log" Jul 20 20:12:47.163938 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:47.163905 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xtkpk_c804680d-78d7-4056-82a7-1eabf0bfeee5/istio-proxy/0.log" Jul 20 20:12:47.225288 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:47.225253 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c66c54875-4xmkh_dcd52987-29d8-4dc9-8a8c-a25e35540bfb/manager/0.log" Jul 20 20:12:47.293200 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:47.293168 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k2zj8_bc0edf10-2e85-438a-b17a-bd69271b6f0d/discovery/0.log" Jul 20 20:12:47.401392 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:47.401354 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fnctw_a13250b4-4f46-4268-9045-0c5cf1095640/payload-pre-processing/0.log" Jul 20 20:12:47.439415 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:47.439331 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-846958b6c8-gnqdc_ecb392a6-aa16-4f23-a6c0-716ab969d05e/router/0.log" Jul 20 20:12:48.669019 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:48.668986 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xtkpk_c804680d-78d7-4056-82a7-1eabf0bfeee5/istio-proxy/0.log" Jul 20 20:12:48.805686 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:48.805651 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k2zj8_bc0edf10-2e85-438a-b17a-bd69271b6f0d/discovery/0.log" Jul 20 20:12:48.908401 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:48.908315 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fnctw_a13250b4-4f46-4268-9045-0c5cf1095640/payload-pre-processing/0.log" Jul 20 20:12:48.950466 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:48.950421 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-846958b6c8-gnqdc_ecb392a6-aa16-4f23-a6c0-716ab969d05e/router/0.log" Jul 20 20:12:52.772446 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:52.772411 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-p9chw_79bfcd7c-58d2-4ab1-82e3-cc3786d8edde/kube-storage-version-migrator-operator/1.log" Jul 20 20:12:52.773591 ip-10-0-143-187 kubenswrapper[2555]: I0720 20:12:52.773572 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-p9chw_79bfcd7c-58d2-4ab1-82e3-cc3786d8edde/kube-storage-version-migrator-operator/0.log"