Jul 15 19:26:37.573536 ip-10-0-139-43 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 19:26:37.573550 ip-10-0-139-43 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 19:26:37.573561 ip-10-0-139-43 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 19:26:37.573928 ip-10-0-139-43 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 19:26:47.138892 ip-10-0-139-43 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 19:26:47.138907 ip-10-0-139-43 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8740773c39f24496b3f686f633e91ab4 -- Jul 15 19:28:37.255696 ip-10-0-139-43 systemd[1]: Starting Kubernetes Kubelet... Jul 15 19:28:37.668717 ip-10-0-139-43 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 19:28:37.668717 ip-10-0-139-43 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 19:28:37.668717 ip-10-0-139-43 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 19:28:37.668717 ip-10-0-139-43 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 19:28:37.668717 ip-10-0-139-43 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 19:28:37.669757 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.669612 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 19:28:37.673164 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673148 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673167 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673173 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673176 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673179 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673182 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673185 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673188 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673190 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673193 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673195 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673198 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673202 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673205 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673208 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:28:37.673204 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673211 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673214 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673217 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673219 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673222 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673224 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673227 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673232 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673235 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673237 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673240 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673242 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673244 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673247 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673249 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673251 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673254 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673256 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673258 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673261 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:28:37.673566 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673263 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673266 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673268 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673270 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673273 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673275 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673277 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673280 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673282 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673284 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673287 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673289 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673291 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673293 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673297 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673299 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673302 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673304 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673307 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:28:37.674027 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673310 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673313 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673315 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673317 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673320 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673322 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673324 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673327 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673329 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673331 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673336 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673340 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673342 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673345 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673347 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673350 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673352 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673355 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673357 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:28:37.674524 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673360 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673362 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673365 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673367 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673369 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673372 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673374 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673378 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673381 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673384 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673387 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673389 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673405 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673408 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673413 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673416 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673418 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673421 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673424 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673427 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:28:37.674967 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673429 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:28:37.675451 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673432 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:28:37.675451 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673435 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:28:37.675451 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673437 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:28:37.675451 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673440 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:28:37.675451 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.673442 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:28:37.676766 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676753 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:28:37.676766 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676766 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676770 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676772 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676775 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676778 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676781 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676784 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676787 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676804 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676808 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676811 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676815 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676818 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676821 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676824 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676826 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676829 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676832 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676834 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:28:37.676828 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676837 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676839 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676842 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676845 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676847 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676849 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676852 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676854 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676856 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676859 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676861 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676864 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676866 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676868 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676871 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676873 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676875 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676878 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676880 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676882 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:28:37.677317 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676885 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676887 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676889 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676893 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676897 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676901 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676904 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676908 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676911 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676913 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676916 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676919 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676923 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676926 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676929 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676932 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676935 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676937 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676940 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:28:37.677843 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676943 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676945 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676948 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676951 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676954 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676958 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676961 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676963 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676966 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676968 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676972 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676975 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676977 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676980 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676982 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676985 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676987 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676990 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676992 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:28:37.678297 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676995 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.676997 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677000 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677002 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677005 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677007 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677009 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677012 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677015 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677018 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677022 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677024 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677027 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677029 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677031 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677034 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677036 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677039 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677042 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677044 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:28:37.678764 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677047 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677498 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677506 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677511 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677516 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677520 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677524 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677529 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677533 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677538 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677542 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677546 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677550 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677555 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677560 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677564 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677568 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677573 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677577 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677581 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:28:37.679241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677587 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677592 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677595 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677600 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677604 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677608 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677612 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677619 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677624 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677627 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677630 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677633 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677636 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677639 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677641 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677644 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677647 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677650 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677652 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:28:37.679723 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677654 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677657 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677659 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677662 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677664 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677667 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677669 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677672 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677675 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677679 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677683 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677686 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677688 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677692 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677694 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677698 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677700 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677704 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677708 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:28:37.680182 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677711 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677713 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677716 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677719 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677721 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677724 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677726 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677729 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677731 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677734 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677736 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677740 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677742 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677744 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677747 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677749 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677752 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677754 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677757 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677759 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:28:37.680663 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677762 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677764 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677767 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677770 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677772 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677775 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677778 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677781 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677783 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677786 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677788 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677791 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677793 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677796 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677799 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677801 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677803 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677806 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677808 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677811 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:28:37.681139 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677813 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.677815 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677897 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677908 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677918 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677925 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677931 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677936 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677941 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677945 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677948 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677951 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677954 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677958 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677961 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677964 2576 flags.go:64] FLAG: --cgroup-root="" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677967 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677971 2576 flags.go:64] FLAG: --client-ca-file="" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677974 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677977 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677981 2576 flags.go:64] FLAG: --cluster-domain="" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677984 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677987 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 19:28:37.681630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677990 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677993 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.677998 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678001 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678004 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678007 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678010 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678012 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678015 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678018 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678021 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678025 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678028 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678030 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678033 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678036 2576 flags.go:64] FLAG: --enable-server="true" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678039 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678043 2576 flags.go:64] FLAG: --event-burst="100" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678046 2576 flags.go:64] FLAG: --event-qps="50" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678049 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678051 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678054 2576 flags.go:64] FLAG: --eviction-hard="" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678058 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678060 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678063 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 19:28:37.682197 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678066 2576 flags.go:64] FLAG: --eviction-soft="" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678069 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678076 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678078 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678081 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678084 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678087 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678090 2576 flags.go:64] FLAG: --feature-gates="" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678094 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678097 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678100 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678102 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678105 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678108 2576 flags.go:64] FLAG: --help="false" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678111 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-139-43.ec2.internal" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678114 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678117 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678119 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678122 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678126 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678128 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678131 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678134 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 19:28:37.682806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678136 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678139 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678142 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678145 2576 flags.go:64] FLAG: --kube-reserved="" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678147 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678150 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678153 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678155 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678158 2576 flags.go:64] FLAG: --lock-file="" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678161 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678164 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678170 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678176 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678178 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678181 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678184 2576 flags.go:64] FLAG: --logging-format="text" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678187 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678190 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678193 2576 flags.go:64] FLAG: --manifest-url="" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678195 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678199 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678202 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678206 2576 flags.go:64] FLAG: --max-pods="110" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678209 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678212 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 19:28:37.683379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678215 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678217 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678220 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678223 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678226 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678232 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678235 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678238 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678241 2576 flags.go:64] FLAG: --pod-cidr="" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678244 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678249 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678252 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678255 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678258 2576 flags.go:64] FLAG: --port="10250" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678261 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678264 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-087f2f842579b6ff2" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678267 2576 flags.go:64] FLAG: --qos-reserved="" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678269 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678275 2576 flags.go:64] FLAG: --register-node="true" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678279 2576 flags.go:64] FLAG: --register-with-taints="" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678282 2576 flags.go:64] FLAG: --registry-burst="10" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678285 2576 flags.go:64] FLAG: --registry-qps="5" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678287 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678290 2576 flags.go:64] FLAG: --reserved-memory="" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678294 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 19:28:37.683995 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678297 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678314 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678318 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678321 2576 flags.go:64] FLAG: --runonce="false" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678324 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678327 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678330 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678333 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678335 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678338 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678341 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678344 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678347 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678349 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678352 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678355 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678357 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678360 2576 flags.go:64] FLAG: --system-cgroups="" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678363 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678368 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678371 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678373 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678377 2576 flags.go:64] FLAG: --tls-min-version="" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678380 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678383 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 19:28:37.684621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678388 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678407 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678410 2576 flags.go:64] FLAG: --v="2" Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678414 2576 flags.go:64] FLAG: --version="false" Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678419 2576 flags.go:64] FLAG: --vmodule="" Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678422 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.678425 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678543 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678547 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678551 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678555 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678558 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678561 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678564 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678566 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678568 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678571 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678573 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678576 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678578 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678581 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:28:37.685219 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678583 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678585 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678588 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678590 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678593 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678595 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678598 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678600 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678603 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678605 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678608 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678612 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678616 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678620 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678622 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678625 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678628 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678630 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678633 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678635 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:28:37.685758 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678638 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678640 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678643 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678645 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678648 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678650 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678652 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678655 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678657 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678659 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678662 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678665 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678667 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678670 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678672 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678674 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678677 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678679 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678682 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678684 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:28:37.686241 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678686 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678689 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678691 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678695 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678699 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678702 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678705 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678707 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678709 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678712 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678714 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678718 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678721 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678724 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678727 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678730 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678734 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678737 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678740 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:28:37.686722 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678743 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678745 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678747 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678750 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678752 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678755 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678757 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678759 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678762 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678764 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678767 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678769 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678772 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678774 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678777 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678780 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678783 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678786 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678789 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678791 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:28:37.687274 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678794 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678797 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678800 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678802 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678804 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.678807 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.679413 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.685726 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.685740 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.685758 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.685764 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685820 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685825 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685828 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685832 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:28:37.687767 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685835 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685838 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685841 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685844 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685847 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685850 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685853 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685855 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685858 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685861 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685863 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685866 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685868 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685871 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685873 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685876 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685878 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685882 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685884 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685887 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:28:37.688125 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685890 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685892 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685894 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685897 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685899 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685902 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685905 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685907 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685910 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685912 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685915 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685917 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685920 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685922 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685925 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685927 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685930 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685932 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685935 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685937 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:28:37.688661 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685940 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685942 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685945 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685947 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685951 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685955 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685959 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685962 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685964 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685967 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685970 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685973 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685976 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685978 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685981 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685984 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685986 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685990 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685992 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:28:37.689171 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685995 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.685997 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686000 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686002 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686005 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686007 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686009 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686012 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686014 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686017 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686019 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686022 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686024 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686027 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686030 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686032 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686034 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686037 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686039 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686042 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:28:37.689641 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686044 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686047 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686049 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686052 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686055 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686057 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686060 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686062 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686066 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686069 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686073 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686075 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686078 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686080 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686083 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:28:37.690117 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686085 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.686090 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686199 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686203 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686205 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686208 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686212 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686215 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686218 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686220 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686223 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686225 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686227 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686230 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686232 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:28:37.690487 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686235 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686237 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686240 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686243 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686246 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686248 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686251 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686254 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686257 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686260 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686262 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686265 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686267 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686270 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686272 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686274 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686277 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686279 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686281 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:28:37.690848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686284 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686286 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686289 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686292 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686294 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686296 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686299 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686301 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686304 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686306 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686308 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686311 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686313 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686317 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686320 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686322 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686325 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686328 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686331 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:28:37.691284 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686333 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686335 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686339 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686341 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686344 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686346 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686349 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686353 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686356 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686359 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686361 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686364 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686367 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686369 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686372 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686374 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686377 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686379 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686382 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686384 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:28:37.691738 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686387 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686389 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686405 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686408 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686410 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686413 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686415 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686418 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686420 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686423 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686425 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686427 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686430 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686432 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686435 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686438 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686440 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686443 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686446 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686449 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:28:37.692215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686451 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686453 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686456 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686458 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686461 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686463 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686465 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:37.686468 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.686472 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.686576 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.688335 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.689580 2576 server.go:1019] "Starting client certificate rotation" Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.689686 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 19:28:37.692817 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.689720 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 19:28:37.693130 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.692850 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 19:28:37.699528 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.699510 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 19:28:37.706494 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.706477 2576 log.go:25] "Validated CRI v1 runtime API" Jul 15 19:28:37.708329 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.708314 2576 log.go:25] "Validated CRI v1 image API" Jul 15 19:28:37.709265 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.709245 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 19:28:37.711605 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.711588 2576 fs.go:135] Filesystem UUIDs: map[0fcd4d9e-37dd-4bd8-ae6d-db7e5cdd8be7:/dev/nvme0n1p4 33881a2b-1bfe-4088-b580-e0724707a731:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 15 19:28:37.711663 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.711605 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 19:28:37.716817 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.716705 2576 manager.go:216] Machine: {Timestamp:2026-07-15 19:28:37.715603491 +0000 UTC m=+0.336159122 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092821 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec244f3fd3ab2112907612015bd50d4e SystemUUID:ec244f3f-d3ab-2112-9076-12015bd50d4e BootID:8740773c-39f2-4496-b3f6-86f633e91ab4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6f:38:a9:67:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6f:38:a9:67:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:7e:a1:de:de:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 19:28:37.716817 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.716810 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 19:28:37.716928 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.716881 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 19:28:37.720631 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.720599 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 19:28:37.720777 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.720634 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-43.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 19:28:37.721337 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.721328 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 19:28:37.721370 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.721339 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 19:28:37.721370 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.721347 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 19:28:37.722105 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.722094 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 19:28:37.722178 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.722164 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 19:28:37.723160 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.723149 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 19:28:37.725729 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.725716 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 15 19:28:37.725847 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.725837 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 19:28:37.725879 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.725866 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 15 19:28:37.725879 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.725877 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 19:28:37.725937 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.725891 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 19:28:37.725937 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.725900 2576 kubelet.go:398] "Adding apiserver pod source" Jul 15 19:28:37.725937 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.725910 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 19:28:37.726254 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.726242 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 19:28:37.726300 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.726263 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 19:28:37.731859 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.731843 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 19:28:37.733259 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.733241 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-43.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 19:28:37.733302 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.733276 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 19:28:37.733657 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.733644 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 19:28:37.733694 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.733675 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 19:28:37.733825 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.733816 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 19:28:37.733859 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.733830 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 19:28:37.733859 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.733837 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 19:28:37.733859 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.733843 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 19:28:37.733859 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.733852 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 19:28:37.733859 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.733857 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 19:28:37.734521 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.734507 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 19:28:37.734565 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.734525 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 19:28:37.734565 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.734537 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 19:28:37.734565 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.734544 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 19:28:37.734565 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.734554 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 19:28:37.734565 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.734562 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 19:28:37.736765 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.736754 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 19:28:37.736765 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.736765 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 19:28:37.739102 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.739084 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-43.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 19:28:37.739678 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.739661 2576 server.go:1268] "Started kubelet" Jul 15 19:28:37.739773 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.739727 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 19:28:37.740423 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.740379 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 19:28:37.740498 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.740440 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 19:28:37.741465 ip-10-0-139-43 systemd[1]: Started Kubernetes Kubelet. Jul 15 19:28:37.741716 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.741696 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 19:28:37.743055 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.743040 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 15 19:28:37.747890 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.747873 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 19:28:37.747890 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.747877 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 19:28:37.748012 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.747881 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6h6qc" Jul 15 19:28:37.748060 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.748043 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:37.748447 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.748334 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 19:28:37.748600 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.748578 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 19:28:37.748680 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.748604 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 19:28:37.748730 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.748720 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 15 19:28:37.748730 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.748727 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 15 19:28:37.749103 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.749088 2576 factory.go:153] Registering CRI-O factory Jul 15 19:28:37.749103 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.749105 2576 factory.go:223] Registration of the crio container factory successfully Jul 15 19:28:37.749242 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.749172 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 19:28:37.749242 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.749184 2576 factory.go:55] Registering systemd factory Jul 15 19:28:37.749242 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.749191 2576 factory.go:223] Registration of the systemd container factory successfully Jul 15 19:28:37.749242 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.749210 2576 factory.go:103] Registering Raw factory Jul 15 19:28:37.749242 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.749224 2576 manager.go:1196] Started watching for new ooms in manager Jul 15 19:28:37.749451 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.749246 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 19:28:37.749813 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.749794 2576 manager.go:349] Starting recovery of all containers Jul 15 19:28:37.754264 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.754240 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6h6qc" Jul 15 19:28:37.756295 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.756270 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-43.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 19:28:37.756410 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.756375 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 19:28:37.757357 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.756344 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-43.ec2.internal.18c28d422c1d968b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-43.ec2.internal,UID:ip-10-0-139-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-43.ec2.internal,},FirstTimestamp:2026-07-15 19:28:37.739632267 +0000 UTC m=+0.360187898,LastTimestamp:2026-07-15 19:28:37.739632267 +0000 UTC m=+0.360187898,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-43.ec2.internal,}" Jul 15 19:28:37.759538 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.759435 2576 manager.go:354] Recovery completed Jul 15 19:28:37.764168 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.764153 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:28:37.766019 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.766004 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:28:37.766085 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.766035 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:28:37.766085 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.766049 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:28:37.767061 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.767042 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:28:37.767272 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.767259 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 19:28:37.767361 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.767350 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 19:28:37.767470 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.767460 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 15 19:28:37.767555 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.767464 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-43.ec2.internal.18c28d422db035e5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-43.ec2.internal,UID:ip-10-0-139-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-43.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-43.ec2.internal,},FirstTimestamp:2026-07-15 19:28:37.766018533 +0000 UTC m=+0.386574167,LastTimestamp:2026-07-15 19:28:37.766018533 +0000 UTC m=+0.386574167,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-43.ec2.internal,}" Jul 15 19:28:37.768037 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.768019 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:28:37.768111 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.768049 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:28:37.768111 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.768065 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:28:37.768679 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.768665 2576 policy_none.go:49] "None policy: Start" Jul 15 19:28:37.768741 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.768712 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 19:28:37.768953 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.768938 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 19:28:37.769773 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.769758 2576 policy_none.go:47] "Start" Jul 15 19:28:37.802993 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.802976 2576 manager.go:337] "Starting Device Plugin manager" Jul 15 19:28:37.803107 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.803010 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 19:28:37.803107 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.803020 2576 server.go:87] "Starting device plugin registration server" Jul 15 19:28:37.803250 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.803236 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 19:28:37.803342 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.803250 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 19:28:37.803342 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.803325 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 19:28:37.803476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.803441 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 19:28:37.803476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.803450 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 19:28:37.803978 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.803962 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 19:28:37.804054 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.804008 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:37.872659 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.872624 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 19:28:37.874064 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.874047 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 19:28:37.874157 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.874080 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 19:28:37.874157 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.874102 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 19:28:37.874157 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.874140 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 19:28:37.876515 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.876493 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 19:28:37.903607 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.903575 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:28:37.904385 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.904366 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:28:37.904490 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.904419 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:28:37.904490 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.904433 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:28:37.904490 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.904456 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-43.ec2.internal" Jul 15 19:28:37.912335 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.912319 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-43.ec2.internal" Jul 15 19:28:37.912412 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.912341 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-43.ec2.internal\": node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:37.924838 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:37.924791 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:37.974254 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.974216 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-43.ec2.internal"] Jul 15 19:28:37.974368 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.974295 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:28:37.975768 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.975753 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:28:37.975824 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.975784 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:28:37.975824 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.975798 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:28:37.977017 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.977004 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:28:37.977136 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.977123 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" Jul 15 19:28:37.977181 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.977151 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:28:37.977771 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.977746 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:28:37.977771 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.977746 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:28:37.977900 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.977778 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:28:37.977900 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.977789 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:28:37.977900 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.977798 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:28:37.977900 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.977811 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:28:37.978733 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.978716 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-43.ec2.internal" Jul 15 19:28:37.978816 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.978740 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:28:37.979609 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.979594 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:28:37.979690 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.979621 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:28:37.979690 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:37.979631 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:28:38.002964 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:38.002943 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-43.ec2.internal\" not found" node="ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.007321 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:38.007307 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-43.ec2.internal\" not found" node="ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.025130 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:38.025109 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:38.050701 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:38.050679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61c38c8734564d401d2e7f5c27e757e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal\" (UID: \"61c38c8734564d401d2e7f5c27e757e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.050780 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:38.050703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61c38c8734564d401d2e7f5c27e757e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal\" (UID: \"61c38c8734564d401d2e7f5c27e757e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.050780 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:38.050722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0425377e9b6e234689d75fb08e2e44f2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-43.ec2.internal\" (UID: \"0425377e9b6e234689d75fb08e2e44f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.125973 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:38.125947 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:38.151333 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:38.151310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61c38c8734564d401d2e7f5c27e757e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal\" (UID: \"61c38c8734564d401d2e7f5c27e757e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.151429 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:38.151346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61c38c8734564d401d2e7f5c27e757e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal\" (UID: \"61c38c8734564d401d2e7f5c27e757e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.151429 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:38.151412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0425377e9b6e234689d75fb08e2e44f2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-43.ec2.internal\" (UID: \"0425377e9b6e234689d75fb08e2e44f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.151500 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:38.151442 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61c38c8734564d401d2e7f5c27e757e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal\" (UID: \"61c38c8734564d401d2e7f5c27e757e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.151500 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:38.151440 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61c38c8734564d401d2e7f5c27e757e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal\" (UID: \"61c38c8734564d401d2e7f5c27e757e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.151500 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:38.151461 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0425377e9b6e234689d75fb08e2e44f2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-43.ec2.internal\" (UID: \"0425377e9b6e234689d75fb08e2e44f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.226643 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:38.226568 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:38.305099 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:38.305063 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.309845 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:38.309828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-43.ec2.internal" Jul 15 19:28:38.328083 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:38.328054 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:38.428646 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:38.428602 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:38.529131 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:38.529063 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:38.629721 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:38.629685 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:40.480303 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.480281 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 19:28:40.480761 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.480444 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 19:28:40.496264 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.496248 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 19:28:40.521471 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:40.521443 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:40.549088 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.549059 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 19:23:39 +0000 UTC" deadline="2028-04-30 20:50:36.481721006 +0000 UTC" Jul 15 19:28:40.549088 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.549085 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15721h21m55.932638512s" Jul 15 19:28:40.622436 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:40.622355 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:40.723243 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:40.723199 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-43.ec2.internal\" not found" Jul 15 19:28:40.749401 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:40.749366 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0425377e9b6e234689d75fb08e2e44f2.slice/crio-58ccd8c276fd8ec9566359124c337f3b515b7ff8cf375f58973eaf41cedc5f02 WatchSource:0}: Error finding container 58ccd8c276fd8ec9566359124c337f3b515b7ff8cf375f58973eaf41cedc5f02: Status 404 returned error can't find the container with id 58ccd8c276fd8ec9566359124c337f3b515b7ff8cf375f58973eaf41cedc5f02 Jul 15 19:28:40.753334 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.753320 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 19:28:40.772331 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.772312 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 19:28:40.786563 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:40.786517 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c38c8734564d401d2e7f5c27e757e5.slice/crio-2fd6c572bda4803ce022d775f0b206b7c1c8894dc3470a6144152348ea60d893 WatchSource:0}: Error finding container 2fd6c572bda4803ce022d775f0b206b7c1c8894dc3470a6144152348ea60d893: Status 404 returned error can't find the container with id 2fd6c572bda4803ce022d775f0b206b7c1c8894dc3470a6144152348ea60d893 Jul 15 19:28:40.839915 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.839896 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" Jul 15 19:28:40.851407 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.851383 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 19:28:40.853138 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.853127 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-43.ec2.internal" Jul 15 19:28:40.859332 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.859313 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 19:28:40.897746 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:40.897689 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 19:28:41.517391 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.517360 2576 apiserver.go:52] "Watching apiserver" Jul 15 19:28:41.526844 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.526411 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 19:28:41.527569 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.527379 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-48hp5","openshift-multus/network-metrics-daemon-6g5mh","openshift-network-diagnostics/network-check-target-kjp9f","kube-system/global-pull-secret-syncer-8t59l","kube-system/kube-apiserver-proxy-ip-10-0-139-43.ec2.internal","openshift-cluster-node-tuning-operator/tuned-995n8","openshift-multus/multus-sqjfn","openshift-network-operator/iptables-alerter-b6gsp","openshift-ovn-kubernetes/ovnkube-node-gw8m2","kube-system/konnectivity-agent-rphkg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg","openshift-dns/node-resolver-wvxs6","openshift-image-registry/node-ca-6724x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal"] Jul 15 19:28:41.529208 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.529186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.532299 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.532275 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 19:28:41.532646 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.532628 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-476jv\"" Jul 15 19:28:41.533384 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.532960 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 19:28:41.533384 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.533083 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 19:28:41.533384 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.533224 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 19:28:41.533622 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.533404 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.535497 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.535230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:41.535497 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:41.535307 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:28:41.535904 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.535883 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 19:28:41.536481 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.536180 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 19:28:41.536481 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.536336 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 19:28:41.536481 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.536403 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z7xb4\"" Jul 15 19:28:41.537432 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.537410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:41.537517 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:41.537476 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:28:41.539105 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.539086 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b6gsp" Jul 15 19:28:41.540253 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.540236 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 19:28:41.540921 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.540865 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.541539 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.541512 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-psgg2\"" Jul 15 19:28:41.541749 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.541729 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 19:28:41.542730 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.541947 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 19:28:41.542730 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.542173 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 19:28:41.543573 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.543059 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.544869 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.544355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6724x" Jul 15 19:28:41.544869 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.544512 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 19:28:41.544869 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.544672 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4pxk6\"" Jul 15 19:28:41.545411 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.545391 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:41.545527 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:41.545456 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:28:41.545889 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.545757 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 19:28:41.548572 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.548164 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 19:28:41.548572 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.548525 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 19:28:41.548833 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.548812 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 19:28:41.549131 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.549112 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 19:28:41.549186 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.549147 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 19:28:41.549469 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.549454 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d5vr5\"" Jul 15 19:28:41.549777 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.549759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-69474\"" Jul 15 19:28:41.550181 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.550163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:28:41.551424 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.551398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.551973 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.551895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-socket-dir-parent\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.552062 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.551996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-run-netns\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.552062 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-sys\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.552168 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552062 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-modprobe-d\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.552168 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-var-lib-kubelet\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.552168 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-tuned\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.552302 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqjhr\" (UniqueName: \"kubernetes.io/projected/e7de75c0-852d-447c-99f9-31d56bd3dac0-kube-api-access-tqjhr\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.552348 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-cni-dir\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.552401 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7de75c0-852d-447c-99f9-31d56bd3dac0-tmp\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.552401 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-os-release\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.552495 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-var-lib-cni-multus\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.552495 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-conf-dir\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.552495 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-daemon-config\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.552665 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-etc-kubernetes\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.552665 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsn24\" (UniqueName: \"kubernetes.io/projected/d69a1fcd-fb8b-4f39-b083-0915ae531986-kube-api-access-bsn24\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.552665 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.552665 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-systemd\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.552846 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e8c8a13-c32a-47b7-9adf-ee291873e7bf-host-slash\") pod \"iptables-alerter-b6gsp\" (UID: \"2e8c8a13-c32a-47b7-9adf-ee291873e7bf\") " pod="openshift-network-operator/iptables-alerter-b6gsp" Jul 15 19:28:41.552846 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4mdp\" (UniqueName: \"kubernetes.io/projected/2e8c8a13-c32a-47b7-9adf-ee291873e7bf-kube-api-access-f4mdp\") pod \"iptables-alerter-b6gsp\" (UID: \"2e8c8a13-c32a-47b7-9adf-ee291873e7bf\") " pod="openshift-network-operator/iptables-alerter-b6gsp" Jul 15 19:28:41.552846 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-kubernetes\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.552846 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-sysctl-d\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.553029 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-system-cni-dir\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.553029 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552904 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 19:28:41.553029 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.552950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-registration-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.553029 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-sysconfig\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.553029 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553020 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 19:28:41.553262 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-host\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.553262 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-run-k8s-cni-cncf-io\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.553262 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-etc-selinux\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.553262 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-sys-fs\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.553262 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553011 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 19:28:41.553262 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553152 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 19:28:41.553262 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/219a812a-b04f-46ab-8705-aa296d4dfb48-kubelet-config\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:41.553262 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553218 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:41.553262 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d69a1fcd-fb8b-4f39-b083-0915ae531986-cni-binary-copy\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.553658 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-run\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.553658 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-var-lib-cni-bin\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.553658 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-var-lib-kubelet\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.553658 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-run-multus-certs\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.553658 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-socket-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.553658 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dx57\" (UniqueName: \"kubernetes.io/projected/1f760829-6284-4af2-8f71-78847474702f-kube-api-access-9dx57\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.553898 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.553728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/219a812a-b04f-46ab-8705-aa296d4dfb48-dbus\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:41.554093 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.554075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wvxs6" Jul 15 19:28:41.554234 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.554207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-lib-modules\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.554323 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.554305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-cnibin\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.554406 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.554355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-hostroot\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.554476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.554435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e8c8a13-c32a-47b7-9adf-ee291873e7bf-iptables-alerter-script\") pod \"iptables-alerter-b6gsp\" (UID: \"2e8c8a13-c32a-47b7-9adf-ee291873e7bf\") " pod="openshift-network-operator/iptables-alerter-b6gsp" Jul 15 19:28:41.554530 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.554478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-sysctl-conf\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.554620 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.554597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjqsg\" (UniqueName: \"kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg\") pod \"network-check-target-kjp9f\" (UID: \"556a9e4e-23a5-432c-985c-57573b5b05e4\") " pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:41.554690 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.554669 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-device-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.555211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.555184 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xxc5f\"" Jul 15 19:28:41.557507 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.557489 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q9sqs\"" Jul 15 19:28:41.557697 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.557683 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 19:28:41.557877 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.557829 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mkvtw\"" Jul 15 19:28:41.557877 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.557857 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 19:28:41.558094 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.558062 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 19:28:41.558151 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.558119 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 19:28:41.558250 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.558235 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 19:28:41.558681 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.558646 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 19:28:41.558835 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.558816 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 19:28:41.572593 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.572570 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9nvql" Jul 15 19:28:41.579937 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.579916 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9nvql" Jul 15 19:28:41.640902 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.640876 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 19:28:41.654841 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.654818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-sysctl-conf\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.654974 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.654846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqsg\" (UniqueName: \"kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg\") pod \"network-check-target-kjp9f\" (UID: \"556a9e4e-23a5-432c-985c-57573b5b05e4\") " pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:41.654974 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.654867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjhfp\" (UniqueName: \"kubernetes.io/projected/c1515d98-02a9-4074-962a-a34146ea1fd1-kube-api-access-cjhfp\") pod \"node-resolver-wvxs6\" (UID: \"c1515d98-02a9-4074-962a-a34146ea1fd1\") " pod="openshift-dns/node-resolver-wvxs6" Jul 15 19:28:41.654974 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.654883 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-run-systemd\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.654974 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.654898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-run-ovn\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.654974 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.654912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be-serviceca\") pod \"node-ca-6724x\" (UID: \"49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be\") " pod="openshift-image-registry/node-ca-6724x" Jul 15 19:28:41.654974 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.654928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-device-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.654974 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.654943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/472350f9-ddd8-4b28-a81a-2a1de81bc3f5-agent-certs\") pod \"konnectivity-agent-rphkg\" (UID: \"472350f9-ddd8-4b28-a81a-2a1de81bc3f5\") " pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:28:41.654974 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.654960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-os-release\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.654974 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.654975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-conf-dir\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.654989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-daemon-config\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-etc-kubernetes\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn24\" (UniqueName: \"kubernetes.io/projected/d69a1fcd-fb8b-4f39-b083-0915ae531986-kube-api-access-bsn24\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-etc-selinux\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1515d98-02a9-4074-962a-a34146ea1fd1-hosts-file\") pod \"node-resolver-wvxs6\" (UID: \"c1515d98-02a9-4074-962a-a34146ea1fd1\") " pod="openshift-dns/node-resolver-wvxs6" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7de75c0-852d-447c-99f9-31d56bd3dac0-tmp\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-var-lib-cni-multus\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/219a812a-b04f-46ab-8705-aa296d4dfb48-dbus\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-run-netns\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-socket-dir-parent\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-run-netns\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-sys\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-var-lib-kubelet\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-systemd\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4mdp\" (UniqueName: \"kubernetes.io/projected/2e8c8a13-c32a-47b7-9adf-ee291873e7bf-kube-api-access-f4mdp\") pod \"iptables-alerter-b6gsp\" (UID: \"2e8c8a13-c32a-47b7-9adf-ee291873e7bf\") " pod="openshift-network-operator/iptables-alerter-b6gsp" Jul 15 19:28:41.655369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-kubernetes\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e465ddfc-79f4-4823-8439-226a8b1bf662-ovnkube-config\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e465ddfc-79f4-4823-8439-226a8b1bf662-ovn-node-metrics-cert\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z2jn\" (UniqueName: \"kubernetes.io/projected/e465ddfc-79f4-4823-8439-226a8b1bf662-kube-api-access-6z2jn\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-sysconfig\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-host\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/219a812a-b04f-46ab-8705-aa296d4dfb48-kubelet-config\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-tuned\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqjhr\" (UniqueName: \"kubernetes.io/projected/e7de75c0-852d-447c-99f9-31d56bd3dac0-kube-api-access-tqjhr\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-cni-dir\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-run-openvswitch\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-node-log\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-var-lib-cni-bin\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-var-lib-kubelet\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-socket-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-cnibin\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.656135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-hostroot\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-etc-openvswitch\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e8c8a13-c32a-47b7-9adf-ee291873e7bf-iptables-alerter-script\") pod \"iptables-alerter-b6gsp\" (UID: \"2e8c8a13-c32a-47b7-9adf-ee291873e7bf\") " pod="openshift-network-operator/iptables-alerter-b6gsp" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1515d98-02a9-4074-962a-a34146ea1fd1-tmp-dir\") pod \"node-resolver-wvxs6\" (UID: \"c1515d98-02a9-4074-962a-a34146ea1fd1\") " pod="openshift-dns/node-resolver-wvxs6" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-slash\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-cni-netd\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtqpd\" (UniqueName: \"kubernetes.io/projected/996e2f7c-c517-41a8-a1f8-16bde57358e2-kube-api-access-wtqpd\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-run-ovn-kubernetes\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be-host\") pod \"node-ca-6724x\" (UID: \"49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be\") " pod="openshift-image-registry/node-ca-6724x" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.655982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-modprobe-d\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-os-release\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-registration-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.656635 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-var-lib-openvswitch\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e8c8a13-c32a-47b7-9adf-ee291873e7bf-host-slash\") pod \"iptables-alerter-b6gsp\" (UID: \"2e8c8a13-c32a-47b7-9adf-ee291873e7bf\") " pod="openshift-network-operator/iptables-alerter-b6gsp" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-sysctl-d\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-system-cni-dir\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-sys-fs\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-log-socket\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e465ddfc-79f4-4823-8439-226a8b1bf662-ovnkube-script-lib\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-run-k8s-cni-cncf-io\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-kubelet\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e465ddfc-79f4-4823-8439-226a8b1bf662-env-overrides\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-cni-binary-copy\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smqwl\" (UniqueName: \"kubernetes.io/projected/49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be-kube-api-access-smqwl\") pod \"node-ca-6724x\" (UID: \"49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be\") " pod="openshift-image-registry/node-ca-6724x" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d69a1fcd-fb8b-4f39-b083-0915ae531986-cni-binary-copy\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-run\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-run-multus-certs\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dx57\" (UniqueName: \"kubernetes.io/projected/1f760829-6284-4af2-8f71-78847474702f-kube-api-access-9dx57\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-systemd-units\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.657344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-cni-bin\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-system-cni-dir\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-cnibin\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-lib-modules\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656686 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-var-lib-cni-bin\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p4fq\" (UniqueName: \"kubernetes.io/projected/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-kube-api-access-8p4fq\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/219a812a-b04f-46ab-8705-aa296d4dfb48-dbus\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/472350f9-ddd8-4b28-a81a-2a1de81bc3f5-konnectivity-ca\") pod \"konnectivity-agent-rphkg\" (UID: \"472350f9-ddd8-4b28-a81a-2a1de81bc3f5\") " pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656800 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-conf-dir\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656813 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-os-release\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656884 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-socket-dir-parent\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656889 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-var-lib-kubelet\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656935 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-run-netns\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656978 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-sysctl-conf\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.656997 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-sys\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657034 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-socket-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.658149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657050 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-systemd\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657107 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-kubernetes\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657121 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-cnibin\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657176 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-sysconfig\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657236 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-host\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657290 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/219a812a-b04f-46ab-8705-aa296d4dfb48-kubelet-config\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657342 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-daemon-config\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e8c8a13-c32a-47b7-9adf-ee291873e7bf-host-slash\") pod \"iptables-alerter-b6gsp\" (UID: \"2e8c8a13-c32a-47b7-9adf-ee291873e7bf\") " pod="openshift-network-operator/iptables-alerter-b6gsp" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-system-cni-dir\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657626 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-sys-fs\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657699 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657768 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-sysctl-d\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657811 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-multus-cni-dir\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657847 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-device-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657877 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-run-multus-certs\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.657912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e8c8a13-c32a-47b7-9adf-ee291873e7bf-iptables-alerter-script\") pod \"iptables-alerter-b6gsp\" (UID: \"2e8c8a13-c32a-47b7-9adf-ee291873e7bf\") " pod="openshift-network-operator/iptables-alerter-b6gsp" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:41.657997 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658023 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d69a1fcd-fb8b-4f39-b083-0915ae531986-cni-binary-copy\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.659008 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658054 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-modprobe-d\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.659999 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:41.658080 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret podName:219a812a-b04f-46ab-8705-aa296d4dfb48 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:42.158040969 +0000 UTC m=+2.987447556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret") pod "global-pull-secret-syncer-8t59l" (UID: "219a812a-b04f-46ab-8705-aa296d4dfb48") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:41.659999 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658096 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-etc-kubernetes\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.659999 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658107 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.659999 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658128 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-run\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.659999 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658194 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-etc-selinux\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.659999 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658232 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-var-lib-cni-multus\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.659999 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658245 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f760829-6284-4af2-8f71-78847474702f-registration-dir\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.659999 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658298 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-host-run-k8s-cni-cncf-io\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.659999 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658298 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-var-lib-kubelet\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.659999 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658419 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7de75c0-852d-447c-99f9-31d56bd3dac0-lib-modules\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.659999 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.658420 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d69a1fcd-fb8b-4f39-b083-0915ae531986-hostroot\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.662353 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.662330 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7de75c0-852d-447c-99f9-31d56bd3dac0-tmp\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.662458 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.662381 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7de75c0-852d-447c-99f9-31d56bd3dac0-etc-tuned\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.669003 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:41.668061 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:28:41.669003 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:41.668086 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:28:41.669003 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:41.668099 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pjqsg for pod openshift-network-diagnostics/network-check-target-kjp9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:41.669003 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:41.668157 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg podName:556a9e4e-23a5-432c-985c-57573b5b05e4 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:42.168143705 +0000 UTC m=+2.997550296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pjqsg" (UniqueName: "kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg") pod "network-check-target-kjp9f" (UID: "556a9e4e-23a5-432c-985c-57573b5b05e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:41.671157 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.671035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" event={"ID":"61c38c8734564d401d2e7f5c27e757e5","Type":"ContainerStarted","Data":"2fd6c572bda4803ce022d775f0b206b7c1c8894dc3470a6144152348ea60d893"} Jul 15 19:28:41.672379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.672289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-43.ec2.internal" event={"ID":"0425377e9b6e234689d75fb08e2e44f2","Type":"ContainerStarted","Data":"58ccd8c276fd8ec9566359124c337f3b515b7ff8cf375f58973eaf41cedc5f02"} Jul 15 19:28:41.674661 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.674502 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqjhr\" (UniqueName: \"kubernetes.io/projected/e7de75c0-852d-447c-99f9-31d56bd3dac0-kube-api-access-tqjhr\") pod \"tuned-995n8\" (UID: \"e7de75c0-852d-447c-99f9-31d56bd3dac0\") " pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.677773 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.676497 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dx57\" (UniqueName: \"kubernetes.io/projected/1f760829-6284-4af2-8f71-78847474702f-kube-api-access-9dx57\") pod \"aws-ebs-csi-driver-node-vcnfg\" (UID: \"1f760829-6284-4af2-8f71-78847474702f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.677773 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.677159 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsn24\" (UniqueName: \"kubernetes.io/projected/d69a1fcd-fb8b-4f39-b083-0915ae531986-kube-api-access-bsn24\") pod \"multus-sqjfn\" (UID: \"d69a1fcd-fb8b-4f39-b083-0915ae531986\") " pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.678498 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.678102 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4mdp\" (UniqueName: \"kubernetes.io/projected/2e8c8a13-c32a-47b7-9adf-ee291873e7bf-kube-api-access-f4mdp\") pod \"iptables-alerter-b6gsp\" (UID: \"2e8c8a13-c32a-47b7-9adf-ee291873e7bf\") " pod="openshift-network-operator/iptables-alerter-b6gsp" Jul 15 19:28:41.758071 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-run-netns\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758239 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e465ddfc-79f4-4823-8439-226a8b1bf662-ovnkube-config\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758239 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e465ddfc-79f4-4823-8439-226a8b1bf662-ovn-node-metrics-cert\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758239 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z2jn\" (UniqueName: \"kubernetes.io/projected/e465ddfc-79f4-4823-8439-226a8b1bf662-kube-api-access-6z2jn\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758239 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-run-openvswitch\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758239 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-node-log\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758239 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758428 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-etc-openvswitch\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758428 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:41.758428 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.758428 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1515d98-02a9-4074-962a-a34146ea1fd1-tmp-dir\") pod \"node-resolver-wvxs6\" (UID: \"c1515d98-02a9-4074-962a-a34146ea1fd1\") " pod="openshift-dns/node-resolver-wvxs6" Jul 15 19:28:41.758428 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-slash\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758428 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-cni-netd\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758428 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtqpd\" (UniqueName: \"kubernetes.io/projected/996e2f7c-c517-41a8-a1f8-16bde57358e2-kube-api-access-wtqpd\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:41.758428 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-run-ovn-kubernetes\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be-host\") pod \"node-ca-6724x\" (UID: \"49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be\") " pod="openshift-image-registry/node-ca-6724x" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-os-release\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-var-lib-openvswitch\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-log-socket\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e465ddfc-79f4-4823-8439-226a8b1bf662-ovnkube-script-lib\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-kubelet\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e465ddfc-79f4-4823-8439-226a8b1bf662-env-overrides\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-cni-binary-copy\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smqwl\" (UniqueName: \"kubernetes.io/projected/49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be-kube-api-access-smqwl\") pod \"node-ca-6724x\" (UID: \"49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be\") " pod="openshift-image-registry/node-ca-6724x" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e465ddfc-79f4-4823-8439-226a8b1bf662-ovnkube-config\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-systemd-units\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758218 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-run-netns\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.758745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-cni-bin\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-system-cni-dir\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-cni-bin\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-cnibin\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758838 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-slash\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758843 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1515d98-02a9-4074-962a-a34146ea1fd1-tmp-dir\") pod \"node-resolver-wvxs6\" (UID: \"c1515d98-02a9-4074-962a-a34146ea1fd1\") " pod="openshift-dns/node-resolver-wvxs6" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p4fq\" (UniqueName: \"kubernetes.io/projected/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-kube-api-access-8p4fq\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758882 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-cni-netd\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/472350f9-ddd8-4b28-a81a-2a1de81bc3f5-konnectivity-ca\") pod \"konnectivity-agent-rphkg\" (UID: \"472350f9-ddd8-4b28-a81a-2a1de81bc3f5\") " pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjhfp\" (UniqueName: \"kubernetes.io/projected/c1515d98-02a9-4074-962a-a34146ea1fd1-kube-api-access-cjhfp\") pod \"node-resolver-wvxs6\" (UID: \"c1515d98-02a9-4074-962a-a34146ea1fd1\") " pod="openshift-dns/node-resolver-wvxs6" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-run-systemd\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.758984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-run-ovn\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be-serviceca\") pod \"node-ca-6724x\" (UID: \"49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be\") " pod="openshift-image-registry/node-ca-6724x" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/472350f9-ddd8-4b28-a81a-2a1de81bc3f5-agent-certs\") pod \"konnectivity-agent-rphkg\" (UID: \"472350f9-ddd8-4b28-a81a-2a1de81bc3f5\") " pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1515d98-02a9-4074-962a-a34146ea1fd1-hosts-file\") pod \"node-resolver-wvxs6\" (UID: \"c1515d98-02a9-4074-962a-a34146ea1fd1\") " pod="openshift-dns/node-resolver-wvxs6" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759106 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-etc-openvswitch\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759171 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1515d98-02a9-4074-962a-a34146ea1fd1-hosts-file\") pod \"node-resolver-wvxs6\" (UID: \"c1515d98-02a9-4074-962a-a34146ea1fd1\") " pod="openshift-dns/node-resolver-wvxs6" Jul 15 19:28:41.759211 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:41.759177 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:41.759224 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs podName:996e2f7c-c517-41a8-a1f8-16bde57358e2 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:42.259211892 +0000 UTC m=+3.088618481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs") pod "network-metrics-daemon-6g5mh" (UID: "996e2f7c-c517-41a8-a1f8-16bde57358e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759219 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-system-cni-dir\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759268 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-node-log\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759310 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-cnibin\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759474 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759628 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/472350f9-ddd8-4b28-a81a-2a1de81bc3f5-konnectivity-ca\") pod \"konnectivity-agent-rphkg\" (UID: \"472350f9-ddd8-4b28-a81a-2a1de81bc3f5\") " pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759696 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-run-openvswitch\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759783 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759834 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-run-systemd\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759875 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-run-ovn\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759890 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759915 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e465ddfc-79f4-4823-8439-226a8b1bf662-env-overrides\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759937 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-systemd-units\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759973 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-var-lib-openvswitch\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.760022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.759973 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-run-ovn-kubernetes\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.760915 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.760022 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-os-release\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.760915 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.760022 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-log-socket\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.760915 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.760056 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be-host\") pod \"node-ca-6724x\" (UID: \"49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be\") " pod="openshift-image-registry/node-ca-6724x" Jul 15 19:28:41.760915 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.760086 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e465ddfc-79f4-4823-8439-226a8b1bf662-host-kubelet\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.760915 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.760181 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-cni-binary-copy\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.760915 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.760277 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be-serviceca\") pod \"node-ca-6724x\" (UID: \"49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be\") " pod="openshift-image-registry/node-ca-6724x" Jul 15 19:28:41.760915 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.760504 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e465ddfc-79f4-4823-8439-226a8b1bf662-ovnkube-script-lib\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.761253 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.761177 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e465ddfc-79f4-4823-8439-226a8b1bf662-ovn-node-metrics-cert\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.762510 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.762478 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/472350f9-ddd8-4b28-a81a-2a1de81bc3f5-agent-certs\") pod \"konnectivity-agent-rphkg\" (UID: \"472350f9-ddd8-4b28-a81a-2a1de81bc3f5\") " pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:28:41.771218 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.770923 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smqwl\" (UniqueName: \"kubernetes.io/projected/49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be-kube-api-access-smqwl\") pod \"node-ca-6724x\" (UID: \"49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be\") " pod="openshift-image-registry/node-ca-6724x" Jul 15 19:28:41.771414 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.771380 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtqpd\" (UniqueName: \"kubernetes.io/projected/996e2f7c-c517-41a8-a1f8-16bde57358e2-kube-api-access-wtqpd\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:41.772112 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.772087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p4fq\" (UniqueName: \"kubernetes.io/projected/8552de76-e2d1-4ae9-b054-e9c3ff8ceb12-kube-api-access-8p4fq\") pod \"multus-additional-cni-plugins-48hp5\" (UID: \"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12\") " pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.772211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.772109 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjhfp\" (UniqueName: \"kubernetes.io/projected/c1515d98-02a9-4074-962a-a34146ea1fd1-kube-api-access-cjhfp\") pod \"node-resolver-wvxs6\" (UID: \"c1515d98-02a9-4074-962a-a34146ea1fd1\") " pod="openshift-dns/node-resolver-wvxs6" Jul 15 19:28:41.772361 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.772341 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z2jn\" (UniqueName: \"kubernetes.io/projected/e465ddfc-79f4-4823-8439-226a8b1bf662-kube-api-access-6z2jn\") pod \"ovnkube-node-gw8m2\" (UID: \"e465ddfc-79f4-4823-8439-226a8b1bf662\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.843577 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.843525 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sqjfn" Jul 15 19:28:41.855529 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.855499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" Jul 15 19:28:41.866367 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.866342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b6gsp" Jul 15 19:28:41.873208 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.873192 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-995n8" Jul 15 19:28:41.881863 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.881844 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:28:41.889407 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.889383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6724x" Jul 15 19:28:41.899044 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.899025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:28:41.906558 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.906527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-48hp5" Jul 15 19:28:41.913052 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.913026 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wvxs6" Jul 15 19:28:41.986779 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:41.986748 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 19:28:42.161895 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:42.161812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:42.162064 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:42.161975 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:42.162064 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:42.162046 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret podName:219a812a-b04f-46ab-8705-aa296d4dfb48 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:43.162030693 +0000 UTC m=+3.991437283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret") pod "global-pull-secret-syncer-8t59l" (UID: "219a812a-b04f-46ab-8705-aa296d4dfb48") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:42.262813 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:42.262787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqsg\" (UniqueName: \"kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg\") pod \"network-check-target-kjp9f\" (UID: \"556a9e4e-23a5-432c-985c-57573b5b05e4\") " pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:42.262974 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:42.262833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:42.262974 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:42.262951 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:42.263062 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:42.262981 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:28:42.263062 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:42.263006 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:28:42.263062 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:42.263020 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pjqsg for pod openshift-network-diagnostics/network-check-target-kjp9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:42.263062 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:42.262993 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs podName:996e2f7c-c517-41a8-a1f8-16bde57358e2 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:43.262982156 +0000 UTC m=+4.092388742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs") pod "network-metrics-daemon-6g5mh" (UID: "996e2f7c-c517-41a8-a1f8-16bde57358e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:42.263206 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:42.263081 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg podName:556a9e4e-23a5-432c-985c-57573b5b05e4 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:43.263063988 +0000 UTC m=+4.092470583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjqsg" (UniqueName: "kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg") pod "network-check-target-kjp9f" (UID: "556a9e4e-23a5-432c-985c-57573b5b05e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:42.582158 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:42.582074 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:23:41 +0000 UTC" deadline="2028-02-19 06:51:24.75914096 +0000 UTC" Jul 15 19:28:42.582158 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:42.582117 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14003h22m42.177034416s" Jul 15 19:28:42.666011 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:42.665987 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:42.666131 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:42.666085 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:28:42.683098 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:42.683074 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7de75c0_852d_447c_99f9_31d56bd3dac0.slice/crio-91dee4572e960ab2b4a58370b7b2d34781c9f9627b6178607bb6ea35a31c28bc WatchSource:0}: Error finding container 91dee4572e960ab2b4a58370b7b2d34781c9f9627b6178607bb6ea35a31c28bc: Status 404 returned error can't find the container with id 91dee4572e960ab2b4a58370b7b2d34781c9f9627b6178607bb6ea35a31c28bc Jul 15 19:28:42.684215 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:42.684173 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f760829_6284_4af2_8f71_78847474702f.slice/crio-63c4f3d6f3499e230afde59c03d11827234b72069b575f91d7d76e0aed781150 WatchSource:0}: Error finding container 63c4f3d6f3499e230afde59c03d11827234b72069b575f91d7d76e0aed781150: Status 404 returned error can't find the container with id 63c4f3d6f3499e230afde59c03d11827234b72069b575f91d7d76e0aed781150 Jul 15 19:28:42.685293 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:42.685263 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode465ddfc_79f4_4823_8439_226a8b1bf662.slice/crio-c02cb89534b0ec806c27216b5025f8ed1ac94d0362dd3465ebbf20029320974e WatchSource:0}: Error finding container c02cb89534b0ec806c27216b5025f8ed1ac94d0362dd3465ebbf20029320974e: Status 404 returned error can't find the container with id c02cb89534b0ec806c27216b5025f8ed1ac94d0362dd3465ebbf20029320974e Jul 15 19:28:42.687749 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:42.687603 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69a1fcd_fb8b_4f39_b083_0915ae531986.slice/crio-c607451e77fd6b1602e94161fe67c74b41469e52057de355850ac7c5cab7f44c WatchSource:0}: Error finding container c607451e77fd6b1602e94161fe67c74b41469e52057de355850ac7c5cab7f44c: Status 404 returned error can't find the container with id c607451e77fd6b1602e94161fe67c74b41469e52057de355850ac7c5cab7f44c Jul 15 19:28:42.690234 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:42.690211 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472350f9_ddd8_4b28_a81a_2a1de81bc3f5.slice/crio-9b9916c5677e577c89535c65943f089ad3bf64d96df77094369ee82a9790bdad WatchSource:0}: Error finding container 9b9916c5677e577c89535c65943f089ad3bf64d96df77094369ee82a9790bdad: Status 404 returned error can't find the container with id 9b9916c5677e577c89535c65943f089ad3bf64d96df77094369ee82a9790bdad Jul 15 19:28:42.691959 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:42.691926 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d0c4b5_6e3d_4b82_b3b2_a6c6f37942be.slice/crio-d17135d7c4aca3f08c7217d679fb0bb89f5a904cf32a06a8d7b18144e552bdb9 WatchSource:0}: Error finding container d17135d7c4aca3f08c7217d679fb0bb89f5a904cf32a06a8d7b18144e552bdb9: Status 404 returned error can't find the container with id d17135d7c4aca3f08c7217d679fb0bb89f5a904cf32a06a8d7b18144e552bdb9 Jul 15 19:28:42.693935 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:42.693287 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8552de76_e2d1_4ae9_b054_e9c3ff8ceb12.slice/crio-f4df2b4c9e0f7b2412c583bf51659823ebf6ea0d53d1726ebd39b7a8127fdcd4 WatchSource:0}: Error finding container f4df2b4c9e0f7b2412c583bf51659823ebf6ea0d53d1726ebd39b7a8127fdcd4: Status 404 returned error can't find the container with id f4df2b4c9e0f7b2412c583bf51659823ebf6ea0d53d1726ebd39b7a8127fdcd4 Jul 15 19:28:42.694132 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:42.694075 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1515d98_02a9_4074_962a_a34146ea1fd1.slice/crio-14e661e1ce0f094217ef2753e94aed3e211fbc4f4992f4ceec233c423939fbc2 WatchSource:0}: Error finding container 14e661e1ce0f094217ef2753e94aed3e211fbc4f4992f4ceec233c423939fbc2: Status 404 returned error can't find the container with id 14e661e1ce0f094217ef2753e94aed3e211fbc4f4992f4ceec233c423939fbc2 Jul 15 19:28:42.695333 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:28:42.694648 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8c8a13_c32a_47b7_9adf_ee291873e7bf.slice/crio-33ad4eb9d5225a558131edae1b146945e9f5da312b4c65b63c1d29597344dc7e WatchSource:0}: Error finding container 33ad4eb9d5225a558131edae1b146945e9f5da312b4c65b63c1d29597344dc7e: Status 404 returned error can't find the container with id 33ad4eb9d5225a558131edae1b146945e9f5da312b4c65b63c1d29597344dc7e Jul 15 19:28:43.171005 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.170283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:43.171005 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:43.170574 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:43.171005 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:43.170638 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret podName:219a812a-b04f-46ab-8705-aa296d4dfb48 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:45.170618389 +0000 UTC m=+6.000024995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret") pod "global-pull-secret-syncer-8t59l" (UID: "219a812a-b04f-46ab-8705-aa296d4dfb48") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:43.271926 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.271134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqsg\" (UniqueName: \"kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg\") pod \"network-check-target-kjp9f\" (UID: \"556a9e4e-23a5-432c-985c-57573b5b05e4\") " pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:43.271926 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.271205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:43.271926 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:43.271330 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:43.271926 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:43.271388 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs podName:996e2f7c-c517-41a8-a1f8-16bde57358e2 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:45.271369651 +0000 UTC m=+6.100776240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs") pod "network-metrics-daemon-6g5mh" (UID: "996e2f7c-c517-41a8-a1f8-16bde57358e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:43.271926 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:43.271815 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:28:43.271926 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:43.271835 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:28:43.271926 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:43.271847 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pjqsg for pod openshift-network-diagnostics/network-check-target-kjp9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:43.271926 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:43.271893 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg podName:556a9e4e-23a5-432c-985c-57573b5b05e4 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:45.271876677 +0000 UTC m=+6.101283269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjqsg" (UniqueName: "kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg") pod "network-check-target-kjp9f" (UID: "556a9e4e-23a5-432c-985c-57573b5b05e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:43.582577 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.582450 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:23:41 +0000 UTC" deadline="2028-01-24 13:06:53.604726415 +0000 UTC" Jul 15 19:28:43.582577 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.582510 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13385h38m10.022220153s" Jul 15 19:28:43.671341 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.671314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:43.671496 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.671315 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:43.671496 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:43.671470 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:28:43.671634 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:43.671528 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:28:43.684401 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.684346 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6724x" event={"ID":"49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be","Type":"ContainerStarted","Data":"d17135d7c4aca3f08c7217d679fb0bb89f5a904cf32a06a8d7b18144e552bdb9"} Jul 15 19:28:43.700757 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.700674 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sqjfn" event={"ID":"d69a1fcd-fb8b-4f39-b083-0915ae531986","Type":"ContainerStarted","Data":"c607451e77fd6b1602e94161fe67c74b41469e52057de355850ac7c5cab7f44c"} Jul 15 19:28:43.702190 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.702163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-995n8" event={"ID":"e7de75c0-852d-447c-99f9-31d56bd3dac0","Type":"ContainerStarted","Data":"91dee4572e960ab2b4a58370b7b2d34781c9f9627b6178607bb6ea35a31c28bc"} Jul 15 19:28:43.703180 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.703141 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wvxs6" event={"ID":"c1515d98-02a9-4074-962a-a34146ea1fd1","Type":"ContainerStarted","Data":"14e661e1ce0f094217ef2753e94aed3e211fbc4f4992f4ceec233c423939fbc2"} Jul 15 19:28:43.708180 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.708155 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48hp5" event={"ID":"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12","Type":"ContainerStarted","Data":"f4df2b4c9e0f7b2412c583bf51659823ebf6ea0d53d1726ebd39b7a8127fdcd4"} Jul 15 19:28:43.711815 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.711750 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rphkg" event={"ID":"472350f9-ddd8-4b28-a81a-2a1de81bc3f5","Type":"ContainerStarted","Data":"9b9916c5677e577c89535c65943f089ad3bf64d96df77094369ee82a9790bdad"} Jul 15 19:28:43.716132 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.716033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" event={"ID":"e465ddfc-79f4-4823-8439-226a8b1bf662","Type":"ContainerStarted","Data":"c02cb89534b0ec806c27216b5025f8ed1ac94d0362dd3465ebbf20029320974e"} Jul 15 19:28:43.727333 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.727305 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" event={"ID":"1f760829-6284-4af2-8f71-78847474702f","Type":"ContainerStarted","Data":"63c4f3d6f3499e230afde59c03d11827234b72069b575f91d7d76e0aed781150"} Jul 15 19:28:43.738924 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.738892 2576 generic.go:356] "Generic (PLEG): container finished" podID="61c38c8734564d401d2e7f5c27e757e5" containerID="418486377d50ca21333fb1828d91f4914dc4e23d2349ce8e79d4c33f5fcb7307" exitCode=0 Jul 15 19:28:43.739179 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.739152 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" event={"ID":"61c38c8734564d401d2e7f5c27e757e5","Type":"ContainerDied","Data":"418486377d50ca21333fb1828d91f4914dc4e23d2349ce8e79d4c33f5fcb7307"} Jul 15 19:28:43.743693 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.743635 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-43.ec2.internal" event={"ID":"0425377e9b6e234689d75fb08e2e44f2","Type":"ContainerStarted","Data":"cf471aff8a6d43e18dbfd5f39f5b963c2b001a529b4aed99acc73e7f4339ca69"} Jul 15 19:28:43.748692 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:43.748583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b6gsp" event={"ID":"2e8c8a13-c32a-47b7-9adf-ee291873e7bf","Type":"ContainerStarted","Data":"33ad4eb9d5225a558131edae1b146945e9f5da312b4c65b63c1d29597344dc7e"} Jul 15 19:28:44.665916 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:44.665884 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:44.666368 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:44.666012 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:28:44.765311 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:44.765275 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" event={"ID":"61c38c8734564d401d2e7f5c27e757e5","Type":"ContainerStarted","Data":"01f6ed922a7f7d9737fe8b9d1682fea0f88341ff1c6c95dfe00f9c2ab5b6c3a6"} Jul 15 19:28:44.778968 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:44.778901 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-43.ec2.internal" podStartSLOduration=4.778879677 podStartE2EDuration="4.778879677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:28:43.769098115 +0000 UTC m=+4.598504726" watchObservedRunningTime="2026-07-15 19:28:44.778879677 +0000 UTC m=+5.608286286" Jul 15 19:28:45.186301 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:45.186259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:45.186507 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:45.186425 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:45.186507 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:45.186490 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret podName:219a812a-b04f-46ab-8705-aa296d4dfb48 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:49.186470579 +0000 UTC m=+10.015877172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret") pod "global-pull-secret-syncer-8t59l" (UID: "219a812a-b04f-46ab-8705-aa296d4dfb48") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:45.287715 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:45.286875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqsg\" (UniqueName: \"kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg\") pod \"network-check-target-kjp9f\" (UID: \"556a9e4e-23a5-432c-985c-57573b5b05e4\") " pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:45.287715 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:45.286955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:45.287715 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:45.287101 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:45.287715 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:45.287165 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs podName:996e2f7c-c517-41a8-a1f8-16bde57358e2 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:49.287146114 +0000 UTC m=+10.116552701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs") pod "network-metrics-daemon-6g5mh" (UID: "996e2f7c-c517-41a8-a1f8-16bde57358e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:45.287715 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:45.287592 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:28:45.287715 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:45.287610 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:28:45.287715 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:45.287622 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pjqsg for pod openshift-network-diagnostics/network-check-target-kjp9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:45.287715 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:45.287668 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg podName:556a9e4e-23a5-432c-985c-57573b5b05e4 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:49.287653716 +0000 UTC m=+10.117060318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjqsg" (UniqueName: "kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg") pod "network-check-target-kjp9f" (UID: "556a9e4e-23a5-432c-985c-57573b5b05e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:45.666755 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:45.666662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:45.667229 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:45.666812 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:28:45.667294 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:45.667262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:45.667390 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:45.667357 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:28:46.666978 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:46.666443 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:46.666978 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:46.666573 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:28:47.666443 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:47.666410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:47.666642 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:47.666569 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:28:47.666964 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:47.666947 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:47.667043 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:47.667029 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:28:48.666099 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:48.666063 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:48.666276 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:48.666210 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:28:49.223105 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:49.223056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:49.223615 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:49.223243 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:49.223615 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:49.223300 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret podName:219a812a-b04f-46ab-8705-aa296d4dfb48 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:57.223285547 +0000 UTC m=+18.052692134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret") pod "global-pull-secret-syncer-8t59l" (UID: "219a812a-b04f-46ab-8705-aa296d4dfb48") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:49.324340 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:49.324296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:49.324514 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:49.324385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqsg\" (UniqueName: \"kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg\") pod \"network-check-target-kjp9f\" (UID: \"556a9e4e-23a5-432c-985c-57573b5b05e4\") " pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:49.324630 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:49.324530 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:28:49.324630 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:49.324578 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:28:49.324630 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:49.324590 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pjqsg for pod openshift-network-diagnostics/network-check-target-kjp9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:49.324762 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:49.324702 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg podName:556a9e4e-23a5-432c-985c-57573b5b05e4 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:57.324685239 +0000 UTC m=+18.154091839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjqsg" (UniqueName: "kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg") pod "network-check-target-kjp9f" (UID: "556a9e4e-23a5-432c-985c-57573b5b05e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:49.325040 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:49.325025 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:49.325084 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:49.325065 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs podName:996e2f7c-c517-41a8-a1f8-16bde57358e2 nodeName:}" failed. No retries permitted until 2026-07-15 19:28:57.325055465 +0000 UTC m=+18.154462053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs") pod "network-metrics-daemon-6g5mh" (UID: "996e2f7c-c517-41a8-a1f8-16bde57358e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:49.666749 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:49.666666 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:49.667672 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:49.667645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:49.667924 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:49.667771 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:28:49.667924 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:49.667870 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:28:50.665657 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:50.665614 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:50.666129 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:50.665753 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:28:51.668521 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:51.668487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:51.669005 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:51.668646 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:28:51.669005 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:51.668702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:51.669005 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:51.668768 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:28:52.666378 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:52.666347 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:52.666537 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:52.666460 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:28:53.665968 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:53.665934 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:53.666345 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:53.666053 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:28:53.666345 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:53.666099 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:53.666345 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:53.666172 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:28:54.665650 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:54.665617 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:54.665809 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:54.665746 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:28:55.665725 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:55.665689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:55.666150 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:55.665701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:55.666150 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:55.665812 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:28:55.666150 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:55.665893 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:28:56.665669 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:56.665631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:56.665866 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:56.665773 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:28:57.286123 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:57.286091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:57.286299 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:57.286221 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:57.286299 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:57.286281 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret podName:219a812a-b04f-46ab-8705-aa296d4dfb48 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:13.286265373 +0000 UTC m=+34.115671968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret") pod "global-pull-secret-syncer-8t59l" (UID: "219a812a-b04f-46ab-8705-aa296d4dfb48") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:28:57.386606 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:57.386571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqsg\" (UniqueName: \"kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg\") pod \"network-check-target-kjp9f\" (UID: \"556a9e4e-23a5-432c-985c-57573b5b05e4\") " pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:57.386785 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:57.386632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:57.386846 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:57.386795 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:57.386846 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:57.386797 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:28:57.386846 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:57.386821 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:28:57.386846 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:57.386833 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pjqsg for pod openshift-network-diagnostics/network-check-target-kjp9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:57.386978 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:57.386861 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs podName:996e2f7c-c517-41a8-a1f8-16bde57358e2 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:13.386842548 +0000 UTC m=+34.216249159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs") pod "network-metrics-daemon-6g5mh" (UID: "996e2f7c-c517-41a8-a1f8-16bde57358e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:28:57.386978 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:57.386877 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg podName:556a9e4e-23a5-432c-985c-57573b5b05e4 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:13.386869163 +0000 UTC m=+34.216275751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjqsg" (UniqueName: "kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg") pod "network-check-target-kjp9f" (UID: "556a9e4e-23a5-432c-985c-57573b5b05e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:28:57.666289 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:57.666237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:57.666289 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:57.666292 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:57.666754 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:57.666380 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:28:57.666754 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:57.666466 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:28:58.666004 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:58.665966 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:28:58.666186 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:58.666092 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:28:59.667239 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:59.667209 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:28:59.667765 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:59.667337 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:28:59.667765 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:28:59.667396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:28:59.667765 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:28:59.667504 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:29:00.665711 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:00.665680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:00.665881 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:00.665806 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:29:01.665866 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:01.665822 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:01.665866 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:01.665869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:29:01.666560 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:01.665954 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:29:01.666560 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:01.666095 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:29:02.667007 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.666538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:02.667825 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:02.667133 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:29:02.804118 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.804027 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6724x" event={"ID":"49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be","Type":"ContainerStarted","Data":"6ccd04f3d4875036ba84a4624232484c98e3d9a85965d2132b3565623976798d"} Jul 15 19:29:02.805886 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.805854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sqjfn" event={"ID":"d69a1fcd-fb8b-4f39-b083-0915ae531986","Type":"ContainerStarted","Data":"845e10a536be5bd26c799a9d78360598a12001aa661490795a01b5718820c55f"} Jul 15 19:29:02.807435 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.807408 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-995n8" event={"ID":"e7de75c0-852d-447c-99f9-31d56bd3dac0","Type":"ContainerStarted","Data":"a2df0614b3fa43bc4c33281b483e1dc58d3f210fc129f798b18488e8310b592a"} Jul 15 19:29:02.808715 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.808691 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wvxs6" event={"ID":"c1515d98-02a9-4074-962a-a34146ea1fd1","Type":"ContainerStarted","Data":"8a792245233d3f1b2528a0e3e3aef22084ee6a93004ada46af06a0903c89ae66"} Jul 15 19:29:02.810138 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.810116 2576 generic.go:356] "Generic (PLEG): container finished" podID="8552de76-e2d1-4ae9-b054-e9c3ff8ceb12" containerID="efec46ec7a32a9e1dc67d79178b6a043b918158f33764b121883651124a80b69" exitCode=0 Jul 15 19:29:02.810215 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.810192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48hp5" event={"ID":"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12","Type":"ContainerDied","Data":"efec46ec7a32a9e1dc67d79178b6a043b918158f33764b121883651124a80b69"} Jul 15 19:29:02.811804 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.811778 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rphkg" event={"ID":"472350f9-ddd8-4b28-a81a-2a1de81bc3f5","Type":"ContainerStarted","Data":"c42863248db94c63e47ac91e7154c93b62a0bbd040bdd5194833f6c0a9086b99"} Jul 15 19:29:02.820484 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.820458 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" event={"ID":"e465ddfc-79f4-4823-8439-226a8b1bf662","Type":"ContainerStarted","Data":"b57479f84c42ea54dbf7e0d49e9bf0136a0dd240685d43ab95996e4c3fdb896d"} Jul 15 19:29:02.820621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.820586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" event={"ID":"e465ddfc-79f4-4823-8439-226a8b1bf662","Type":"ContainerStarted","Data":"d854e6516c37c5a47a98df8d789df05a2649ec442d2429562049b7d684d7c25e"} Jul 15 19:29:02.820696 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.820637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" event={"ID":"e465ddfc-79f4-4823-8439-226a8b1bf662","Type":"ContainerStarted","Data":"cfe8df2206d61dd12343649c6e6dad940b20ab30562f48f25bb5985c575c13f1"} Jul 15 19:29:02.820696 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.820686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" event={"ID":"e465ddfc-79f4-4823-8439-226a8b1bf662","Type":"ContainerStarted","Data":"cb1e1cd49541cb83081b1931d1342472de4d1b37aa7c7db8f48708ab64874984"} Jul 15 19:29:02.820806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.820734 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" event={"ID":"e465ddfc-79f4-4823-8439-226a8b1bf662","Type":"ContainerStarted","Data":"15f8bb1635ab78ad34873c019025bb57b19cbe20fff5a336df81a4af7dc076ce"} Jul 15 19:29:02.820806 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.820781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" event={"ID":"e465ddfc-79f4-4823-8439-226a8b1bf662","Type":"ContainerStarted","Data":"c6e7f3341ce799b28d1009252e872636b2197a8bac3c387fea9ea118d11b76f6"} Jul 15 19:29:02.822349 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.822326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" event={"ID":"1f760829-6284-4af2-8f71-78847474702f","Type":"ContainerStarted","Data":"b3ff47c42af4df0dcb93010345bcef7235885a7db8c2189ade9b97abd90c3e08"} Jul 15 19:29:02.828487 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.828448 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-43.ec2.internal" podStartSLOduration=22.828435277 podStartE2EDuration="22.828435277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:28:44.780179696 +0000 UTC m=+5.609586309" watchObservedRunningTime="2026-07-15 19:29:02.828435277 +0000 UTC m=+23.657841887" Jul 15 19:29:02.844764 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.844715 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-995n8" podStartSLOduration=4.715337223 podStartE2EDuration="23.844699274s" totalImagesPullingTime="19.129362051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:02.844598651 +0000 UTC m=+23.674005262" watchObservedRunningTime="2026-07-15 19:29:02.844699274 +0000 UTC m=+23.674105884" Jul 15 19:29:02.845378 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.845349 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6724x" podStartSLOduration=8.938963278 podStartE2EDuration="23.845342201s" totalImagesPullingTime="14.906378923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:02.828909078 +0000 UTC m=+23.658315713" watchObservedRunningTime="2026-07-15 19:29:02.845342201 +0000 UTC m=+23.674748814" Jul 15 19:29:02.859436 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.859384 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rphkg" podStartSLOduration=4.750806486 podStartE2EDuration="23.859366771s" totalImagesPullingTime="19.108560285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:02.858736731 +0000 UTC m=+23.688143366" watchObservedRunningTime="2026-07-15 19:29:02.859366771 +0000 UTC m=+23.688773378" Jul 15 19:29:02.909411 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.909365 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sqjfn" podStartSLOduration=4.7372565049999995 podStartE2EDuration="23.909347994s" totalImagesPullingTime="19.172091489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:02.909270592 +0000 UTC m=+23.738677201" watchObservedRunningTime="2026-07-15 19:29:02.909347994 +0000 UTC m=+23.738754584" Jul 15 19:29:02.909745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:02.909722 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wvxs6" podStartSLOduration=4.810143136 podStartE2EDuration="23.90971587s" totalImagesPullingTime="19.099572734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:02.892918364 +0000 UTC m=+23.722324973" watchObservedRunningTime="2026-07-15 19:29:02.90971587 +0000 UTC m=+23.739122479" Jul 15 19:29:03.365420 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:03.365396 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 19:29:03.607924 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:03.607653 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T19:29:03.365415459Z","UUID":"e8c6014a-526c-45d2-b4f3-1c460f97b9b1","Handler":null,"Name":"","Endpoint":""} Jul 15 19:29:03.609283 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:03.609264 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 19:29:03.609395 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:03.609304 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 19:29:03.665919 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:03.665886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:03.666098 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:03.665941 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:29:03.666098 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:03.666019 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:29:03.666217 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:03.666111 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:29:03.826733 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:03.826697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b6gsp" event={"ID":"2e8c8a13-c32a-47b7-9adf-ee291873e7bf","Type":"ContainerStarted","Data":"1b20dbca4e5143535a638731fccdcaadf8d5db1e50cf48277dacea381c11a4a8"} Jul 15 19:29:03.829255 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:03.829219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" event={"ID":"1f760829-6284-4af2-8f71-78847474702f","Type":"ContainerStarted","Data":"ef5d188ec3bf5fd49fa7687814c525de3fac3d8e4f74893d2ce368ba54581dd1"} Jul 15 19:29:03.841626 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:03.841576 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b6gsp" podStartSLOduration=5.728795804 podStartE2EDuration="24.841536781s" totalImagesPullingTime="19.112740977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:03.840734216 +0000 UTC m=+24.670140844" watchObservedRunningTime="2026-07-15 19:29:03.841536781 +0000 UTC m=+24.670943393" Jul 15 19:29:04.666385 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:04.666359 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:04.666508 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:04.666460 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:29:04.834286 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:04.834201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" event={"ID":"1f760829-6284-4af2-8f71-78847474702f","Type":"ContainerStarted","Data":"4e901c723a2133c6a94a32f3e70fd174ea5658f406a6f733c7d33f9f87f1155e"} Jul 15 19:29:04.839309 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:04.839281 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" event={"ID":"e465ddfc-79f4-4823-8439-226a8b1bf662","Type":"ContainerStarted","Data":"a6528012f085f1ecddc727b518b7986f6dd4fc7bc08370528568fb55e19fd56e"} Jul 15 19:29:04.851744 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:04.851691 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vcnfg" podStartSLOduration=4.390467631 podStartE2EDuration="25.851672879s" totalImagesPullingTime="21.461205248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:04.851237065 +0000 UTC m=+25.680643692" watchObservedRunningTime="2026-07-15 19:29:04.851672879 +0000 UTC m=+25.681079490" Jul 15 19:29:05.666060 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:05.666020 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:29:05.666321 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:05.666168 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:29:05.666321 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:05.666230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:05.666426 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:05.666341 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:29:06.666472 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:06.666436 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:06.666892 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:06.666594 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:29:07.464611 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.463484 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:29:07.464611 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.464245 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:29:07.665805 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.665512 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:07.665936 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.665591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:29:07.665936 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:07.665868 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:29:07.665936 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:07.665912 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:29:07.847802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.847771 2576 generic.go:356] "Generic (PLEG): container finished" podID="8552de76-e2d1-4ae9-b054-e9c3ff8ceb12" containerID="e6a5d64980512b0a3bbd68bbd324c25cf7c77121cef5bb6da8d663e163ac854c" exitCode=0 Jul 15 19:29:07.848673 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.847844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48hp5" event={"ID":"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12","Type":"ContainerDied","Data":"e6a5d64980512b0a3bbd68bbd324c25cf7c77121cef5bb6da8d663e163ac854c"} Jul 15 19:29:07.852979 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.852953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" event={"ID":"e465ddfc-79f4-4823-8439-226a8b1bf662","Type":"ContainerStarted","Data":"b6cf98309ee2901ad35a1fc3c1473810826fb6c075696662942819c4f35a7a90"} Jul 15 19:29:07.853522 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.853501 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:29:07.854350 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.854332 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rphkg" Jul 15 19:29:07.855583 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.855563 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:29:07.855675 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.855636 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:29:07.855731 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.855685 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:29:07.871243 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.871222 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:29:07.871379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.871367 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:29:07.897158 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:07.897116 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" podStartSLOduration=9.706450997 podStartE2EDuration="28.897104915s" totalImagesPullingTime="19.190653918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:07.895244265 +0000 UTC m=+28.724650873" watchObservedRunningTime="2026-07-15 19:29:07.897104915 +0000 UTC m=+28.726511521" Jul 15 19:29:08.666354 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:08.666311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:08.666630 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:08.666466 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:29:09.167664 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:09.167632 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6g5mh"] Jul 15 19:29:09.168093 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:09.167758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:29:09.168093 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:09.167861 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:29:09.170531 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:09.170504 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kjp9f"] Jul 15 19:29:09.170675 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:09.170623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:09.170744 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:09.170718 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:29:09.171027 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:09.171000 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8t59l"] Jul 15 19:29:09.171083 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:09.171071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:09.171172 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:09.171156 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:29:10.665833 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:10.665758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:10.665833 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:10.665789 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:29:10.666185 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:10.665871 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:29:10.666185 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:10.665931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:10.666185 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:10.666016 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:29:10.666185 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:10.666085 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:29:10.862298 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:10.862266 2576 generic.go:356] "Generic (PLEG): container finished" podID="8552de76-e2d1-4ae9-b054-e9c3ff8ceb12" containerID="e0a8d12d04ebf88ac39beb693a74c7f5d45dd18aced1816b058ace644ddc7fb5" exitCode=0 Jul 15 19:29:10.862446 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:10.862335 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48hp5" event={"ID":"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12","Type":"ContainerDied","Data":"e0a8d12d04ebf88ac39beb693a74c7f5d45dd18aced1816b058ace644ddc7fb5"} Jul 15 19:29:12.666439 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:12.666260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:12.666881 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:12.666319 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:29:12.666881 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:12.666529 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t59l" podUID="219a812a-b04f-46ab-8705-aa296d4dfb48" Jul 15 19:29:12.666881 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:12.666626 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6g5mh" podUID="996e2f7c-c517-41a8-a1f8-16bde57358e2" Jul 15 19:29:12.666881 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:12.666320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:12.666881 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:12.666696 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjp9f" podUID="556a9e4e-23a5-432c-985c-57573b5b05e4" Jul 15 19:29:12.869052 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:12.869017 2576 generic.go:356] "Generic (PLEG): container finished" podID="8552de76-e2d1-4ae9-b054-e9c3ff8ceb12" containerID="f5df2a9d93ae56314c1a70d17430fa153e51e836ee73b689bbccab6300be5c29" exitCode=0 Jul 15 19:29:12.869185 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:12.869082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48hp5" event={"ID":"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12","Type":"ContainerDied","Data":"f5df2a9d93ae56314c1a70d17430fa153e51e836ee73b689bbccab6300be5c29"} Jul 15 19:29:13.310902 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:13.310821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:13.311039 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:13.310960 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:29:13.311039 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:13.311026 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret podName:219a812a-b04f-46ab-8705-aa296d4dfb48 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:45.311002043 +0000 UTC m=+66.140408629 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret") pod "global-pull-secret-syncer-8t59l" (UID: "219a812a-b04f-46ab-8705-aa296d4dfb48") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:29:13.411315 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:13.411281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:29:13.411471 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:13.411330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqsg\" (UniqueName: \"kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg\") pod \"network-check-target-kjp9f\" (UID: \"556a9e4e-23a5-432c-985c-57573b5b05e4\") " pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:13.411471 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:13.411446 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:29:13.411610 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:13.411522 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs podName:996e2f7c-c517-41a8-a1f8-16bde57358e2 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:45.411499905 +0000 UTC m=+66.240906515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs") pod "network-metrics-daemon-6g5mh" (UID: "996e2f7c-c517-41a8-a1f8-16bde57358e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:29:13.411610 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:13.411447 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:29:13.411610 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:13.411579 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:29:13.411610 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:13.411593 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pjqsg for pod openshift-network-diagnostics/network-check-target-kjp9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:29:13.411775 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:13.411637 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg podName:556a9e4e-23a5-432c-985c-57573b5b05e4 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:45.411624495 +0000 UTC m=+66.241031085 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjqsg" (UniqueName: "kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg") pod "network-check-target-kjp9f" (UID: "556a9e4e-23a5-432c-985c-57573b5b05e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:29:14.507568 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.507527 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-43.ec2.internal" event="NodeReady" Jul 15 19:29:14.508036 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.507687 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 19:29:14.547881 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.547850 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-65zbp"] Jul 15 19:29:14.550389 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.550065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.550656 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.550627 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-457fm"] Jul 15 19:29:14.552369 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.552352 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-457fm" Jul 15 19:29:14.553691 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.553669 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 19:29:14.553788 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.553690 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9zc59\"" Jul 15 19:29:14.553788 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.553717 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 19:29:14.554831 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.554812 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 19:29:14.555340 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.555064 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jtlc5\"" Jul 15 19:29:14.555340 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.555066 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 19:29:14.555489 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.555342 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 19:29:14.560138 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.560116 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-65zbp"] Jul 15 19:29:14.562480 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.562429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-457fm"] Jul 15 19:29:14.665502 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.665470 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:14.665682 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.665476 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:14.665682 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.665478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:29:14.669041 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.668780 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 19:29:14.669041 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.668839 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 19:29:14.669041 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.668858 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 19:29:14.669041 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.668903 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 19:29:14.669041 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.668861 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t5v82\"" Jul 15 19:29:14.669041 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.668861 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5jvdh\"" Jul 15 19:29:14.721053 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.721027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90a7d0ca-fa3f-47cc-a770-fa1151efb4bf-cert\") pod \"ingress-canary-457fm\" (UID: \"90a7d0ca-fa3f-47cc-a770-fa1151efb4bf\") " pod="openshift-ingress-canary/ingress-canary-457fm" Jul 15 19:29:14.721225 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.721069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b17b42a6-5a2c-48ed-9832-72da1543b98e-config-volume\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.721225 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.721113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhj9n\" (UniqueName: \"kubernetes.io/projected/90a7d0ca-fa3f-47cc-a770-fa1151efb4bf-kube-api-access-xhj9n\") pod \"ingress-canary-457fm\" (UID: \"90a7d0ca-fa3f-47cc-a770-fa1151efb4bf\") " pod="openshift-ingress-canary/ingress-canary-457fm" Jul 15 19:29:14.721225 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.721179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.721225 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.721217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf47z\" (UniqueName: \"kubernetes.io/projected/b17b42a6-5a2c-48ed-9832-72da1543b98e-kube-api-access-lf47z\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.721446 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.721251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b17b42a6-5a2c-48ed-9832-72da1543b98e-tmp-dir\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.822581 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.822479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.822581 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.822526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf47z\" (UniqueName: \"kubernetes.io/projected/b17b42a6-5a2c-48ed-9832-72da1543b98e-kube-api-access-lf47z\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.822794 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.822588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b17b42a6-5a2c-48ed-9832-72da1543b98e-tmp-dir\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.822794 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.822628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90a7d0ca-fa3f-47cc-a770-fa1151efb4bf-cert\") pod \"ingress-canary-457fm\" (UID: \"90a7d0ca-fa3f-47cc-a770-fa1151efb4bf\") " pod="openshift-ingress-canary/ingress-canary-457fm" Jul 15 19:29:14.822794 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.822654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b17b42a6-5a2c-48ed-9832-72da1543b98e-config-volume\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.822794 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:14.822659 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:29:14.822794 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.822676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhj9n\" (UniqueName: \"kubernetes.io/projected/90a7d0ca-fa3f-47cc-a770-fa1151efb4bf-kube-api-access-xhj9n\") pod \"ingress-canary-457fm\" (UID: \"90a7d0ca-fa3f-47cc-a770-fa1151efb4bf\") " pod="openshift-ingress-canary/ingress-canary-457fm" Jul 15 19:29:14.822794 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:14.822730 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls podName:b17b42a6-5a2c-48ed-9832-72da1543b98e nodeName:}" failed. No retries permitted until 2026-07-15 19:29:15.322708932 +0000 UTC m=+36.152115537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls") pod "dns-default-65zbp" (UID: "b17b42a6-5a2c-48ed-9832-72da1543b98e") : secret "dns-default-metrics-tls" not found Jul 15 19:29:14.823211 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.823192 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b17b42a6-5a2c-48ed-9832-72da1543b98e-tmp-dir\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.823913 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.823895 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b17b42a6-5a2c-48ed-9832-72da1543b98e-config-volume\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.827717 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.827694 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90a7d0ca-fa3f-47cc-a770-fa1151efb4bf-cert\") pod \"ingress-canary-457fm\" (UID: \"90a7d0ca-fa3f-47cc-a770-fa1151efb4bf\") " pod="openshift-ingress-canary/ingress-canary-457fm" Jul 15 19:29:14.831137 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.831115 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhj9n\" (UniqueName: \"kubernetes.io/projected/90a7d0ca-fa3f-47cc-a770-fa1151efb4bf-kube-api-access-xhj9n\") pod \"ingress-canary-457fm\" (UID: \"90a7d0ca-fa3f-47cc-a770-fa1151efb4bf\") " pod="openshift-ingress-canary/ingress-canary-457fm" Jul 15 19:29:14.831801 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.831771 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf47z\" (UniqueName: \"kubernetes.io/projected/b17b42a6-5a2c-48ed-9832-72da1543b98e-kube-api-access-lf47z\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:14.868910 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:14.868882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-457fm" Jul 15 19:29:15.039568 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:15.039372 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-457fm"] Jul 15 19:29:15.043587 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:29:15.043533 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a7d0ca_fa3f_47cc_a770_fa1151efb4bf.slice/crio-63b761a8c974ba90809abfbb2640a2dbb6e08924ee80f7970a2f643dd00863dc WatchSource:0}: Error finding container 63b761a8c974ba90809abfbb2640a2dbb6e08924ee80f7970a2f643dd00863dc: Status 404 returned error can't find the container with id 63b761a8c974ba90809abfbb2640a2dbb6e08924ee80f7970a2f643dd00863dc Jul 15 19:29:15.327393 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:15.327360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:15.327560 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:15.327528 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:29:15.327629 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:15.327616 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls podName:b17b42a6-5a2c-48ed-9832-72da1543b98e nodeName:}" failed. No retries permitted until 2026-07-15 19:29:16.327596559 +0000 UTC m=+37.157003145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls") pod "dns-default-65zbp" (UID: "b17b42a6-5a2c-48ed-9832-72da1543b98e") : secret "dns-default-metrics-tls" not found Jul 15 19:29:15.878922 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:15.878880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-457fm" event={"ID":"90a7d0ca-fa3f-47cc-a770-fa1151efb4bf","Type":"ContainerStarted","Data":"63b761a8c974ba90809abfbb2640a2dbb6e08924ee80f7970a2f643dd00863dc"} Jul 15 19:29:16.333801 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:16.333763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:16.333979 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:16.333947 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:29:16.334039 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:16.334032 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls podName:b17b42a6-5a2c-48ed-9832-72da1543b98e nodeName:}" failed. No retries permitted until 2026-07-15 19:29:18.334008869 +0000 UTC m=+39.163415475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls") pod "dns-default-65zbp" (UID: "b17b42a6-5a2c-48ed-9832-72da1543b98e") : secret "dns-default-metrics-tls" not found Jul 15 19:29:17.887114 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:17.887079 2576 generic.go:356] "Generic (PLEG): container finished" podID="8552de76-e2d1-4ae9-b054-e9c3ff8ceb12" containerID="6d77564bb1ecc1c8ce7841eb0ad68992e0f3fc332ace042d75ae88ab34277030" exitCode=0 Jul 15 19:29:17.887474 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:17.887142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48hp5" event={"ID":"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12","Type":"ContainerDied","Data":"6d77564bb1ecc1c8ce7841eb0ad68992e0f3fc332ace042d75ae88ab34277030"} Jul 15 19:29:18.351653 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:18.351599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:18.351866 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:18.351791 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:29:18.351933 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:18.351882 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls podName:b17b42a6-5a2c-48ed-9832-72da1543b98e nodeName:}" failed. No retries permitted until 2026-07-15 19:29:22.351859291 +0000 UTC m=+43.181265882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls") pod "dns-default-65zbp" (UID: "b17b42a6-5a2c-48ed-9832-72da1543b98e") : secret "dns-default-metrics-tls" not found Jul 15 19:29:18.892055 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:18.892025 2576 generic.go:356] "Generic (PLEG): container finished" podID="8552de76-e2d1-4ae9-b054-e9c3ff8ceb12" containerID="f2756d8d2b8b5ebf27bf302a57d5687f959f0dfe530f6fc03f32b74177abc404" exitCode=0 Jul 15 19:29:18.892425 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:18.892081 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48hp5" event={"ID":"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12","Type":"ContainerDied","Data":"f2756d8d2b8b5ebf27bf302a57d5687f959f0dfe530f6fc03f32b74177abc404"} Jul 15 19:29:19.895248 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:19.895044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-457fm" event={"ID":"90a7d0ca-fa3f-47cc-a770-fa1151efb4bf","Type":"ContainerStarted","Data":"832600d274987397ec1e30cacefc45247f9ca690feac72cbce1a061d36a96d81"} Jul 15 19:29:19.898314 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:19.898291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48hp5" event={"ID":"8552de76-e2d1-4ae9-b054-e9c3ff8ceb12","Type":"ContainerStarted","Data":"4352d8076b4be937ebf1c61ef3081dbbd40f50fdcbec30fcd6b508743db225a5"} Jul 15 19:29:19.909691 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:19.909644 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-457fm" podStartSLOduration=1.9964813129999999 podStartE2EDuration="5.909628374s" totalImagesPullingTime="3.913147061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:19.909040659 +0000 UTC m=+40.738447258" watchObservedRunningTime="2026-07-15 19:29:19.909628374 +0000 UTC m=+40.739034983" Jul 15 19:29:19.932885 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:19.932834 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-48hp5" podStartSLOduration=9.664520775 podStartE2EDuration="40.932817936s" totalImagesPullingTime="31.268297161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:19.928956965 +0000 UTC m=+40.758363573" watchObservedRunningTime="2026-07-15 19:29:19.932817936 +0000 UTC m=+40.762224546" Jul 15 19:29:22.383015 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:22.382969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:22.383382 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:22.383119 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:29:22.383382 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:22.383183 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls podName:b17b42a6-5a2c-48ed-9832-72da1543b98e nodeName:}" failed. No retries permitted until 2026-07-15 19:29:30.383166944 +0000 UTC m=+51.212573531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls") pod "dns-default-65zbp" (UID: "b17b42a6-5a2c-48ed-9832-72da1543b98e") : secret "dns-default-metrics-tls" not found Jul 15 19:29:30.434433 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:30.434395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:30.435032 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:30.434512 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:29:30.435032 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:30.434595 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls podName:b17b42a6-5a2c-48ed-9832-72da1543b98e nodeName:}" failed. No retries permitted until 2026-07-15 19:29:46.434581487 +0000 UTC m=+67.263988073 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls") pod "dns-default-65zbp" (UID: "b17b42a6-5a2c-48ed-9832-72da1543b98e") : secret "dns-default-metrics-tls" not found Jul 15 19:29:38.435831 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.435794 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm"] Jul 15 19:29:38.437492 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.437477 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" Jul 15 19:29:38.441270 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.441239 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 19:29:38.441397 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.441269 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2lfjh\"" Jul 15 19:29:38.442461 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.442445 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 19:29:38.442743 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.442727 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 19:29:38.442813 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.442798 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 19:29:38.450715 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.450696 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm"] Jul 15 19:29:38.489609 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.489570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql6wz\" (UniqueName: \"kubernetes.io/projected/6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831-kube-api-access-ql6wz\") pod \"kube-storage-version-migrator-operator-799cb7f958-t5hbm\" (UID: \"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" Jul 15 19:29:38.489762 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.489622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-t5hbm\" (UID: \"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" Jul 15 19:29:38.489762 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.489703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-t5hbm\" (UID: \"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" Jul 15 19:29:38.535669 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.535636 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-794d569b8b-m7q5l"] Jul 15 19:29:38.537295 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.537280 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.540156 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.540136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 19:29:38.540469 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.540456 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 19:29:38.540783 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.540766 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 19:29:38.540886 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.540822 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4j7lw\"" Jul 15 19:29:38.547731 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.547714 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 19:29:38.553307 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.553285 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-794d569b8b-m7q5l"] Jul 15 19:29:38.590877 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.590846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql6wz\" (UniqueName: \"kubernetes.io/projected/6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831-kube-api-access-ql6wz\") pod \"kube-storage-version-migrator-operator-799cb7f958-t5hbm\" (UID: \"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" Jul 15 19:29:38.590877 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.590879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-certificates\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.591070 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.590897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-bound-sa-token\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.591070 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.591008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-t5hbm\" (UID: \"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" Jul 15 19:29:38.591070 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.591028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-image-registry-private-configuration\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.591070 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.591050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-t5hbm\" (UID: \"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" Jul 15 19:29:38.591070 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.591065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-trusted-ca\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.591281 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.591154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-installation-pull-secrets\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.591281 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.591176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk7jm\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-kube-api-access-tk7jm\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.591281 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.591222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.591281 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.591245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb18f3d0-35f9-422d-8ff8-8a958c883b34-ca-trust-extracted\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.591576 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.591529 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-t5hbm\" (UID: \"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" Jul 15 19:29:38.595022 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.595005 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-t5hbm\" (UID: \"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" Jul 15 19:29:38.599086 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.599064 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql6wz\" (UniqueName: \"kubernetes.io/projected/6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831-kube-api-access-ql6wz\") pod \"kube-storage-version-migrator-operator-799cb7f958-t5hbm\" (UID: \"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" Jul 15 19:29:38.653984 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.653947 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w"] Jul 15 19:29:38.655779 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.655762 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:38.658733 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.658713 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 19:29:38.660131 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.660111 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 19:29:38.660185 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.660146 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gfrrf\"" Jul 15 19:29:38.660494 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.660478 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 19:29:38.660581 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.660482 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 19:29:38.667564 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.667523 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w"] Jul 15 19:29:38.692536 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.692536 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb18f3d0-35f9-422d-8ff8-8a958c883b34-ca-trust-extracted\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.692536 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-certificates\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.692794 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-bound-sa-token\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.692794 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-image-registry-private-configuration\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.692794 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b871de46-813a-41f7-a434-2e430220f44c-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:38.692794 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:38.692640 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:29:38.692794 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:38.692655 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794d569b8b-m7q5l: secret "image-registry-tls" not found Jul 15 19:29:38.692794 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:38.692709 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls podName:eb18f3d0-35f9-422d-8ff8-8a958c883b34 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:39.192694738 +0000 UTC m=+60.022101325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls") pod "image-registry-794d569b8b-m7q5l" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34") : secret "image-registry-tls" not found Jul 15 19:29:38.692794 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-trusted-ca\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.693108 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:38.693108 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-installation-pull-secrets\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.693108 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692927 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb18f3d0-35f9-422d-8ff8-8a958c883b34-ca-trust-extracted\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.693108 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7jm\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-kube-api-access-tk7jm\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.693108 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.692994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bffqx\" (UniqueName: \"kubernetes.io/projected/b871de46-813a-41f7-a434-2e430220f44c-kube-api-access-bffqx\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:38.693357 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.693183 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-certificates\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.693799 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.693775 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-trusted-ca\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.695206 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.695191 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-installation-pull-secrets\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.695256 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.695212 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-image-registry-private-configuration\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.703833 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.703810 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-bound-sa-token\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.704018 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.704000 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk7jm\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-kube-api-access-tk7jm\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:38.746857 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.746823 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" Jul 15 19:29:38.794165 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.794041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b871de46-813a-41f7-a434-2e430220f44c-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:38.794165 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.794121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:38.794290 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.794189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bffqx\" (UniqueName: \"kubernetes.io/projected/b871de46-813a-41f7-a434-2e430220f44c-kube-api-access-bffqx\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:38.794290 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:38.794270 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:38.794387 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:38.794341 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls podName:b871de46-813a-41f7-a434-2e430220f44c nodeName:}" failed. No retries permitted until 2026-07-15 19:29:39.294316664 +0000 UTC m=+60.123723266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9f72w" (UID: "b871de46-813a-41f7-a434-2e430220f44c") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:38.794841 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.794788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b871de46-813a-41f7-a434-2e430220f44c-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:38.805385 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.805355 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bffqx\" (UniqueName: \"kubernetes.io/projected/b871de46-813a-41f7-a434-2e430220f44c-kube-api-access-bffqx\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:38.871659 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.871636 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm"] Jul 15 19:29:38.873970 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:29:38.873948 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bddbb7f_e5a6_4108_95a5_b6d3e8cd0831.slice/crio-86f65b1d778d12cb32c6e542252342d5e19f92a26ad6e05bc1c71c8b70f2713f WatchSource:0}: Error finding container 86f65b1d778d12cb32c6e542252342d5e19f92a26ad6e05bc1c71c8b70f2713f: Status 404 returned error can't find the container with id 86f65b1d778d12cb32c6e542252342d5e19f92a26ad6e05bc1c71c8b70f2713f Jul 15 19:29:38.940290 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:38.940253 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" event={"ID":"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831","Type":"ContainerStarted","Data":"86f65b1d778d12cb32c6e542252342d5e19f92a26ad6e05bc1c71c8b70f2713f"} Jul 15 19:29:39.197804 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:39.197765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:39.197971 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:39.197932 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:29:39.197971 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:39.197950 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794d569b8b-m7q5l: secret "image-registry-tls" not found Jul 15 19:29:39.198039 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:39.198008 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls podName:eb18f3d0-35f9-422d-8ff8-8a958c883b34 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:40.19799257 +0000 UTC m=+61.027399157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls") pod "image-registry-794d569b8b-m7q5l" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34") : secret "image-registry-tls" not found Jul 15 19:29:39.298376 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:39.298339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:39.298536 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:39.298506 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:39.298612 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:39.298601 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls podName:b871de46-813a-41f7-a434-2e430220f44c nodeName:}" failed. No retries permitted until 2026-07-15 19:29:40.298581073 +0000 UTC m=+61.127987668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9f72w" (UID: "b871de46-813a-41f7-a434-2e430220f44c") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:39.870074 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:39.870045 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw8m2" Jul 15 19:29:40.208685 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:40.208604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:40.208831 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:40.208752 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:29:40.208831 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:40.208768 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794d569b8b-m7q5l: secret "image-registry-tls" not found Jul 15 19:29:40.208831 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:40.208820 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls podName:eb18f3d0-35f9-422d-8ff8-8a958c883b34 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:42.20880493 +0000 UTC m=+63.038211521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls") pod "image-registry-794d569b8b-m7q5l" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34") : secret "image-registry-tls" not found Jul 15 19:29:40.309425 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:40.309386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:40.309630 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:40.309610 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:40.309783 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:40.309769 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls podName:b871de46-813a-41f7-a434-2e430220f44c nodeName:}" failed. No retries permitted until 2026-07-15 19:29:42.30968872 +0000 UTC m=+63.139095307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9f72w" (UID: "b871de46-813a-41f7-a434-2e430220f44c") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:41.949358 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:41.949320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" event={"ID":"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831","Type":"ContainerStarted","Data":"88b2c2bbe9df7ede09eee54552cd6b44b5c9c84ee0b11d04ca7532a81feabb11"} Jul 15 19:29:41.965380 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:41.965335 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" podStartSLOduration=1.587259844 podStartE2EDuration="3.965321859s" totalImagesPullingTime="2.378062015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:41.964439405 +0000 UTC m=+62.793846024" watchObservedRunningTime="2026-07-15 19:29:41.965321859 +0000 UTC m=+62.794728468" Jul 15 19:29:42.224659 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:42.224565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:42.224830 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:42.224735 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:29:42.224830 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:42.224759 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794d569b8b-m7q5l: secret "image-registry-tls" not found Jul 15 19:29:42.224941 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:42.224843 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls podName:eb18f3d0-35f9-422d-8ff8-8a958c883b34 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:46.224821633 +0000 UTC m=+67.054228222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls") pod "image-registry-794d569b8b-m7q5l" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34") : secret "image-registry-tls" not found Jul 15 19:29:42.325333 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:42.325288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:42.325507 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:42.325444 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:42.325580 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:42.325513 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls podName:b871de46-813a-41f7-a434-2e430220f44c nodeName:}" failed. No retries permitted until 2026-07-15 19:29:46.325495771 +0000 UTC m=+67.154902373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9f72w" (UID: "b871de46-813a-41f7-a434-2e430220f44c") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:43.364439 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.364404 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r8dph"] Jul 15 19:29:43.366830 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.366814 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.369458 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.369438 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 19:29:43.369795 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.369772 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 19:29:43.369852 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.369781 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 19:29:43.370839 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.370818 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 19:29:43.370951 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.370827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wwfmj\"" Jul 15 19:29:43.375262 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.375242 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r8dph"] Jul 15 19:29:43.434354 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.434325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da77df0b-887a-4c53-82a8-69ee8556be83-crio-socket\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.434518 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.434377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.434518 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.434453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da77df0b-887a-4c53-82a8-69ee8556be83-data-volume\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.434518 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.434487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.434643 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.434525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntqdr\" (UniqueName: \"kubernetes.io/projected/da77df0b-887a-4c53-82a8-69ee8556be83-kube-api-access-ntqdr\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.535408 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.535365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da77df0b-887a-4c53-82a8-69ee8556be83-crio-socket\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.535598 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.535427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.535598 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.535467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da77df0b-887a-4c53-82a8-69ee8556be83-data-volume\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.535598 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.535489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.535598 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.535495 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da77df0b-887a-4c53-82a8-69ee8556be83-crio-socket\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.535598 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.535538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntqdr\" (UniqueName: \"kubernetes.io/projected/da77df0b-887a-4c53-82a8-69ee8556be83-kube-api-access-ntqdr\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.535598 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:43.535592 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 19:29:43.535794 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:43.535622 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:29:43.535794 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:43.535697 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls podName:da77df0b-887a-4c53-82a8-69ee8556be83 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:44.035679195 +0000 UTC m=+64.865085784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r8dph" (UID: "da77df0b-887a-4c53-82a8-69ee8556be83") : secret "insights-runtime-extractor-tls" not found Jul 15 19:29:43.535794 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:43.535714 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm podName:da77df0b-887a-4c53-82a8-69ee8556be83 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:44.035706904 +0000 UTC m=+64.865113492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r8dph" (UID: "da77df0b-887a-4c53-82a8-69ee8556be83") : configmap "kube-rbac-proxy" not found Jul 15 19:29:43.535891 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.535880 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da77df0b-887a-4c53-82a8-69ee8556be83-data-volume\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:43.543856 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:43.543836 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntqdr\" (UniqueName: \"kubernetes.io/projected/da77df0b-887a-4c53-82a8-69ee8556be83-kube-api-access-ntqdr\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:44.039617 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:44.039580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:44.039780 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:44.039637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:44.039780 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:44.039748 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:29:44.039846 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:44.039819 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls podName:da77df0b-887a-4c53-82a8-69ee8556be83 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:45.039803704 +0000 UTC m=+65.869210292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r8dph" (UID: "da77df0b-887a-4c53-82a8-69ee8556be83") : secret "insights-runtime-extractor-tls" not found Jul 15 19:29:44.039846 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:44.039751 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 19:29:44.039920 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:44.039879 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm podName:da77df0b-887a-4c53-82a8-69ee8556be83 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:45.039867947 +0000 UTC m=+65.869274535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r8dph" (UID: "da77df0b-887a-4c53-82a8-69ee8556be83") : configmap "kube-rbac-proxy" not found Jul 15 19:29:45.046779 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.046742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:45.047194 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.046854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:45.047194 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:45.046873 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 19:29:45.047194 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:45.046937 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm podName:da77df0b-887a-4c53-82a8-69ee8556be83 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:47.046921295 +0000 UTC m=+67.876327881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r8dph" (UID: "da77df0b-887a-4c53-82a8-69ee8556be83") : configmap "kube-rbac-proxy" not found Jul 15 19:29:45.047194 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:45.046956 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:29:45.047194 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:45.047004 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls podName:da77df0b-887a-4c53-82a8-69ee8556be83 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:47.046986479 +0000 UTC m=+67.876393066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r8dph" (UID: "da77df0b-887a-4c53-82a8-69ee8556be83") : secret "insights-runtime-extractor-tls" not found Jul 15 19:29:45.349028 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.348936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:45.352100 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.352084 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 19:29:45.362343 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.362313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/219a812a-b04f-46ab-8705-aa296d4dfb48-original-pull-secret\") pod \"global-pull-secret-syncer-8t59l\" (UID: \"219a812a-b04f-46ab-8705-aa296d4dfb48\") " pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:45.449897 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.449860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:29:45.450057 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.449932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqsg\" (UniqueName: \"kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg\") pod \"network-check-target-kjp9f\" (UID: \"556a9e4e-23a5-432c-985c-57573b5b05e4\") " pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:45.452744 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.452719 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 19:29:45.452803 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.452767 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 19:29:45.460266 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:45.460241 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 19:29:45.460419 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:45.460302 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs podName:996e2f7c-c517-41a8-a1f8-16bde57358e2 nodeName:}" failed. No retries permitted until 2026-07-15 19:30:49.460287038 +0000 UTC m=+130.289693626 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs") pod "network-metrics-daemon-6g5mh" (UID: "996e2f7c-c517-41a8-a1f8-16bde57358e2") : secret "metrics-daemon-secret" not found Jul 15 19:29:45.462873 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.462856 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 19:29:45.473638 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.473614 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjqsg\" (UniqueName: \"kubernetes.io/projected/556a9e4e-23a5-432c-985c-57573b5b05e4-kube-api-access-pjqsg\") pod \"network-check-target-kjp9f\" (UID: \"556a9e4e-23a5-432c-985c-57573b5b05e4\") " pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:45.577674 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.577619 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t59l" Jul 15 19:29:45.586710 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.586683 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5jvdh\"" Jul 15 19:29:45.593918 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.593897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:45.716966 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.716920 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8t59l"] Jul 15 19:29:45.719695 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:29:45.719660 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219a812a_b04f_46ab_8705_aa296d4dfb48.slice/crio-76a83d9185c05e02d9bf082191fe52ea632d0d4479cf59e0da8e7db200097a83 WatchSource:0}: Error finding container 76a83d9185c05e02d9bf082191fe52ea632d0d4479cf59e0da8e7db200097a83: Status 404 returned error can't find the container with id 76a83d9185c05e02d9bf082191fe52ea632d0d4479cf59e0da8e7db200097a83 Jul 15 19:29:45.729057 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.729033 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kjp9f"] Jul 15 19:29:45.731404 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:29:45.731382 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556a9e4e_23a5_432c_985c_57573b5b05e4.slice/crio-82d82896d4a03a0556719cf3d419655d24142f15f641f93a3d66878232584425 WatchSource:0}: Error finding container 82d82896d4a03a0556719cf3d419655d24142f15f641f93a3d66878232584425: Status 404 returned error can't find the container with id 82d82896d4a03a0556719cf3d419655d24142f15f641f93a3d66878232584425 Jul 15 19:29:45.960772 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.960686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kjp9f" event={"ID":"556a9e4e-23a5-432c-985c-57573b5b05e4","Type":"ContainerStarted","Data":"82d82896d4a03a0556719cf3d419655d24142f15f641f93a3d66878232584425"} Jul 15 19:29:45.961659 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:45.961637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8t59l" event={"ID":"219a812a-b04f-46ab-8705-aa296d4dfb48","Type":"ContainerStarted","Data":"76a83d9185c05e02d9bf082191fe52ea632d0d4479cf59e0da8e7db200097a83"} Jul 15 19:29:46.255787 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.255753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:46.256215 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:46.255889 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:29:46.256215 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:46.255900 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794d569b8b-m7q5l: secret "image-registry-tls" not found Jul 15 19:29:46.256215 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:46.255957 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls podName:eb18f3d0-35f9-422d-8ff8-8a958c883b34 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:54.255939618 +0000 UTC m=+75.085346208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls") pod "image-registry-794d569b8b-m7q5l" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34") : secret "image-registry-tls" not found Jul 15 19:29:46.352913 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.352884 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wvxs6_c1515d98-02a9-4074-962a-a34146ea1fd1/dns-node-resolver/0.log" Jul 15 19:29:46.356241 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.356208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:46.356373 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:46.356358 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:46.356431 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:46.356411 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls podName:b871de46-813a-41f7-a434-2e430220f44c nodeName:}" failed. No retries permitted until 2026-07-15 19:29:54.356396046 +0000 UTC m=+75.185802634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9f72w" (UID: "b871de46-813a-41f7-a434-2e430220f44c") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:46.456762 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.456725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:29:46.456939 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:46.456917 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:29:46.457004 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:46.456979 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls podName:b17b42a6-5a2c-48ed-9832-72da1543b98e nodeName:}" failed. No retries permitted until 2026-07-15 19:30:18.456960113 +0000 UTC m=+99.286366713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls") pod "dns-default-65zbp" (UID: "b17b42a6-5a2c-48ed-9832-72da1543b98e") : secret "dns-default-metrics-tls" not found Jul 15 19:29:46.743865 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.743624 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-l5cvg"] Jul 15 19:29:46.746163 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.746141 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" Jul 15 19:29:46.748840 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.748787 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 19:29:46.748979 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.748970 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5wvr4\"" Jul 15 19:29:46.750592 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.750219 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 19:29:46.750592 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.750416 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 19:29:46.750592 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.750492 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 19:29:46.753289 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.753260 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-l5cvg"] Jul 15 19:29:46.860266 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.860232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f8030874-35ab-4916-a4aa-754b7d3d41ef-signing-cabundle\") pod \"service-ca-79f68b9f4f-l5cvg\" (UID: \"f8030874-35ab-4916-a4aa-754b7d3d41ef\") " pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" Jul 15 19:29:46.860449 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.860276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6h2j\" (UniqueName: \"kubernetes.io/projected/f8030874-35ab-4916-a4aa-754b7d3d41ef-kube-api-access-j6h2j\") pod \"service-ca-79f68b9f4f-l5cvg\" (UID: \"f8030874-35ab-4916-a4aa-754b7d3d41ef\") " pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" Jul 15 19:29:46.860449 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.860316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f8030874-35ab-4916-a4aa-754b7d3d41ef-signing-key\") pod \"service-ca-79f68b9f4f-l5cvg\" (UID: \"f8030874-35ab-4916-a4aa-754b7d3d41ef\") " pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" Jul 15 19:29:46.952744 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.952719 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6724x_49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be/node-ca/0.log" Jul 15 19:29:46.961055 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.961022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f8030874-35ab-4916-a4aa-754b7d3d41ef-signing-key\") pod \"service-ca-79f68b9f4f-l5cvg\" (UID: \"f8030874-35ab-4916-a4aa-754b7d3d41ef\") " pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" Jul 15 19:29:46.961199 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.961154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f8030874-35ab-4916-a4aa-754b7d3d41ef-signing-cabundle\") pod \"service-ca-79f68b9f4f-l5cvg\" (UID: \"f8030874-35ab-4916-a4aa-754b7d3d41ef\") " pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" Jul 15 19:29:46.961199 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.961185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6h2j\" (UniqueName: \"kubernetes.io/projected/f8030874-35ab-4916-a4aa-754b7d3d41ef-kube-api-access-j6h2j\") pod \"service-ca-79f68b9f4f-l5cvg\" (UID: \"f8030874-35ab-4916-a4aa-754b7d3d41ef\") " pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" Jul 15 19:29:46.962155 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.962120 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f8030874-35ab-4916-a4aa-754b7d3d41ef-signing-cabundle\") pod \"service-ca-79f68b9f4f-l5cvg\" (UID: \"f8030874-35ab-4916-a4aa-754b7d3d41ef\") " pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" Jul 15 19:29:46.964157 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.964133 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f8030874-35ab-4916-a4aa-754b7d3d41ef-signing-key\") pod \"service-ca-79f68b9f4f-l5cvg\" (UID: \"f8030874-35ab-4916-a4aa-754b7d3d41ef\") " pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" Jul 15 19:29:46.970591 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:46.970571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6h2j\" (UniqueName: \"kubernetes.io/projected/f8030874-35ab-4916-a4aa-754b7d3d41ef-kube-api-access-j6h2j\") pod \"service-ca-79f68b9f4f-l5cvg\" (UID: \"f8030874-35ab-4916-a4aa-754b7d3d41ef\") " pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" Jul 15 19:29:47.058978 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:47.058939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" Jul 15 19:29:47.062152 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:47.062126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:47.062255 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:47.062185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:47.062322 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:47.062270 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 19:29:47.062367 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:47.062323 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:29:47.062367 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:47.062336 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm podName:da77df0b-887a-4c53-82a8-69ee8556be83 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:51.062314022 +0000 UTC m=+71.891720636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r8dph" (UID: "da77df0b-887a-4c53-82a8-69ee8556be83") : configmap "kube-rbac-proxy" not found Jul 15 19:29:47.062472 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:47.062371 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls podName:da77df0b-887a-4c53-82a8-69ee8556be83 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:51.062355964 +0000 UTC m=+71.891762577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r8dph" (UID: "da77df0b-887a-4c53-82a8-69ee8556be83") : secret "insights-runtime-extractor-tls" not found Jul 15 19:29:47.206469 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:47.206436 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-l5cvg"] Jul 15 19:29:47.211230 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:29:47.211203 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8030874_35ab_4916_a4aa_754b7d3d41ef.slice/crio-79aa9e162156708fd9ce4b0230bb89fd5462b05e33e55d010f63e9719dcea6bb WatchSource:0}: Error finding container 79aa9e162156708fd9ce4b0230bb89fd5462b05e33e55d010f63e9719dcea6bb: Status 404 returned error can't find the container with id 79aa9e162156708fd9ce4b0230bb89fd5462b05e33e55d010f63e9719dcea6bb Jul 15 19:29:47.753167 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:47.753037 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-457fm_90a7d0ca-fa3f-47cc-a770-fa1151efb4bf/serve-healthcheck-canary/0.log" Jul 15 19:29:47.969398 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:47.969353 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" event={"ID":"f8030874-35ab-4916-a4aa-754b7d3d41ef","Type":"ContainerStarted","Data":"79aa9e162156708fd9ce4b0230bb89fd5462b05e33e55d010f63e9719dcea6bb"} Jul 15 19:29:48.754125 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:48.754097 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-t5hbm_6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831/kube-storage-version-migrator-operator/0.log" Jul 15 19:29:51.100997 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:51.100966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:51.101298 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:51.101050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:51.101298 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:51.101072 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 19:29:51.101298 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:51.101184 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm podName:da77df0b-887a-4c53-82a8-69ee8556be83 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:59.101163046 +0000 UTC m=+79.930569648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r8dph" (UID: "da77df0b-887a-4c53-82a8-69ee8556be83") : configmap "kube-rbac-proxy" not found Jul 15 19:29:51.101298 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:51.101210 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:29:51.101298 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:51.101273 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls podName:da77df0b-887a-4c53-82a8-69ee8556be83 nodeName:}" failed. No retries permitted until 2026-07-15 19:29:59.101255061 +0000 UTC m=+79.930661663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r8dph" (UID: "da77df0b-887a-4c53-82a8-69ee8556be83") : secret "insights-runtime-extractor-tls" not found Jul 15 19:29:51.981834 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:51.981803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8t59l" event={"ID":"219a812a-b04f-46ab-8705-aa296d4dfb48","Type":"ContainerStarted","Data":"144a5d5737a1c2a436b1a025deb96ea949ab5d05e6d5c28fb3d3653d95a39ba6"} Jul 15 19:29:51.983357 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:51.983328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" event={"ID":"f8030874-35ab-4916-a4aa-754b7d3d41ef","Type":"ContainerStarted","Data":"da301cacd8041e0f1a7204471816b1b0d7fb509dca9fe01c9dc2e652cf3037c5"} Jul 15 19:29:51.984595 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:51.984575 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kjp9f" event={"ID":"556a9e4e-23a5-432c-985c-57573b5b05e4","Type":"ContainerStarted","Data":"ee30e98fbf7db939a2b521500fcccfbd701ea454f651af732e41600d2ed1c317"} Jul 15 19:29:51.984740 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:51.984725 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:29:51.999640 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:51.999601 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8t59l" podStartSLOduration=67.702875651 podStartE2EDuration="1m12.999589799s" totalImagesPullingTime="5.296714148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:51.998500968 +0000 UTC m=+72.827907577" watchObservedRunningTime="2026-07-15 19:29:51.999589799 +0000 UTC m=+72.828996407" Jul 15 19:29:52.014823 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:52.014787 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kjp9f" podStartSLOduration=67.747746658 podStartE2EDuration="1m13.014775672s" totalImagesPullingTime="5.267029014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:52.013857611 +0000 UTC m=+72.843264236" watchObservedRunningTime="2026-07-15 19:29:52.014775672 +0000 UTC m=+72.844182275" Jul 15 19:29:52.032469 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:52.032432 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-l5cvg" podStartSLOduration=2.221290632 podStartE2EDuration="6.032420514s" totalImagesPullingTime="3.811129882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:52.031643613 +0000 UTC m=+72.861050223" watchObservedRunningTime="2026-07-15 19:29:52.032420514 +0000 UTC m=+72.861827123" Jul 15 19:29:54.327589 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:54.327518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls\") pod \"image-registry-794d569b8b-m7q5l\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:29:54.327972 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:54.327685 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:29:54.327972 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:54.327707 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794d569b8b-m7q5l: secret "image-registry-tls" not found Jul 15 19:29:54.327972 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:54.327759 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls podName:eb18f3d0-35f9-422d-8ff8-8a958c883b34 nodeName:}" failed. No retries permitted until 2026-07-15 19:30:10.327744189 +0000 UTC m=+91.157150776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls") pod "image-registry-794d569b8b-m7q5l" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34") : secret "image-registry-tls" not found Jul 15 19:29:54.428885 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:54.428847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:29:54.429028 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:54.428959 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:54.429028 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:54.429013 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls podName:b871de46-813a-41f7-a434-2e430220f44c nodeName:}" failed. No retries permitted until 2026-07-15 19:30:10.429000394 +0000 UTC m=+91.258406981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9f72w" (UID: "b871de46-813a-41f7-a434-2e430220f44c") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:29:59.165312 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:59.165264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:59.165312 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:59.165324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:29:59.165766 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:59.165426 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:29:59.165766 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:29:59.165481 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls podName:da77df0b-887a-4c53-82a8-69ee8556be83 nodeName:}" failed. No retries permitted until 2026-07-15 19:30:15.16546766 +0000 UTC m=+95.994874251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r8dph" (UID: "da77df0b-887a-4c53-82a8-69ee8556be83") : secret "insights-runtime-extractor-tls" not found Jul 15 19:29:59.165847 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:29:59.165800 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da77df0b-887a-4c53-82a8-69ee8556be83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:30:08.044012 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.043895 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw"] Jul 15 19:30:08.046609 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.046584 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd"] Jul 15 19:30:08.046730 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.046686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw" Jul 15 19:30:08.048218 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.048201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:08.051915 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.051883 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 15 19:30:08.052021 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.051883 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 19:30:08.052021 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.051999 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 19:30:08.052246 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.052231 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 15 19:30:08.052344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.052257 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 19:30:08.052344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.052258 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vwzz9\"" Jul 15 19:30:08.060188 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.060169 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw"] Jul 15 19:30:08.064564 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.064527 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd"] Jul 15 19:30:08.065214 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.065193 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-794d569b8b-m7q5l"] Jul 15 19:30:08.065404 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:30:08.065384 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" podUID="eb18f3d0-35f9-422d-8ff8-8a958c883b34" Jul 15 19:30:08.106269 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.106236 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d5886ff86-f7ztn"] Jul 15 19:30:08.108213 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.108194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.122478 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.122452 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5886ff86-f7ztn"] Jul 15 19:30:08.130964 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.130941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1023df4f-81ee-42d5-b5f2-7045203eebc7-klusterlet-config\") pod \"klusterlet-addon-workmgr-66498467b-t6jqd\" (UID: \"1023df4f-81ee-42d5-b5f2-7045203eebc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:08.131087 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.130995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b5241ea-cf52-45d4-8a78-0511aadd4a06-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw\" (UID: \"8b5241ea-cf52-45d4-8a78-0511aadd4a06\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw" Jul 15 19:30:08.131087 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.131015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7x6z\" (UniqueName: \"kubernetes.io/projected/8b5241ea-cf52-45d4-8a78-0511aadd4a06-kube-api-access-z7x6z\") pod \"managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw\" (UID: \"8b5241ea-cf52-45d4-8a78-0511aadd4a06\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw" Jul 15 19:30:08.131087 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.131057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1023df4f-81ee-42d5-b5f2-7045203eebc7-tmp\") pod \"klusterlet-addon-workmgr-66498467b-t6jqd\" (UID: \"1023df4f-81ee-42d5-b5f2-7045203eebc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:08.131209 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.131119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86bsm\" (UniqueName: \"kubernetes.io/projected/1023df4f-81ee-42d5-b5f2-7045203eebc7-kube-api-access-86bsm\") pod \"klusterlet-addon-workmgr-66498467b-t6jqd\" (UID: \"1023df4f-81ee-42d5-b5f2-7045203eebc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:08.232427 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86bsm\" (UniqueName: \"kubernetes.io/projected/1023df4f-81ee-42d5-b5f2-7045203eebc7-kube-api-access-86bsm\") pod \"klusterlet-addon-workmgr-66498467b-t6jqd\" (UID: \"1023df4f-81ee-42d5-b5f2-7045203eebc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:08.232427 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45700e73-b422-4d3b-81b8-c74618b322c1-registry-tls\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.232666 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45700e73-b422-4d3b-81b8-c74618b322c1-bound-sa-token\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.232666 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45700e73-b422-4d3b-81b8-c74618b322c1-ca-trust-extracted\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.232666 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45700e73-b422-4d3b-81b8-c74618b322c1-installation-pull-secrets\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.232666 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45700e73-b422-4d3b-81b8-c74618b322c1-image-registry-private-configuration\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.232666 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1023df4f-81ee-42d5-b5f2-7045203eebc7-klusterlet-config\") pod \"klusterlet-addon-workmgr-66498467b-t6jqd\" (UID: \"1023df4f-81ee-42d5-b5f2-7045203eebc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:08.232666 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45700e73-b422-4d3b-81b8-c74618b322c1-trusted-ca\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.232666 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45700e73-b422-4d3b-81b8-c74618b322c1-registry-certificates\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.232937 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b5241ea-cf52-45d4-8a78-0511aadd4a06-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw\" (UID: \"8b5241ea-cf52-45d4-8a78-0511aadd4a06\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw" Jul 15 19:30:08.232937 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7x6z\" (UniqueName: \"kubernetes.io/projected/8b5241ea-cf52-45d4-8a78-0511aadd4a06-kube-api-access-z7x6z\") pod \"managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw\" (UID: \"8b5241ea-cf52-45d4-8a78-0511aadd4a06\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw" Jul 15 19:30:08.232937 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1023df4f-81ee-42d5-b5f2-7045203eebc7-tmp\") pod \"klusterlet-addon-workmgr-66498467b-t6jqd\" (UID: \"1023df4f-81ee-42d5-b5f2-7045203eebc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:08.232937 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.232854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmzmt\" (UniqueName: \"kubernetes.io/projected/45700e73-b422-4d3b-81b8-c74618b322c1-kube-api-access-cmzmt\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.233192 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.233173 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1023df4f-81ee-42d5-b5f2-7045203eebc7-tmp\") pod \"klusterlet-addon-workmgr-66498467b-t6jqd\" (UID: \"1023df4f-81ee-42d5-b5f2-7045203eebc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:08.235188 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.235163 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1023df4f-81ee-42d5-b5f2-7045203eebc7-klusterlet-config\") pod \"klusterlet-addon-workmgr-66498467b-t6jqd\" (UID: \"1023df4f-81ee-42d5-b5f2-7045203eebc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:08.235288 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.235188 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b5241ea-cf52-45d4-8a78-0511aadd4a06-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw\" (UID: \"8b5241ea-cf52-45d4-8a78-0511aadd4a06\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw" Jul 15 19:30:08.242923 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.242894 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7x6z\" (UniqueName: \"kubernetes.io/projected/8b5241ea-cf52-45d4-8a78-0511aadd4a06-kube-api-access-z7x6z\") pod \"managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw\" (UID: \"8b5241ea-cf52-45d4-8a78-0511aadd4a06\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw" Jul 15 19:30:08.243118 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.243097 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86bsm\" (UniqueName: \"kubernetes.io/projected/1023df4f-81ee-42d5-b5f2-7045203eebc7-kube-api-access-86bsm\") pod \"klusterlet-addon-workmgr-66498467b-t6jqd\" (UID: \"1023df4f-81ee-42d5-b5f2-7045203eebc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:08.333407 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.333323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmzmt\" (UniqueName: \"kubernetes.io/projected/45700e73-b422-4d3b-81b8-c74618b322c1-kube-api-access-cmzmt\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.333407 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.333357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45700e73-b422-4d3b-81b8-c74618b322c1-registry-tls\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.333407 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.333394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45700e73-b422-4d3b-81b8-c74618b322c1-bound-sa-token\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.333407 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.333411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45700e73-b422-4d3b-81b8-c74618b322c1-ca-trust-extracted\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.333774 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.333429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45700e73-b422-4d3b-81b8-c74618b322c1-installation-pull-secrets\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.333774 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.333458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45700e73-b422-4d3b-81b8-c74618b322c1-image-registry-private-configuration\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.333774 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.333488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45700e73-b422-4d3b-81b8-c74618b322c1-trusted-ca\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.333774 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.333529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45700e73-b422-4d3b-81b8-c74618b322c1-registry-certificates\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.333979 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.333858 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45700e73-b422-4d3b-81b8-c74618b322c1-ca-trust-extracted\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.334518 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.334493 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45700e73-b422-4d3b-81b8-c74618b322c1-registry-certificates\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.334650 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.334589 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45700e73-b422-4d3b-81b8-c74618b322c1-trusted-ca\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.336036 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.336007 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45700e73-b422-4d3b-81b8-c74618b322c1-registry-tls\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.336127 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.336090 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45700e73-b422-4d3b-81b8-c74618b322c1-image-registry-private-configuration\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.336127 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.336098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45700e73-b422-4d3b-81b8-c74618b322c1-installation-pull-secrets\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.342627 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.342607 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmzmt\" (UniqueName: \"kubernetes.io/projected/45700e73-b422-4d3b-81b8-c74618b322c1-kube-api-access-cmzmt\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.342988 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.342974 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45700e73-b422-4d3b-81b8-c74618b322c1-bound-sa-token\") pod \"image-registry-5d5886ff86-f7ztn\" (UID: \"45700e73-b422-4d3b-81b8-c74618b322c1\") " pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.364647 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.364621 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw" Jul 15 19:30:08.371526 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.371507 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:08.419072 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.418811 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4j7lw\"" Jul 15 19:30:08.426627 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.426307 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:08.500215 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.500179 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw"] Jul 15 19:30:08.503493 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:08.503449 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b5241ea_cf52_45d4_8a78_0511aadd4a06.slice/crio-539e528c2dad7b7ca2401a5dec924f692c466766c0f962290e210d27c322a97b WatchSource:0}: Error finding container 539e528c2dad7b7ca2401a5dec924f692c466766c0f962290e210d27c322a97b: Status 404 returned error can't find the container with id 539e528c2dad7b7ca2401a5dec924f692c466766c0f962290e210d27c322a97b Jul 15 19:30:08.518461 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.518418 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd"] Jul 15 19:30:08.521358 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:08.521324 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1023df4f_81ee_42d5_b5f2_7045203eebc7.slice/crio-edb1f895214582aa007cee3acbdb5a49c538766c41d36493aadd2c2b606ff40e WatchSource:0}: Error finding container edb1f895214582aa007cee3acbdb5a49c538766c41d36493aadd2c2b606ff40e: Status 404 returned error can't find the container with id edb1f895214582aa007cee3acbdb5a49c538766c41d36493aadd2c2b606ff40e Jul 15 19:30:08.568081 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:08.568057 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5886ff86-f7ztn"] Jul 15 19:30:08.570383 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:08.570353 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45700e73_b422_4d3b_81b8_c74618b322c1.slice/crio-8ba7f276d59cf8a387b2079d0d2dd13974268bb9506e40272eba539ad7c9ab62 WatchSource:0}: Error finding container 8ba7f276d59cf8a387b2079d0d2dd13974268bb9506e40272eba539ad7c9ab62: Status 404 returned error can't find the container with id 8ba7f276d59cf8a387b2079d0d2dd13974268bb9506e40272eba539ad7c9ab62 Jul 15 19:30:09.027975 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.027939 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw" event={"ID":"8b5241ea-cf52-45d4-8a78-0511aadd4a06","Type":"ContainerStarted","Data":"539e528c2dad7b7ca2401a5dec924f692c466766c0f962290e210d27c322a97b"} Jul 15 19:30:09.029317 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.029286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" event={"ID":"45700e73-b422-4d3b-81b8-c74618b322c1","Type":"ContainerStarted","Data":"8bc012b5b5d5d5bb69b4538fca8b7a4d95dccb24bdbf289410196ac679276d44"} Jul 15 19:30:09.029446 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.029328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" event={"ID":"45700e73-b422-4d3b-81b8-c74618b322c1","Type":"ContainerStarted","Data":"8ba7f276d59cf8a387b2079d0d2dd13974268bb9506e40272eba539ad7c9ab62"} Jul 15 19:30:09.029446 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.029409 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:09.030379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.030357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" event={"ID":"1023df4f-81ee-42d5-b5f2-7045203eebc7","Type":"ContainerStarted","Data":"edb1f895214582aa007cee3acbdb5a49c538766c41d36493aadd2c2b606ff40e"} Jul 15 19:30:09.030468 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.030382 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:30:09.036518 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.036501 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:30:09.050858 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.050818 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" podStartSLOduration=1.050805274 podStartE2EDuration="1.050805274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:09.049947598 +0000 UTC m=+89.879354206" watchObservedRunningTime="2026-07-15 19:30:09.050805274 +0000 UTC m=+89.880211883" Jul 15 19:30:09.140718 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.140684 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-trusted-ca\") pod \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " Jul 15 19:30:09.140857 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.140732 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb18f3d0-35f9-422d-8ff8-8a958c883b34-ca-trust-extracted\") pod \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " Jul 15 19:30:09.140857 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.140765 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk7jm\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-kube-api-access-tk7jm\") pod \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " Jul 15 19:30:09.140857 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.140798 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-installation-pull-secrets\") pod \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " Jul 15 19:30:09.140857 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.140831 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-certificates\") pod \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " Jul 15 19:30:09.141045 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.140873 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-bound-sa-token\") pod \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " Jul 15 19:30:09.141045 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.140908 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-image-registry-private-configuration\") pod \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\" (UID: \"eb18f3d0-35f9-422d-8ff8-8a958c883b34\") " Jul 15 19:30:09.141149 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.141076 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb18f3d0-35f9-422d-8ff8-8a958c883b34-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "eb18f3d0-35f9-422d-8ff8-8a958c883b34" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:30:09.141241 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.141220 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "eb18f3d0-35f9-422d-8ff8-8a958c883b34" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:30:09.141327 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.141303 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "eb18f3d0-35f9-422d-8ff8-8a958c883b34" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:30:09.141391 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.141332 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-trusted-ca\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:30:09.141391 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.141353 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb18f3d0-35f9-422d-8ff8-8a958c883b34-ca-trust-extracted\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:30:09.143480 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.143444 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "eb18f3d0-35f9-422d-8ff8-8a958c883b34" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:30:09.143480 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.143450 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-kube-api-access-tk7jm" (OuterVolumeSpecName: "kube-api-access-tk7jm") pod "eb18f3d0-35f9-422d-8ff8-8a958c883b34" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34"). InnerVolumeSpecName "kube-api-access-tk7jm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:30:09.143653 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.143521 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "eb18f3d0-35f9-422d-8ff8-8a958c883b34" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:30:09.143653 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.143565 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "eb18f3d0-35f9-422d-8ff8-8a958c883b34" (UID: "eb18f3d0-35f9-422d-8ff8-8a958c883b34"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:30:09.241972 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.241937 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-image-registry-private-configuration\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:30:09.241972 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.241969 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk7jm\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-kube-api-access-tk7jm\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:30:09.241972 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.241979 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb18f3d0-35f9-422d-8ff8-8a958c883b34-installation-pull-secrets\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:30:09.242178 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.241989 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-certificates\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:30:09.242178 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:09.241998 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-bound-sa-token\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:30:10.034340 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:10.034307 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794d569b8b-m7q5l" Jul 15 19:30:10.063473 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:10.063445 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-794d569b8b-m7q5l"] Jul 15 19:30:10.068988 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:10.068949 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-794d569b8b-m7q5l"] Jul 15 19:30:10.150133 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:10.150109 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb18f3d0-35f9-422d-8ff8-8a958c883b34-registry-tls\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:30:10.453504 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:10.453401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:30:10.456468 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:10.456437 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b871de46-813a-41f7-a434-2e430220f44c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9f72w\" (UID: \"b871de46-813a-41f7-a434-2e430220f44c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:30:10.466747 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:10.466720 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gfrrf\"" Jul 15 19:30:10.475109 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:10.474864 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" Jul 15 19:30:10.635061 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:10.635028 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w"] Jul 15 19:30:10.638041 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:10.638013 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb871de46_813a_41f7_a434_2e430220f44c.slice/crio-ede4e538dd6fc186fab46b4274c7722d6b3ef08395bc144e353994deaee55fa1 WatchSource:0}: Error finding container ede4e538dd6fc186fab46b4274c7722d6b3ef08395bc144e353994deaee55fa1: Status 404 returned error can't find the container with id ede4e538dd6fc186fab46b4274c7722d6b3ef08395bc144e353994deaee55fa1 Jul 15 19:30:11.039366 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:11.039319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" event={"ID":"b871de46-813a-41f7-a434-2e430220f44c","Type":"ContainerStarted","Data":"ede4e538dd6fc186fab46b4274c7722d6b3ef08395bc144e353994deaee55fa1"} Jul 15 19:30:11.675540 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:11.675501 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb18f3d0-35f9-422d-8ff8-8a958c883b34" path="/var/lib/kubelet/pods/eb18f3d0-35f9-422d-8ff8-8a958c883b34/volumes" Jul 15 19:30:15.056420 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.056382 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" event={"ID":"b871de46-813a-41f7-a434-2e430220f44c","Type":"ContainerStarted","Data":"98155fd875d87686b88983dde3961853cce01f2d3e1edfdc19b206eea5c1784a"} Jul 15 19:30:15.057911 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.057890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" event={"ID":"1023df4f-81ee-42d5-b5f2-7045203eebc7","Type":"ContainerStarted","Data":"ca3e589d5d4b63301e8d1824922440c8b66783b4883d0128f3ff1b6a466795de"} Jul 15 19:30:15.058015 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.057940 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:15.059404 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.059379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw" event={"ID":"8b5241ea-cf52-45d4-8a78-0511aadd4a06","Type":"ContainerStarted","Data":"ee2629a4feed2ec452f78ce3b47d32c944f7af9fd11de60788b0fecdf14ca91c"} Jul 15 19:30:15.059989 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.059972 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" Jul 15 19:30:15.072408 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.072376 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9f72w" podStartSLOduration=33.465435536 podStartE2EDuration="37.072364875s" totalImagesPullingTime="3.606929339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:15.071054468 +0000 UTC m=+95.900461079" watchObservedRunningTime="2026-07-15 19:30:15.072364875 +0000 UTC m=+95.901771483" Jul 15 19:30:15.085344 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.085308 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8ff6b57d-pv6fw" podStartSLOduration=1.33573999 podStartE2EDuration="7.085298109s" totalImagesPullingTime="5.749558119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:15.084898869 +0000 UTC m=+95.914305481" watchObservedRunningTime="2026-07-15 19:30:15.085298109 +0000 UTC m=+95.914704718" Jul 15 19:30:15.099368 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.099334 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66498467b-t6jqd" podStartSLOduration=1.357157601 podStartE2EDuration="7.099325172s" totalImagesPullingTime="5.742167571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:15.098595845 +0000 UTC m=+95.928002454" watchObservedRunningTime="2026-07-15 19:30:15.099325172 +0000 UTC m=+95.928731781" Jul 15 19:30:15.192399 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.192376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:30:15.194931 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.194908 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da77df0b-887a-4c53-82a8-69ee8556be83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8dph\" (UID: \"da77df0b-887a-4c53-82a8-69ee8556be83\") " pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:30:15.475968 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.475875 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r8dph" Jul 15 19:30:15.598661 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:15.598632 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r8dph"] Jul 15 19:30:15.602648 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:15.602616 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda77df0b_887a_4c53_82a8_69ee8556be83.slice/crio-a47cc19032deadd0e0301dcdbe5e67b40c3a68ca1797558e7dcaed300e2c8d06 WatchSource:0}: Error finding container a47cc19032deadd0e0301dcdbe5e67b40c3a68ca1797558e7dcaed300e2c8d06: Status 404 returned error can't find the container with id a47cc19032deadd0e0301dcdbe5e67b40c3a68ca1797558e7dcaed300e2c8d06 Jul 15 19:30:16.065661 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:16.065206 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r8dph" event={"ID":"da77df0b-887a-4c53-82a8-69ee8556be83","Type":"ContainerStarted","Data":"a47cc19032deadd0e0301dcdbe5e67b40c3a68ca1797558e7dcaed300e2c8d06"} Jul 15 19:30:18.517525 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:18.517492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:30:18.520090 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:18.520064 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b17b42a6-5a2c-48ed-9832-72da1543b98e-metrics-tls\") pod \"dns-default-65zbp\" (UID: \"b17b42a6-5a2c-48ed-9832-72da1543b98e\") " pod="openshift-dns/dns-default-65zbp" Jul 15 19:30:18.765958 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:18.765933 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9zc59\"" Jul 15 19:30:18.774295 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:18.774230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-65zbp" Jul 15 19:30:20.507445 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:20.507389 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-65zbp"] Jul 15 19:30:20.509629 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:20.509604 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17b42a6_5a2c_48ed_9832_72da1543b98e.slice/crio-09e428fccecfbd687e6aa76895ba1539d21c029a2be53f65d0c4158a20823a43 WatchSource:0}: Error finding container 09e428fccecfbd687e6aa76895ba1539d21c029a2be53f65d0c4158a20823a43: Status 404 returned error can't find the container with id 09e428fccecfbd687e6aa76895ba1539d21c029a2be53f65d0c4158a20823a43 Jul 15 19:30:21.085524 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:21.085485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-65zbp" event={"ID":"b17b42a6-5a2c-48ed-9832-72da1543b98e","Type":"ContainerStarted","Data":"09e428fccecfbd687e6aa76895ba1539d21c029a2be53f65d0c4158a20823a43"} Jul 15 19:30:21.087506 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:21.087474 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r8dph" event={"ID":"da77df0b-887a-4c53-82a8-69ee8556be83","Type":"ContainerStarted","Data":"4f84f8c4188f85319b906ab750f9583055758e522aa8646f44ab880d1b70aa03"} Jul 15 19:30:22.989279 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:22.989238 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kjp9f" Jul 15 19:30:25.106435 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:25.106407 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-65zbp" event={"ID":"b17b42a6-5a2c-48ed-9832-72da1543b98e","Type":"ContainerStarted","Data":"452d17fff87eefbd4306e1e5df4e2577aa883857b28b025026d32aa6faaa2f41"} Jul 15 19:30:25.106809 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:25.106470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-65zbp" event={"ID":"b17b42a6-5a2c-48ed-9832-72da1543b98e","Type":"ContainerStarted","Data":"9b79b9a6f2e575d503b5fc110817e367d5da91c60d419f3f239b20ba7fce1d21"} Jul 15 19:30:26.112170 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:26.112127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r8dph" event={"ID":"da77df0b-887a-4c53-82a8-69ee8556be83","Type":"ContainerStarted","Data":"737b5013eb413dc722ef22efbb3a215e84c0359948dd8138211ea544399d64e8"} Jul 15 19:30:26.112598 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:26.112282 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-65zbp" Jul 15 19:30:26.130254 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:26.130207 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-65zbp" podStartSLOduration=67.769912113 podStartE2EDuration="1m12.130191364s" totalImagesPullingTime="4.360279251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:26.128185069 +0000 UTC m=+106.957591678" watchObservedRunningTime="2026-07-15 19:30:26.130191364 +0000 UTC m=+106.959597972" Jul 15 19:30:28.432021 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:28.431984 2576 patch_prober.go:28] interesting pod/image-registry-5d5886ff86-f7ztn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 19:30:28.432426 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:28.432046 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" podUID="45700e73-b422-4d3b-81b8-c74618b322c1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 19:30:29.126929 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:29.126899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r8dph" event={"ID":"da77df0b-887a-4c53-82a8-69ee8556be83","Type":"ContainerStarted","Data":"e95b75b697a4fcaffab99973d8c71344014318d11b5968733f38cf0c59a09e00"} Jul 15 19:30:29.145989 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:29.145942 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r8dph" podStartSLOduration=32.952045872 podStartE2EDuration="46.145927792s" totalImagesPullingTime="13.19388192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:29:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:29.144303631 +0000 UTC m=+109.973710240" watchObservedRunningTime="2026-07-15 19:30:29.145927792 +0000 UTC m=+109.975334400" Jul 15 19:30:30.039138 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:30.039108 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d5886ff86-f7ztn" Jul 15 19:30:33.123316 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.123275 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9mjlh"] Jul 15 19:30:33.125899 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.125877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.130033 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.130010 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 15 19:30:33.130153 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.130053 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 15 19:30:33.130153 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.130146 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 15 19:30:33.130254 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.130053 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 19:30:33.130308 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.130265 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lxnbp\"" Jul 15 19:30:33.138047 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.138022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.138210 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.138186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad866d62-06cd-4d37-9286-085f3dbd9866-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.138324 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.138239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.138324 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.138270 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.138324 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.138290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkcx6\" (UniqueName: \"kubernetes.io/projected/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-api-access-fkcx6\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.138492 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.138333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad866d62-06cd-4d37-9286-085f3dbd9866-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.139800 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.139783 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9mjlh"] Jul 15 19:30:33.141178 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.141157 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7knnc"] Jul 15 19:30:33.143851 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.143833 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.146143 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.146126 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 19:30:33.146493 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.146476 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 19:30:33.146714 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.146693 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x2sbw\"" Jul 15 19:30:33.146802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.146777 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 19:30:33.238652 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.238618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad866d62-06cd-4d37-9286-085f3dbd9866-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.238652 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.238664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-tls\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.238889 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.238714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-wtmp\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.238889 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.238738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e151d879-2975-4ea2-8274-68b9f9197849-metrics-client-ca\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.238889 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.238765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e151d879-2975-4ea2-8274-68b9f9197849-sys\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.238889 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.238845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcvwd\" (UniqueName: \"kubernetes.io/projected/e151d879-2975-4ea2-8274-68b9f9197849-kube-api-access-xcvwd\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.239082 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.238925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.239082 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.239006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad866d62-06cd-4d37-9286-085f3dbd9866-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.239082 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:30:33.239018 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 15 19:30:33.239082 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.239019 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad866d62-06cd-4d37-9286-085f3dbd9866-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.239082 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.239051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-accelerators-collector-config\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.239082 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:30:33.239082 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-tls podName:ad866d62-06cd-4d37-9286-085f3dbd9866 nodeName:}" failed. No retries permitted until 2026-07-15 19:30:33.739062319 +0000 UTC m=+114.568468921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-9mjlh" (UID: "ad866d62-06cd-4d37-9286-085f3dbd9866") : secret "kube-state-metrics-tls" not found Jul 15 19:30:33.239398 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.239191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.239398 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.239223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e151d879-2975-4ea2-8274-68b9f9197849-root\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.239398 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.239262 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.239398 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.239292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-textfile\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.239614 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.239434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcx6\" (UniqueName: \"kubernetes.io/projected/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-api-access-fkcx6\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.239614 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.239481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.239716 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.239659 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad866d62-06cd-4d37-9286-085f3dbd9866-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.239921 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.239901 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.242210 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.242189 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.248048 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.248024 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkcx6\" (UniqueName: \"kubernetes.io/projected/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-api-access-fkcx6\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.340225 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e151d879-2975-4ea2-8274-68b9f9197849-root\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340393 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-textfile\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340393 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340393 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-tls\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340393 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340315 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e151d879-2975-4ea2-8274-68b9f9197849-root\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340393 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-wtmp\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340393 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e151d879-2975-4ea2-8274-68b9f9197849-metrics-client-ca\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340742 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e151d879-2975-4ea2-8274-68b9f9197849-sys\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340742 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340437 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-wtmp\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340742 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcvwd\" (UniqueName: \"kubernetes.io/projected/e151d879-2975-4ea2-8274-68b9f9197849-kube-api-access-xcvwd\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340742 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-accelerators-collector-config\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340742 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340614 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-textfile\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.340742 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e151d879-2975-4ea2-8274-68b9f9197849-sys\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.341032 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340990 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e151d879-2975-4ea2-8274-68b9f9197849-metrics-client-ca\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.341032 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.340999 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-accelerators-collector-config\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.342830 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.342805 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.343145 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.343129 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e151d879-2975-4ea2-8274-68b9f9197849-node-exporter-tls\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.353447 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.353419 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcvwd\" (UniqueName: \"kubernetes.io/projected/e151d879-2975-4ea2-8274-68b9f9197849-kube-api-access-xcvwd\") pod \"node-exporter-7knnc\" (UID: \"e151d879-2975-4ea2-8274-68b9f9197849\") " pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.454053 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.453970 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7knnc" Jul 15 19:30:33.464844 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:33.464822 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode151d879_2975_4ea2_8274_68b9f9197849.slice/crio-dcf1ee333a1d5484c9972b11eaea249baf1f2c4ca55a502ed854aae5c5415441 WatchSource:0}: Error finding container dcf1ee333a1d5484c9972b11eaea249baf1f2c4ca55a502ed854aae5c5415441: Status 404 returned error can't find the container with id dcf1ee333a1d5484c9972b11eaea249baf1f2c4ca55a502ed854aae5c5415441 Jul 15 19:30:33.743359 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.743269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:33.745685 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:33.745667 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad866d62-06cd-4d37-9286-085f3dbd9866-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9mjlh\" (UID: \"ad866d62-06cd-4d37-9286-085f3dbd9866\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:34.036409 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.036375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" Jul 15 19:30:34.147858 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.147792 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7knnc" event={"ID":"e151d879-2975-4ea2-8274-68b9f9197849","Type":"ContainerStarted","Data":"dcf1ee333a1d5484c9972b11eaea249baf1f2c4ca55a502ed854aae5c5415441"} Jul 15 19:30:34.173932 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.173899 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9mjlh"] Jul 15 19:30:34.177112 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:34.177089 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad866d62_06cd_4d37_9286_085f3dbd9866.slice/crio-09a378b71f3caeda481fd12fcc15fad9a434ce8e43969825e5d49590760298a3 WatchSource:0}: Error finding container 09a378b71f3caeda481fd12fcc15fad9a434ce8e43969825e5d49590760298a3: Status 404 returned error can't find the container with id 09a378b71f3caeda481fd12fcc15fad9a434ce8e43969825e5d49590760298a3 Jul 15 19:30:34.186029 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.186006 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 19:30:34.188877 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.188862 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.191423 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.191404 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 19:30:34.191916 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.191706 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 19:30:34.191916 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.191718 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 19:30:34.191916 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.191732 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 19:30:34.191916 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.191801 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t29m4\"" Jul 15 19:30:34.191916 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.191753 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 19:30:34.191916 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.191739 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 19:30:34.193010 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.192974 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 19:30:34.193130 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.193016 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 19:30:34.193191 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.193156 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 19:30:34.207011 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.206924 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 19:30:34.247677 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.247651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.247821 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.247705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-web-config\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.247821 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.247739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.247821 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.247764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.247821 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.247786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wm79\" (UniqueName: \"kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-kube-api-access-7wm79\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.247977 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.247838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-out\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.247977 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.247878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.247977 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.247927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.247977 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.247960 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.248157 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.247986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.248157 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.248010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.248157 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.248055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.248157 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.248091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.348626 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.348626 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.348834 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.348834 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.348834 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.348834 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:30:34.348765 2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 15 19:30:34.348834 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.348834 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.348834 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:30:34.348824 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-main-tls podName:0ca8aba7-9918-44da-a37e-d2c64129eb2d nodeName:}" failed. No retries permitted until 2026-07-15 19:30:34.848805551 +0000 UTC m=+115.678212141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d") : secret "alertmanager-main-tls" not found Jul 15 19:30:34.349187 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348865 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.349187 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-web-config\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.349187 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348943 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.349187 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.349187 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.348982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.349187 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.349006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wm79\" (UniqueName: \"kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-kube-api-access-7wm79\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.349187 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.349033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-out\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.349979 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.349581 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.350669 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.350646 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.352290 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.352265 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.352383 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.352304 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.353338 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.353296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-web-config\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.353999 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.353957 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.354186 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.354162 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.355158 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.355137 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.355495 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.355467 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-out\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.355946 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.355925 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.358043 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.358025 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wm79\" (UniqueName: \"kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-kube-api-access-7wm79\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.852752 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.852718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:34.855186 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:34.855168 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:35.099857 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:35.099825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:30:35.154895 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:35.154853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" event={"ID":"ad866d62-06cd-4d37-9286-085f3dbd9866","Type":"ContainerStarted","Data":"09a378b71f3caeda481fd12fcc15fad9a434ce8e43969825e5d49590760298a3"} Jul 15 19:30:35.265176 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:35.265151 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 19:30:35.267243 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:35.267220 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca8aba7_9918_44da_a37e_d2c64129eb2d.slice/crio-73fa10566f59200001ea73fb3ea938553c43e2fa732f4117bb4fddf285f4d9ce WatchSource:0}: Error finding container 73fa10566f59200001ea73fb3ea938553c43e2fa732f4117bb4fddf285f4d9ce: Status 404 returned error can't find the container with id 73fa10566f59200001ea73fb3ea938553c43e2fa732f4117bb4fddf285f4d9ce Jul 15 19:30:36.119023 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:36.118928 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-65zbp" Jul 15 19:30:36.165923 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:36.165011 2576 generic.go:356] "Generic (PLEG): container finished" podID="e151d879-2975-4ea2-8274-68b9f9197849" containerID="54f4c86b64111e4287e87daec610057139e7581ab7707280ffe354d13a574840" exitCode=0 Jul 15 19:30:36.165923 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:36.165092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7knnc" event={"ID":"e151d879-2975-4ea2-8274-68b9f9197849","Type":"ContainerDied","Data":"54f4c86b64111e4287e87daec610057139e7581ab7707280ffe354d13a574840"} Jul 15 19:30:36.177675 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:36.177293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" event={"ID":"ad866d62-06cd-4d37-9286-085f3dbd9866","Type":"ContainerStarted","Data":"f8d391d34df18accfc57111040e6eda3b5f9312026dfbd3d98886cab4074f1bc"} Jul 15 19:30:36.177675 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:36.177364 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" event={"ID":"ad866d62-06cd-4d37-9286-085f3dbd9866","Type":"ContainerStarted","Data":"1b648847a92c7ec5b0c2537db770355b9851fe0fe0f2e508b499f483930513d1"} Jul 15 19:30:36.177675 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:36.177395 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" event={"ID":"ad866d62-06cd-4d37-9286-085f3dbd9866","Type":"ContainerStarted","Data":"f30f5bd5c1166e44d66557d3aa974185f74462e0d0c96c2ed2220b5781e6df68"} Jul 15 19:30:36.180538 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:36.180512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerStarted","Data":"73fa10566f59200001ea73fb3ea938553c43e2fa732f4117bb4fddf285f4d9ce"} Jul 15 19:30:36.202683 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:36.202626 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-9mjlh" podStartSLOduration=1.48504531 podStartE2EDuration="3.202606545s" totalImagesPullingTime="1.717561235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:36.201022415 +0000 UTC m=+117.030429025" watchObservedRunningTime="2026-07-15 19:30:36.202606545 +0000 UTC m=+117.032013154" Jul 15 19:30:37.186079 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.186038 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7knnc" event={"ID":"e151d879-2975-4ea2-8274-68b9f9197849","Type":"ContainerStarted","Data":"792798e8ef4b46cf370df69f6cf4419dffc72891d0cf920d4bcf066ab2578eff"} Jul 15 19:30:37.186519 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.186102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7knnc" event={"ID":"e151d879-2975-4ea2-8274-68b9f9197849","Type":"ContainerStarted","Data":"f86b8577725826ee771d230b3ea01e197bc185559fdc80b1be87f77d8820ce8b"} Jul 15 19:30:37.187504 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.187478 2576 generic.go:356] "Generic (PLEG): container finished" podID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerID="f31999a13cf45c0e05bcf43ffb6993ef4555a1ba3b5001dcf5789bc8ad0b2df4" exitCode=0 Jul 15 19:30:37.187588 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.187568 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerDied","Data":"f31999a13cf45c0e05bcf43ffb6993ef4555a1ba3b5001dcf5789bc8ad0b2df4"} Jul 15 19:30:37.205661 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.205601 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7knnc" podStartSLOduration=1.63852972 podStartE2EDuration="4.205583089s" totalImagesPullingTime="2.431087396s" totalInitContainerRuntime="135.965973ms" isStatefulPod=true podCreationTimestamp="2026-07-15 19:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:37.204688429 +0000 UTC m=+118.034095056" watchObservedRunningTime="2026-07-15 19:30:37.205583089 +0000 UTC m=+118.034989700" Jul 15 19:30:37.899390 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.899348 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7"] Jul 15 19:30:37.901753 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.901737 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" Jul 15 19:30:37.904134 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.904117 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 15 19:30:37.904362 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.904349 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-r7wdf\"" Jul 15 19:30:37.910666 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.910640 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7"] Jul 15 19:30:37.977724 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.977687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnqmm\" (UniqueName: \"kubernetes.io/projected/32627078-5cff-4c1d-a8c0-09ed104ce92a-kube-api-access-xnqmm\") pod \"monitoring-plugin-5f68df7f58-tm5k7\" (UID: \"32627078-5cff-4c1d-a8c0-09ed104ce92a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" Jul 15 19:30:37.977897 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:37.977738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32627078-5cff-4c1d-a8c0-09ed104ce92a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-tm5k7\" (UID: \"32627078-5cff-4c1d-a8c0-09ed104ce92a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" Jul 15 19:30:38.078910 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:38.078877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnqmm\" (UniqueName: \"kubernetes.io/projected/32627078-5cff-4c1d-a8c0-09ed104ce92a-kube-api-access-xnqmm\") pod \"monitoring-plugin-5f68df7f58-tm5k7\" (UID: \"32627078-5cff-4c1d-a8c0-09ed104ce92a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" Jul 15 19:30:38.079075 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:38.078922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32627078-5cff-4c1d-a8c0-09ed104ce92a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-tm5k7\" (UID: \"32627078-5cff-4c1d-a8c0-09ed104ce92a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" Jul 15 19:30:38.081807 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:38.081784 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32627078-5cff-4c1d-a8c0-09ed104ce92a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-tm5k7\" (UID: \"32627078-5cff-4c1d-a8c0-09ed104ce92a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" Jul 15 19:30:38.087099 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:38.087076 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnqmm\" (UniqueName: \"kubernetes.io/projected/32627078-5cff-4c1d-a8c0-09ed104ce92a-kube-api-access-xnqmm\") pod \"monitoring-plugin-5f68df7f58-tm5k7\" (UID: \"32627078-5cff-4c1d-a8c0-09ed104ce92a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" Jul 15 19:30:38.211167 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:38.211082 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" Jul 15 19:30:38.345725 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:38.345696 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7"] Jul 15 19:30:38.349052 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:38.349025 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32627078_5cff_4c1d_a8c0_09ed104ce92a.slice/crio-541f14301991c2c7bdad7affd5312905cfd664b9ffd2a15ac4c1538afec73534 WatchSource:0}: Error finding container 541f14301991c2c7bdad7affd5312905cfd664b9ffd2a15ac4c1538afec73534: Status 404 returned error can't find the container with id 541f14301991c2c7bdad7affd5312905cfd664b9ffd2a15ac4c1538afec73534 Jul 15 19:30:39.197202 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.197138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" event={"ID":"32627078-5cff-4c1d-a8c0-09ed104ce92a","Type":"ContainerStarted","Data":"541f14301991c2c7bdad7affd5312905cfd664b9ffd2a15ac4c1538afec73534"} Jul 15 19:30:39.200652 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.200621 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerStarted","Data":"028c21fe03e5a0b63ca5fbf4368abd9901049688616353a8e6c445f8e3d7d63c"} Jul 15 19:30:39.200754 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.200679 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerStarted","Data":"0543c5c3357fe42dd7a4579760112a647b8cb5e5f8f930618aa56ce95bc8ff7e"} Jul 15 19:30:39.393766 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.393700 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 19:30:39.396710 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.396689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.399750 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.399726 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 19:30:39.399852 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.399815 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2rpc621buo8hn\"" Jul 15 19:30:39.400726 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.400687 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 19:30:39.400905 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.400759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 19:30:39.400905 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.400767 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 19:30:39.401087 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.400915 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 19:30:39.401087 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.400924 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 19:30:39.401087 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.400967 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 19:30:39.401087 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.401033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 19:30:39.401087 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.401074 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 19:30:39.401304 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.401201 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 19:30:39.401352 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.401328 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9nvbl\"" Jul 15 19:30:39.401712 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.401693 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 19:30:39.401792 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.401696 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 19:30:39.401792 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.401700 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 19:30:39.407875 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.407853 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 19:30:39.411142 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.411111 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 19:30:39.412697 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.412668 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 19:30:39.494782 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.494750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.494782 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.494784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495000 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.494801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495000 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.494818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495000 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.494840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495000 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.494924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495000 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.494959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495000 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.494988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495245 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jvpx\" (UniqueName: \"kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-kube-api-access-5jvpx\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495245 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495245 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495245 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495245 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495245 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495169 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495245 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495245 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495245 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495536 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495536 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.495536 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.495311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-config\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596455 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596455 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596455 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596455 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-config\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jvpx\" (UniqueName: \"kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-kube-api-access-5jvpx\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.596802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.597626 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.597626 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.596905 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.597690 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.597620 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.599286 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.599267 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.599889 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.599868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 19:30:39.599889 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.599881 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2rpc621buo8hn\"" Jul 15 19:30:39.600060 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.599872 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 19:30:39.600060 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.599996 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 19:30:39.600312 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.600292 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 19:30:39.600312 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.600306 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 19:30:39.600455 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.600362 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 19:30:39.600455 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.600374 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 19:30:39.600577 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.600495 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 19:30:39.600577 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.600502 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 19:30:39.600577 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.600496 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 19:30:39.600922 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.600888 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 19:30:39.600922 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.600909 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 19:30:39.601073 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.600927 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 19:30:39.603606 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.603590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 19:30:39.606478 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.606457 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 19:30:39.607475 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.607231 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.608755 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.608731 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.609496 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.609471 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.609621 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.609484 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.610078 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.610052 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jvpx\" (UniqueName: \"kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-kube-api-access-5jvpx\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.610078 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.610075 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.611237 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.611207 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.612277 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.611837 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.612277 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.612085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-config\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.612277 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.612233 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.612277 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.612249 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.612277 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.612248 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.612970 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.612926 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.613309 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.613283 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.614007 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.613934 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.614514 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.614495 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.614610 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.614572 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:39.716160 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.716128 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9nvbl\"" Jul 15 19:30:39.723423 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:39.723390 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:40.053252 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:40.053220 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 19:30:40.057309 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:40.057277 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1fc066_3f60_497f_b389_7672dd603009.slice/crio-632bf202f1a974dffc281276005143af44d0d774088de6376fb4e84853564391 WatchSource:0}: Error finding container 632bf202f1a974dffc281276005143af44d0d774088de6376fb4e84853564391: Status 404 returned error can't find the container with id 632bf202f1a974dffc281276005143af44d0d774088de6376fb4e84853564391 Jul 15 19:30:40.208210 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:40.208124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerStarted","Data":"82583b5016b67bc31e70028c491a568d3821dcb01cb4c2b617f89661fcabfeae"} Jul 15 19:30:40.208210 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:40.208202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerStarted","Data":"5d4f90261b624b75b40ba5792144ac75058f3aa9dc9b76bd8ea51ee109c8c78e"} Jul 15 19:30:40.208395 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:40.208240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerStarted","Data":"2c01b265ac88956a769db29e9cd47090cf914e145517554624e7252c5e770816"} Jul 15 19:30:40.209752 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:40.209725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" event={"ID":"32627078-5cff-4c1d-a8c0-09ed104ce92a","Type":"ContainerStarted","Data":"1eaa571f8d9068d85d482a95166883be783b1b7278831e947e6b1fdf8e2ab3c5"} Jul 15 19:30:40.209973 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:40.209912 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" Jul 15 19:30:40.211526 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:40.211500 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed1fc066-3f60-497f-b389-7672dd603009" containerID="f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99" exitCode=0 Jul 15 19:30:40.211654 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:40.211565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerDied","Data":"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99"} Jul 15 19:30:40.211654 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:40.211620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerStarted","Data":"632bf202f1a974dffc281276005143af44d0d774088de6376fb4e84853564391"} Jul 15 19:30:40.215629 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:40.215611 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" Jul 15 19:30:40.227596 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:40.227536 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-tm5k7" podStartSLOduration=1.641845049 podStartE2EDuration="3.227522359s" totalImagesPullingTime="1.58567731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:40.226205716 +0000 UTC m=+121.055612326" watchObservedRunningTime="2026-07-15 19:30:40.227522359 +0000 UTC m=+121.056928968" Jul 15 19:30:41.222619 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:41.222584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerStarted","Data":"a9b197b132934a187bda7e910e0beda382d252cb41ff634ba08906c7a4650d77"} Jul 15 19:30:41.250231 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:41.250191 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.064053849 podStartE2EDuration="7.250177244s" totalImagesPullingTime="4.17146391s" totalInitContainerRuntime="14.659485ms" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:41.248802501 +0000 UTC m=+122.078209123" watchObservedRunningTime="2026-07-15 19:30:41.250177244 +0000 UTC m=+122.079583853" Jul 15 19:30:45.241825 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:45.241787 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerStarted","Data":"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce"} Jul 15 19:30:45.242172 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:45.241896 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerStarted","Data":"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172"} Jul 15 19:30:47.252729 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:47.252691 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerStarted","Data":"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab"} Jul 15 19:30:47.253111 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:47.252757 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerStarted","Data":"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc"} Jul 15 19:30:47.253111 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:47.252791 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerStarted","Data":"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc"} Jul 15 19:30:47.253111 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:47.252819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerStarted","Data":"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c"} Jul 15 19:30:47.282081 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:47.282035 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.205731946 podStartE2EDuration="8.282015434s" totalImagesPullingTime="6.053737498s" totalInitContainerRuntime="22.54599ms" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:47.280074729 +0000 UTC m=+128.109481356" watchObservedRunningTime="2026-07-15 19:30:47.282015434 +0000 UTC m=+128.111422042" Jul 15 19:30:49.498790 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:49.498755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:30:49.501135 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:49.501114 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996e2f7c-c517-41a8-a1f8-16bde57358e2-metrics-certs\") pod \"network-metrics-daemon-6g5mh\" (UID: \"996e2f7c-c517-41a8-a1f8-16bde57358e2\") " pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:30:49.723832 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:49.723801 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:30:49.792185 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:49.792153 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t5v82\"" Jul 15 19:30:49.800558 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:49.800531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6g5mh" Jul 15 19:30:49.932410 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:49.932385 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6g5mh"] Jul 15 19:30:49.934848 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:30:49.934821 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996e2f7c_c517_41a8_a1f8_16bde57358e2.slice/crio-37ed893c5aaa499212b72bfb057c4611331b06e49c3f487bf23af46a71900b66 WatchSource:0}: Error finding container 37ed893c5aaa499212b72bfb057c4611331b06e49c3f487bf23af46a71900b66: Status 404 returned error can't find the container with id 37ed893c5aaa499212b72bfb057c4611331b06e49c3f487bf23af46a71900b66 Jul 15 19:30:50.265199 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:50.265161 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6g5mh" event={"ID":"996e2f7c-c517-41a8-a1f8-16bde57358e2","Type":"ContainerStarted","Data":"37ed893c5aaa499212b72bfb057c4611331b06e49c3f487bf23af46a71900b66"} Jul 15 19:30:52.276894 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:52.276855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6g5mh" event={"ID":"996e2f7c-c517-41a8-a1f8-16bde57358e2","Type":"ContainerStarted","Data":"b0595445d2adf734a78dc5f16f3314229af5d0534edea3d0305e77edbde72d2f"} Jul 15 19:30:52.277330 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:52.276918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6g5mh" event={"ID":"996e2f7c-c517-41a8-a1f8-16bde57358e2","Type":"ContainerStarted","Data":"de189db5ec6aaf8dcaa5bad1cdf84a27d701943362a033d2135cec2b09134091"} Jul 15 19:30:52.297396 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:52.297350 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6g5mh" podStartSLOduration=132.030663209 podStartE2EDuration="2m13.297332639s" totalImagesPullingTime="1.26666943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:52.295784514 +0000 UTC m=+133.125191176" watchObservedRunningTime="2026-07-15 19:30:52.297332639 +0000 UTC m=+133.126739274" Jul 15 19:30:53.282258 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:53.282223 2576 generic.go:356] "Generic (PLEG): container finished" podID="6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831" containerID="88b2c2bbe9df7ede09eee54552cd6b44b5c9c84ee0b11d04ca7532a81feabb11" exitCode=0 Jul 15 19:30:53.282768 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:53.282297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" event={"ID":"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831","Type":"ContainerDied","Data":"88b2c2bbe9df7ede09eee54552cd6b44b5c9c84ee0b11d04ca7532a81feabb11"} Jul 15 19:30:53.282768 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:53.282745 2576 scope.go:117] "RemoveContainer" containerID="88b2c2bbe9df7ede09eee54552cd6b44b5c9c84ee0b11d04ca7532a81feabb11" Jul 15 19:30:54.288688 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:54.288657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t5hbm" event={"ID":"6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831","Type":"ContainerStarted","Data":"c47e8886cd4380cd1c533638de36feaaf1acc4bc1d8d1f4c3d565eab78abe415"} Jul 15 19:30:58.955937 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:30:58.955911 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-457fm_90a7d0ca-fa3f-47cc-a770-fa1151efb4bf/serve-healthcheck-canary/0.log" Jul 15 19:31:39.724063 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:39.723968 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:39.744287 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:39.744261 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:40.483739 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:40.483713 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:53.336032 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.334651 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 19:31:53.336032 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.335516 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="alertmanager" containerID="cri-o://0543c5c3357fe42dd7a4579760112a647b8cb5e5f8f930618aa56ce95bc8ff7e" gracePeriod=120 Jul 15 19:31:53.336032 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.335820 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="config-reloader" containerID="cri-o://028c21fe03e5a0b63ca5fbf4368abd9901049688616353a8e6c445f8e3d7d63c" gracePeriod=120 Jul 15 19:31:53.336032 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.335881 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="prom-label-proxy" containerID="cri-o://a9b197b132934a187bda7e910e0beda382d252cb41ff634ba08906c7a4650d77" gracePeriod=120 Jul 15 19:31:53.336032 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.335819 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy" containerID="cri-o://2c01b265ac88956a769db29e9cd47090cf914e145517554624e7252c5e770816" gracePeriod=120 Jul 15 19:31:53.336032 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.335989 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy-web" containerID="cri-o://82583b5016b67bc31e70028c491a568d3821dcb01cb4c2b617f89661fcabfeae" gracePeriod=120 Jul 15 19:31:53.336032 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.336018 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy-metric" containerID="cri-o://5d4f90261b624b75b40ba5792144ac75058f3aa9dc9b76bd8ea51ee109c8c78e" gracePeriod=120 Jul 15 19:31:53.521972 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.521940 2576 generic.go:356] "Generic (PLEG): container finished" podID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerID="a9b197b132934a187bda7e910e0beda382d252cb41ff634ba08906c7a4650d77" exitCode=0 Jul 15 19:31:53.521972 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.521968 2576 generic.go:356] "Generic (PLEG): container finished" podID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerID="2c01b265ac88956a769db29e9cd47090cf914e145517554624e7252c5e770816" exitCode=0 Jul 15 19:31:53.521972 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.521978 2576 generic.go:356] "Generic (PLEG): container finished" podID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerID="028c21fe03e5a0b63ca5fbf4368abd9901049688616353a8e6c445f8e3d7d63c" exitCode=0 Jul 15 19:31:53.522147 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.521984 2576 generic.go:356] "Generic (PLEG): container finished" podID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerID="0543c5c3357fe42dd7a4579760112a647b8cb5e5f8f930618aa56ce95bc8ff7e" exitCode=0 Jul 15 19:31:53.522147 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.522010 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerDied","Data":"a9b197b132934a187bda7e910e0beda382d252cb41ff634ba08906c7a4650d77"} Jul 15 19:31:53.522147 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.522106 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerDied","Data":"2c01b265ac88956a769db29e9cd47090cf914e145517554624e7252c5e770816"} Jul 15 19:31:53.522147 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.522134 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerDied","Data":"028c21fe03e5a0b63ca5fbf4368abd9901049688616353a8e6c445f8e3d7d63c"} Jul 15 19:31:53.522263 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:53.522157 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerDied","Data":"0543c5c3357fe42dd7a4579760112a647b8cb5e5f8f930618aa56ce95bc8ff7e"} Jul 15 19:31:54.530109 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.530079 2576 generic.go:356] "Generic (PLEG): container finished" podID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerID="5d4f90261b624b75b40ba5792144ac75058f3aa9dc9b76bd8ea51ee109c8c78e" exitCode=0 Jul 15 19:31:54.530109 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.530104 2576 generic.go:356] "Generic (PLEG): container finished" podID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerID="82583b5016b67bc31e70028c491a568d3821dcb01cb4c2b617f89661fcabfeae" exitCode=0 Jul 15 19:31:54.530457 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.530154 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerDied","Data":"5d4f90261b624b75b40ba5792144ac75058f3aa9dc9b76bd8ea51ee109c8c78e"} Jul 15 19:31:54.530457 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.530241 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerDied","Data":"82583b5016b67bc31e70028c491a568d3821dcb01cb4c2b617f89661fcabfeae"} Jul 15 19:31:54.580326 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.580304 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:31:54.661333 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661249 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-main-db\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661333 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661297 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-main-tls\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661333 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661316 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-volume\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661640 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661346 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661640 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661578 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-cluster-tls-config\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661640 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661630 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:31:54.661774 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661636 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-tls-assets\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661774 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661700 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-out\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661774 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661733 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661926 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661790 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-metrics-client-ca\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661926 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661823 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-web-config\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661926 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661847 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-trusted-ca-bundle\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661926 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661879 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-web\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.661926 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.661911 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wm79\" (UniqueName: \"kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-kube-api-access-7wm79\") pod \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\" (UID: \"0ca8aba7-9918-44da-a37e-d2c64129eb2d\") " Jul 15 19:31:54.662375 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.662354 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-main-db\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.663026 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.662972 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:31:54.663137 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.663094 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:31:54.664472 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.664432 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:54.664860 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.664836 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:31:54.665315 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.665245 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:54.665405 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.665345 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-out" (OuterVolumeSpecName: "config-out") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:31:54.665839 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.665808 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-kube-api-access-7wm79" (OuterVolumeSpecName: "kube-api-access-7wm79") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "kube-api-access-7wm79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:31:54.666139 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.665897 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-volume" (OuterVolumeSpecName: "config-volume") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:54.666436 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.666412 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:54.666662 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.666642 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:54.669477 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.669448 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:54.675631 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.675613 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-web-config" (OuterVolumeSpecName: "web-config") pod "0ca8aba7-9918-44da-a37e-d2c64129eb2d" (UID: "0ca8aba7-9918-44da-a37e-d2c64129eb2d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:54.763214 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763186 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-main-tls\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.763214 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763214 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-volume\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.763403 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763230 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.763403 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763243 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-cluster-tls-config\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.763403 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763254 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-tls-assets\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.763403 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763265 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca8aba7-9918-44da-a37e-d2c64129eb2d-config-out\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.763403 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763276 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.763403 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763288 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-metrics-client-ca\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.763403 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763300 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-web-config\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.763403 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763312 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca8aba7-9918-44da-a37e-d2c64129eb2d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.763403 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763324 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca8aba7-9918-44da-a37e-d2c64129eb2d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:54.763403 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:54.763337 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wm79\" (UniqueName: \"kubernetes.io/projected/0ca8aba7-9918-44da-a37e-d2c64129eb2d-kube-api-access-7wm79\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:55.536918 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.536888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca8aba7-9918-44da-a37e-d2c64129eb2d","Type":"ContainerDied","Data":"73fa10566f59200001ea73fb3ea938553c43e2fa732f4117bb4fddf285f4d9ce"} Jul 15 19:31:55.536918 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.536918 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 19:31:55.537335 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.536972 2576 scope.go:117] "RemoveContainer" containerID="a9b197b132934a187bda7e910e0beda382d252cb41ff634ba08906c7a4650d77" Jul 15 19:31:55.544972 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.544953 2576 scope.go:117] "RemoveContainer" containerID="5d4f90261b624b75b40ba5792144ac75058f3aa9dc9b76bd8ea51ee109c8c78e" Jul 15 19:31:55.552393 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.552373 2576 scope.go:117] "RemoveContainer" containerID="2c01b265ac88956a769db29e9cd47090cf914e145517554624e7252c5e770816" Jul 15 19:31:55.560351 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.560016 2576 scope.go:117] "RemoveContainer" containerID="82583b5016b67bc31e70028c491a568d3821dcb01cb4c2b617f89661fcabfeae" Jul 15 19:31:55.560351 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.560040 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 19:31:55.565124 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.565094 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 19:31:55.567695 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.567679 2576 scope.go:117] "RemoveContainer" containerID="028c21fe03e5a0b63ca5fbf4368abd9901049688616353a8e6c445f8e3d7d63c" Jul 15 19:31:55.574691 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.574677 2576 scope.go:117] "RemoveContainer" containerID="0543c5c3357fe42dd7a4579760112a647b8cb5e5f8f930618aa56ce95bc8ff7e" Jul 15 19:31:55.581851 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.581834 2576 scope.go:117] "RemoveContainer" containerID="f31999a13cf45c0e05bcf43ffb6993ef4555a1ba3b5001dcf5789bc8ad0b2df4" Jul 15 19:31:55.670114 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:55.670037 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" path="/var/lib/kubelet/pods/0ca8aba7-9918-44da-a37e-d2c64129eb2d/volumes" Jul 15 19:31:57.670885 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.670853 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 19:31:57.671378 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.671211 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="prometheus" containerID="cri-o://271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172" gracePeriod=600 Jul 15 19:31:57.671378 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.671251 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy-web" containerID="cri-o://0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc" gracePeriod=600 Jul 15 19:31:57.671378 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.671264 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="thanos-sidecar" containerID="cri-o://b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c" gracePeriod=600 Jul 15 19:31:57.671378 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.671260 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="config-reloader" containerID="cri-o://d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce" gracePeriod=600 Jul 15 19:31:57.671378 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.671224 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy-thanos" containerID="cri-o://43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab" gracePeriod=600 Jul 15 19:31:57.671656 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.671270 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy" containerID="cri-o://4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc" gracePeriod=600 Jul 15 19:31:57.910225 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.910197 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:57.991058 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.990977 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-config-out\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991058 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991013 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-metrics-client-certs\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991058 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991032 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-metrics-client-ca\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991058 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991056 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-grpc-tls\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991370 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991073 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-config\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991370 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991098 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991370 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991255 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-1\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991370 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991314 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-0\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991370 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991358 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-tls\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991628 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991385 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-serving-certs-ca-bundle\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991628 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991422 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-thanos-prometheus-http-client-file\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991628 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991469 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-2\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991628 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991506 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-tls-assets\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991628 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991536 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jvpx\" (UniqueName: \"kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-kube-api-access-5jvpx\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991628 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991563 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:31:57.991628 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991612 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.991628 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991616 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:31:57.992007 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991649 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-kube-rbac-proxy\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.992007 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991724 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-db\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.992007 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991866 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-kubelet-serving-ca-bundle\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.992007 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991893 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-web-config\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.992007 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991903 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:31:57.992007 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.991917 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-trusted-ca-bundle\") pod \"ed1fc066-3f60-497f-b389-7672dd603009\" (UID: \"ed1fc066-3f60-497f-b389-7672dd603009\") " Jul 15 19:31:57.992315 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.992166 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:57.992315 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.992186 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-metrics-client-ca\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:57.992315 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.992200 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:57.992645 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.992574 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:31:57.994307 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.993623 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:31:57.994307 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.993931 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:31:57.994307 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.993995 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-config" (OuterVolumeSpecName: "config") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:57.994307 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.994274 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:57.994613 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.994336 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-config-out" (OuterVolumeSpecName: "config-out") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:31:57.994613 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.994569 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:31:57.994751 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.994716 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:57.994847 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.994756 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:57.994894 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.994840 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:31:57.995719 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.995682 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:57.995914 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.995886 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:57.996121 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.996098 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:57.996370 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.996343 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:31:57.996437 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.996397 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-kube-api-access-5jvpx" (OuterVolumeSpecName: "kube-api-access-5jvpx") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "kube-api-access-5jvpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:31:57.996872 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:57.996856 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:58.006101 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.006077 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-web-config" (OuterVolumeSpecName: "web-config") pod "ed1fc066-3f60-497f-b389-7672dd603009" (UID: "ed1fc066-3f60-497f-b389-7672dd603009"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:31:58.093263 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093227 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093263 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093256 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-tls-assets\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093263 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093265 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jvpx\" (UniqueName: \"kubernetes.io/projected/ed1fc066-3f60-497f-b389-7672dd603009-kube-api-access-5jvpx\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093275 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093285 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-kube-rbac-proxy\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093293 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-db\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093301 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093311 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-web-config\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093319 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093327 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed1fc066-3f60-497f-b389-7672dd603009-config-out\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093335 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-metrics-client-certs\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093342 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-grpc-tls\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093350 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-config\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093357 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093365 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed1fc066-3f60-497f-b389-7672dd603009-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093373 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.093476 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.093382 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed1fc066-3f60-497f-b389-7672dd603009-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:31:58.552527 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552493 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed1fc066-3f60-497f-b389-7672dd603009" containerID="43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab" exitCode=0 Jul 15 19:31:58.552527 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552518 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed1fc066-3f60-497f-b389-7672dd603009" containerID="4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc" exitCode=0 Jul 15 19:31:58.552527 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552524 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed1fc066-3f60-497f-b389-7672dd603009" containerID="0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc" exitCode=0 Jul 15 19:31:58.552527 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552530 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed1fc066-3f60-497f-b389-7672dd603009" containerID="b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c" exitCode=0 Jul 15 19:31:58.552527 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552535 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed1fc066-3f60-497f-b389-7672dd603009" containerID="d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce" exitCode=0 Jul 15 19:31:58.552840 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552540 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed1fc066-3f60-497f-b389-7672dd603009" containerID="271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172" exitCode=0 Jul 15 19:31:58.552840 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552591 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.552840 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerDied","Data":"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab"} Jul 15 19:31:58.552840 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552671 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerDied","Data":"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc"} Jul 15 19:31:58.552840 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552714 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerDied","Data":"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc"} Jul 15 19:31:58.552840 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552735 2576 scope.go:117] "RemoveContainer" containerID="43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab" Jul 15 19:31:58.552840 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerDied","Data":"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c"} Jul 15 19:31:58.552840 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552801 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerDied","Data":"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce"} Jul 15 19:31:58.552840 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerDied","Data":"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172"} Jul 15 19:31:58.553183 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.552883 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed1fc066-3f60-497f-b389-7672dd603009","Type":"ContainerDied","Data":"632bf202f1a974dffc281276005143af44d0d774088de6376fb4e84853564391"} Jul 15 19:31:58.560618 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.560600 2576 scope.go:117] "RemoveContainer" containerID="4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc" Jul 15 19:31:58.569688 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.569664 2576 scope.go:117] "RemoveContainer" containerID="0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc" Jul 15 19:31:58.576905 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.576880 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 19:31:58.577396 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.577384 2576 scope.go:117] "RemoveContainer" containerID="b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c" Jul 15 19:31:58.583310 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.583280 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 19:31:58.585166 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.585142 2576 scope.go:117] "RemoveContainer" containerID="d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce" Jul 15 19:31:58.591907 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.591889 2576 scope.go:117] "RemoveContainer" containerID="271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172" Jul 15 19:31:58.599204 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.599188 2576 scope.go:117] "RemoveContainer" containerID="f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99" Jul 15 19:31:58.605477 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605452 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 19:31:58.605802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605782 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="prom-label-proxy" Jul 15 19:31:58.605802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605802 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="prom-label-proxy" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605809 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy-web" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605815 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy-web" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605822 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy-thanos" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605827 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy-thanos" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605835 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="thanos-sidecar" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605840 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="thanos-sidecar" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605847 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="init-config-reloader" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605852 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="init-config-reloader" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605859 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605864 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605874 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="init-config-reloader" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605878 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="init-config-reloader" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605885 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy-metric" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605889 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy-metric" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605896 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy-web" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605901 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy-web" Jul 15 19:31:58.605901 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605907 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="config-reloader" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605912 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="config-reloader" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605918 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="alertmanager" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605923 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="alertmanager" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605928 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605933 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605938 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="config-reloader" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605943 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="config-reloader" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605949 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="prometheus" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605953 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="prometheus" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605991 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="prometheus" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.605997 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy-web" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606004 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="thanos-sidecar" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606009 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="alertmanager" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606016 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606020 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="config-reloader" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606025 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606031 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy-web" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606036 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="prom-label-proxy" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606040 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1fc066-3f60-497f-b389-7672dd603009" containerName="kube-rbac-proxy-thanos" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606045 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="config-reloader" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606050 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca8aba7-9918-44da-a37e-d2c64129eb2d" containerName="kube-rbac-proxy-metric" Jul 15 19:31:58.606456 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606191 2576 scope.go:117] "RemoveContainer" containerID="43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab" Jul 15 19:31:58.607198 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:31:58.606472 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": container with ID starting with 43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab not found: ID does not exist" containerID="43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab" Jul 15 19:31:58.607198 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606506 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab"} err="failed to get container status \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": rpc error: code = NotFound desc = could not find container \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": container with ID starting with 43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab not found: ID does not exist" Jul 15 19:31:58.607198 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606563 2576 scope.go:117] "RemoveContainer" containerID="4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc" Jul 15 19:31:58.607198 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:31:58.606848 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": container with ID starting with 4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc not found: ID does not exist" containerID="4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc" Jul 15 19:31:58.607198 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606883 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc"} err="failed to get container status \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": rpc error: code = NotFound desc = could not find container \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": container with ID starting with 4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc not found: ID does not exist" Jul 15 19:31:58.607198 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.606904 2576 scope.go:117] "RemoveContainer" containerID="0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc" Jul 15 19:31:58.607198 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:31:58.607157 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": container with ID starting with 0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc not found: ID does not exist" containerID="0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc" Jul 15 19:31:58.607198 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.607191 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc"} err="failed to get container status \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": rpc error: code = NotFound desc = could not find container \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": container with ID starting with 0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc not found: ID does not exist" Jul 15 19:31:58.607488 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.607209 2576 scope.go:117] "RemoveContainer" containerID="b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c" Jul 15 19:31:58.607488 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:31:58.607446 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": container with ID starting with b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c not found: ID does not exist" containerID="b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c" Jul 15 19:31:58.607488 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.607467 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c"} err="failed to get container status \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": rpc error: code = NotFound desc = could not find container \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": container with ID starting with b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c not found: ID does not exist" Jul 15 19:31:58.607488 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.607483 2576 scope.go:117] "RemoveContainer" containerID="d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce" Jul 15 19:31:58.607728 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:31:58.607711 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": container with ID starting with d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce not found: ID does not exist" containerID="d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce" Jul 15 19:31:58.607769 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.607732 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce"} err="failed to get container status \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": rpc error: code = NotFound desc = could not find container \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": container with ID starting with d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce not found: ID does not exist" Jul 15 19:31:58.607769 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.607747 2576 scope.go:117] "RemoveContainer" containerID="271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172" Jul 15 19:31:58.607982 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:31:58.607963 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": container with ID starting with 271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172 not found: ID does not exist" containerID="271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172" Jul 15 19:31:58.608033 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.607986 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172"} err="failed to get container status \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": rpc error: code = NotFound desc = could not find container \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": container with ID starting with 271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172 not found: ID does not exist" Jul 15 19:31:58.608033 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.607998 2576 scope.go:117] "RemoveContainer" containerID="f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99" Jul 15 19:31:58.608218 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:31:58.608202 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": container with ID starting with f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99 not found: ID does not exist" containerID="f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99" Jul 15 19:31:58.608270 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.608221 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99"} err="failed to get container status \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": rpc error: code = NotFound desc = could not find container \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": container with ID starting with f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99 not found: ID does not exist" Jul 15 19:31:58.608270 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.608236 2576 scope.go:117] "RemoveContainer" containerID="43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab" Jul 15 19:31:58.608495 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.608476 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab"} err="failed to get container status \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": rpc error: code = NotFound desc = could not find container \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": container with ID starting with 43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab not found: ID does not exist" Jul 15 19:31:58.608559 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.608495 2576 scope.go:117] "RemoveContainer" containerID="4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc" Jul 15 19:31:58.608707 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.608687 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc"} err="failed to get container status \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": rpc error: code = NotFound desc = could not find container \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": container with ID starting with 4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc not found: ID does not exist" Jul 15 19:31:58.608756 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.608710 2576 scope.go:117] "RemoveContainer" containerID="0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc" Jul 15 19:31:58.608929 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.608902 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc"} err="failed to get container status \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": rpc error: code = NotFound desc = could not find container \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": container with ID starting with 0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc not found: ID does not exist" Jul 15 19:31:58.608929 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.608929 2576 scope.go:117] "RemoveContainer" containerID="b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c" Jul 15 19:31:58.609148 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.609132 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c"} err="failed to get container status \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": rpc error: code = NotFound desc = could not find container \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": container with ID starting with b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c not found: ID does not exist" Jul 15 19:31:58.609148 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.609148 2576 scope.go:117] "RemoveContainer" containerID="d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce" Jul 15 19:31:58.609347 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.609330 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce"} err="failed to get container status \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": rpc error: code = NotFound desc = could not find container \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": container with ID starting with d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce not found: ID does not exist" Jul 15 19:31:58.609409 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.609347 2576 scope.go:117] "RemoveContainer" containerID="271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172" Jul 15 19:31:58.609588 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.609567 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172"} err="failed to get container status \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": rpc error: code = NotFound desc = could not find container \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": container with ID starting with 271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172 not found: ID does not exist" Jul 15 19:31:58.609634 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.609588 2576 scope.go:117] "RemoveContainer" containerID="f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99" Jul 15 19:31:58.609785 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.609770 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99"} err="failed to get container status \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": rpc error: code = NotFound desc = could not find container \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": container with ID starting with f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99 not found: ID does not exist" Jul 15 19:31:58.609785 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.609785 2576 scope.go:117] "RemoveContainer" containerID="43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab" Jul 15 19:31:58.610028 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.610009 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab"} err="failed to get container status \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": rpc error: code = NotFound desc = could not find container \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": container with ID starting with 43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab not found: ID does not exist" Jul 15 19:31:58.610102 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.610031 2576 scope.go:117] "RemoveContainer" containerID="4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc" Jul 15 19:31:58.610291 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.610275 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc"} err="failed to get container status \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": rpc error: code = NotFound desc = could not find container \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": container with ID starting with 4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc not found: ID does not exist" Jul 15 19:31:58.610339 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.610293 2576 scope.go:117] "RemoveContainer" containerID="0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc" Jul 15 19:31:58.610515 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.610500 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc"} err="failed to get container status \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": rpc error: code = NotFound desc = could not find container \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": container with ID starting with 0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc not found: ID does not exist" Jul 15 19:31:58.610606 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.610515 2576 scope.go:117] "RemoveContainer" containerID="b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c" Jul 15 19:31:58.610721 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.610703 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c"} err="failed to get container status \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": rpc error: code = NotFound desc = could not find container \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": container with ID starting with b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c not found: ID does not exist" Jul 15 19:31:58.610785 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.610723 2576 scope.go:117] "RemoveContainer" containerID="d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce" Jul 15 19:31:58.611006 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.610988 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce"} err="failed to get container status \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": rpc error: code = NotFound desc = could not find container \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": container with ID starting with d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce not found: ID does not exist" Jul 15 19:31:58.611075 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.611007 2576 scope.go:117] "RemoveContainer" containerID="271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172" Jul 15 19:31:58.611242 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.611226 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172"} err="failed to get container status \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": rpc error: code = NotFound desc = could not find container \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": container with ID starting with 271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172 not found: ID does not exist" Jul 15 19:31:58.611309 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.611244 2576 scope.go:117] "RemoveContainer" containerID="f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99" Jul 15 19:31:58.611482 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.611468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.611568 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.611469 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99"} err="failed to get container status \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": rpc error: code = NotFound desc = could not find container \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": container with ID starting with f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99 not found: ID does not exist" Jul 15 19:31:58.611627 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.611569 2576 scope.go:117] "RemoveContainer" containerID="43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab" Jul 15 19:31:58.612058 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.612036 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab"} err="failed to get container status \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": rpc error: code = NotFound desc = could not find container \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": container with ID starting with 43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab not found: ID does not exist" Jul 15 19:31:58.612058 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.612058 2576 scope.go:117] "RemoveContainer" containerID="4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc" Jul 15 19:31:58.612289 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.612270 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc"} err="failed to get container status \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": rpc error: code = NotFound desc = could not find container \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": container with ID starting with 4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc not found: ID does not exist" Jul 15 19:31:58.612289 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.612291 2576 scope.go:117] "RemoveContainer" containerID="0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc" Jul 15 19:31:58.612529 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.612509 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc"} err="failed to get container status \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": rpc error: code = NotFound desc = could not find container \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": container with ID starting with 0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc not found: ID does not exist" Jul 15 19:31:58.612628 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.612532 2576 scope.go:117] "RemoveContainer" containerID="b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c" Jul 15 19:31:58.612808 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.612791 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c"} err="failed to get container status \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": rpc error: code = NotFound desc = could not find container \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": container with ID starting with b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c not found: ID does not exist" Jul 15 19:31:58.612879 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.612810 2576 scope.go:117] "RemoveContainer" containerID="d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce" Jul 15 19:31:58.613044 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.613028 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce"} err="failed to get container status \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": rpc error: code = NotFound desc = could not find container \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": container with ID starting with d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce not found: ID does not exist" Jul 15 19:31:58.613092 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.613045 2576 scope.go:117] "RemoveContainer" containerID="271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172" Jul 15 19:31:58.613261 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.613241 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172"} err="failed to get container status \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": rpc error: code = NotFound desc = could not find container \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": container with ID starting with 271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172 not found: ID does not exist" Jul 15 19:31:58.613325 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.613262 2576 scope.go:117] "RemoveContainer" containerID="f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99" Jul 15 19:31:58.613488 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.613471 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99"} err="failed to get container status \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": rpc error: code = NotFound desc = could not find container \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": container with ID starting with f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99 not found: ID does not exist" Jul 15 19:31:58.613533 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.613490 2576 scope.go:117] "RemoveContainer" containerID="43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab" Jul 15 19:31:58.613698 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.613681 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab"} err="failed to get container status \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": rpc error: code = NotFound desc = could not find container \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": container with ID starting with 43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab not found: ID does not exist" Jul 15 19:31:58.613698 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.613698 2576 scope.go:117] "RemoveContainer" containerID="4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc" Jul 15 19:31:58.613922 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.613907 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc"} err="failed to get container status \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": rpc error: code = NotFound desc = could not find container \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": container with ID starting with 4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc not found: ID does not exist" Jul 15 19:31:58.613922 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.613921 2576 scope.go:117] "RemoveContainer" containerID="0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc" Jul 15 19:31:58.614113 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.614097 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc"} err="failed to get container status \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": rpc error: code = NotFound desc = could not find container \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": container with ID starting with 0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc not found: ID does not exist" Jul 15 19:31:58.614154 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.614113 2576 scope.go:117] "RemoveContainer" containerID="b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c" Jul 15 19:31:58.614303 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.614285 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c"} err="failed to get container status \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": rpc error: code = NotFound desc = could not find container \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": container with ID starting with b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c not found: ID does not exist" Jul 15 19:31:58.614385 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.614304 2576 scope.go:117] "RemoveContainer" containerID="d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce" Jul 15 19:31:58.614510 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.614486 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce"} err="failed to get container status \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": rpc error: code = NotFound desc = could not find container \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": container with ID starting with d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce not found: ID does not exist" Jul 15 19:31:58.614510 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.614512 2576 scope.go:117] "RemoveContainer" containerID="271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172" Jul 15 19:31:58.614758 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.614739 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172"} err="failed to get container status \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": rpc error: code = NotFound desc = could not find container \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": container with ID starting with 271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172 not found: ID does not exist" Jul 15 19:31:58.614818 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.614759 2576 scope.go:117] "RemoveContainer" containerID="f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99" Jul 15 19:31:58.615023 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.614999 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99"} err="failed to get container status \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": rpc error: code = NotFound desc = could not find container \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": container with ID starting with f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99 not found: ID does not exist" Jul 15 19:31:58.615023 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615023 2576 scope.go:117] "RemoveContainer" containerID="43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab" Jul 15 19:31:58.615209 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615064 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 19:31:58.615209 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615120 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 19:31:58.615209 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615064 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 19:31:58.615209 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615064 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 19:31:58.615396 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615380 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 19:31:58.615455 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615445 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 19:31:58.615509 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615490 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9nvbl\"" Jul 15 19:31:58.615509 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615491 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2rpc621buo8hn\"" Jul 15 19:31:58.615670 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615566 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 19:31:58.615670 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615622 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 19:31:58.615741 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615692 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab"} err="failed to get container status \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": rpc error: code = NotFound desc = could not find container \"43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab\": container with ID starting with 43d45f6325df5163423ca2e2d1a0e9d6406661da519474279028f1ace710bbab not found: ID does not exist" Jul 15 19:31:58.615741 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615716 2576 scope.go:117] "RemoveContainer" containerID="4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc" Jul 15 19:31:58.615870 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615856 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 19:31:58.615916 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615898 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 19:31:58.615960 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.615858 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 19:31:58.616180 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.616159 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc"} err="failed to get container status \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": rpc error: code = NotFound desc = could not find container \"4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc\": container with ID starting with 4f5540cd23d34c0159d4cf3f42f01e41c97ea2566d17625b2ceb77ef89337cdc not found: ID does not exist" Jul 15 19:31:58.616180 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.616180 2576 scope.go:117] "RemoveContainer" containerID="0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc" Jul 15 19:31:58.616447 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.616427 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc"} err="failed to get container status \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": rpc error: code = NotFound desc = could not find container \"0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc\": container with ID starting with 0bf22e06821d9b2ddf4d08f3ecf223fda3a49deedefd57ad2c0e1a3f832358cc not found: ID does not exist" Jul 15 19:31:58.616518 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.616448 2576 scope.go:117] "RemoveContainer" containerID="b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c" Jul 15 19:31:58.616754 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.616728 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c"} err="failed to get container status \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": rpc error: code = NotFound desc = could not find container \"b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c\": container with ID starting with b8fea401d789ba623f87289d565864fe467ecd09e557d5e03da6d69ff6b2d06c not found: ID does not exist" Jul 15 19:31:58.616854 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.616763 2576 scope.go:117] "RemoveContainer" containerID="d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce" Jul 15 19:31:58.616854 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.616770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 19:31:58.617051 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.617034 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 19:31:58.617142 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.617049 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce"} err="failed to get container status \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": rpc error: code = NotFound desc = could not find container \"d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce\": container with ID starting with d697e777c8969b5d828c4c400aba542d918a87ce97944c2bc7c875fb3c22c4ce not found: ID does not exist" Jul 15 19:31:58.617142 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.617073 2576 scope.go:117] "RemoveContainer" containerID="271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172" Jul 15 19:31:58.617342 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.617316 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172"} err="failed to get container status \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": rpc error: code = NotFound desc = could not find container \"271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172\": container with ID starting with 271a032a19be4a005949116f173f14dfd043e217662ea123354339f30b168172 not found: ID does not exist" Jul 15 19:31:58.617342 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.617341 2576 scope.go:117] "RemoveContainer" containerID="f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99" Jul 15 19:31:58.617637 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.617617 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99"} err="failed to get container status \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": rpc error: code = NotFound desc = could not find container \"f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99\": container with ID starting with f1479cb87fdf7616d2f831e74f29c310c6c8e05e6ee32dba0f398a1962d27c99 not found: ID does not exist" Jul 15 19:31:58.618874 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.618837 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 19:31:58.621379 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.621360 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 19:31:58.625417 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.625397 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 19:31:58.698827 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.698800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699121 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.698834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-web-config\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699121 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.698856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699121 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.698922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da817844-fb85-4993-b4c6-f47f8427b526-config-out\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699121 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.698954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699121 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.698989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699121 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699121 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-config\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699121 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da817844-fb85-4993-b4c6-f47f8427b526-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699121 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699400 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699400 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699400 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699400 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699400 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699400 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699400 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cwj4\" (UniqueName: \"kubernetes.io/projected/da817844-fb85-4993-b4c6-f47f8427b526-kube-api-access-6cwj4\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699400 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699400 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.699400 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.699378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.800795 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.800757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.800990 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.800805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.800990 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.800828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-web-config\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.800990 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.800851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.800990 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.800872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da817844-fb85-4993-b4c6-f47f8427b526-config-out\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.800990 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.800891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.800990 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.800921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.800990 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.800942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.800990 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.800967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-config\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.800990 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.800991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da817844-fb85-4993-b4c6-f47f8427b526-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.801433 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.801020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.801433 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.801045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.801433 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.801075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.801433 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.801105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.801433 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.801136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.801433 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.801171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.801433 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.801194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.801433 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.801218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cwj4\" (UniqueName: \"kubernetes.io/projected/da817844-fb85-4993-b4c6-f47f8427b526-kube-api-access-6cwj4\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.801433 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.801246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.801433 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.801273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.802128 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.802030 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.802719 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.802656 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.802940 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.802918 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.804077 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.804052 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.804177 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.804109 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.804270 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.804250 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.804717 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.804644 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da817844-fb85-4993-b4c6-f47f8427b526-config-out\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.805846 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.804798 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.805846 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.805174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.805846 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.805302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-web-config\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.805846 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.805397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.805846 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.805651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.806218 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.806108 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.806218 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.806208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.806893 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.806856 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.806992 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.806897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-config\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.807242 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.807219 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da817844-fb85-4993-b4c6-f47f8427b526-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.807513 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.807493 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da817844-fb85-4993-b4c6-f47f8427b526-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.808258 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.808240 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da817844-fb85-4993-b4c6-f47f8427b526-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.813687 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.813669 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cwj4\" (UniqueName: \"kubernetes.io/projected/da817844-fb85-4993-b4c6-f47f8427b526-kube-api-access-6cwj4\") pod \"prometheus-k8s-0\" (UID: \"da817844-fb85-4993-b4c6-f47f8427b526\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:58.921924 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:58.921885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:31:59.069313 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:59.069206 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 19:31:59.073072 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:31:59.073042 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda817844_fb85_4993_b4c6_f47f8427b526.slice/crio-d12c614c283e0ca1d15ac9ea01f2710dd0dfc9e7ac0d0879b26c8e14e684acf5 WatchSource:0}: Error finding container d12c614c283e0ca1d15ac9ea01f2710dd0dfc9e7ac0d0879b26c8e14e684acf5: Status 404 returned error can't find the container with id d12c614c283e0ca1d15ac9ea01f2710dd0dfc9e7ac0d0879b26c8e14e684acf5 Jul 15 19:31:59.559232 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:59.559199 2576 generic.go:356] "Generic (PLEG): container finished" podID="da817844-fb85-4993-b4c6-f47f8427b526" containerID="4a89ab18f598d15a9325f905f83783c3775e365e800a782698b2190ba98f09f2" exitCode=0 Jul 15 19:31:59.559395 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:59.559240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da817844-fb85-4993-b4c6-f47f8427b526","Type":"ContainerDied","Data":"4a89ab18f598d15a9325f905f83783c3775e365e800a782698b2190ba98f09f2"} Jul 15 19:31:59.559395 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:59.559289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da817844-fb85-4993-b4c6-f47f8427b526","Type":"ContainerStarted","Data":"d12c614c283e0ca1d15ac9ea01f2710dd0dfc9e7ac0d0879b26c8e14e684acf5"} Jul 15 19:31:59.672006 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:31:59.671974 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed1fc066-3f60-497f-b389-7672dd603009" path="/var/lib/kubelet/pods/ed1fc066-3f60-497f-b389-7672dd603009/volumes" Jul 15 19:32:00.566970 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:32:00.566930 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da817844-fb85-4993-b4c6-f47f8427b526","Type":"ContainerStarted","Data":"f2543826a46e4954e72ea989e485f901bc60b4c102f7c8f457aa7f4a010f8e04"} Jul 15 19:32:00.567390 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:32:00.567235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da817844-fb85-4993-b4c6-f47f8427b526","Type":"ContainerStarted","Data":"4013bc5dc6f6ad6054cb9b7b70cd1a4531103c120eb58f4420c525a8a6c8ce33"} Jul 15 19:32:00.567513 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:32:00.567494 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da817844-fb85-4993-b4c6-f47f8427b526","Type":"ContainerStarted","Data":"266ea4e9e50d4349f569753e5c225b3d7252efd050d494a7a417c61cfe756be1"} Jul 15 19:32:00.567660 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:32:00.567639 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da817844-fb85-4993-b4c6-f47f8427b526","Type":"ContainerStarted","Data":"4a0d9160882c79d153bccd3c3e9f6f2739bf117b97570487f45c3795321870c9"} Jul 15 19:32:00.567723 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:32:00.567712 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da817844-fb85-4993-b4c6-f47f8427b526","Type":"ContainerStarted","Data":"a1a0df21ff409dda262df9fdddd593272845f5eb876dda2dd807ed8e6da48282"} Jul 15 19:32:00.567781 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:32:00.567770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da817844-fb85-4993-b4c6-f47f8427b526","Type":"ContainerStarted","Data":"0a96abb34da63196558cbcd89358c9728002a30d170a9fc1a059c68c812d760a"} Jul 15 19:32:00.595210 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:32:00.595151 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.575641202 podStartE2EDuration="2.595135944s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.494742ms" isStatefulPod=false podCreationTimestamp="2026-07-15 19:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:32:00.593580524 +0000 UTC m=+201.422987163" watchObservedRunningTime="2026-07-15 19:32:00.595135944 +0000 UTC m=+201.424542553" Jul 15 19:32:03.922643 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:32:03.922607 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:32:58.922082 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:32:58.922045 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:32:58.938010 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:32:58.937983 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:32:59.816714 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:32:59.816684 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 19:33:39.563355 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:33:39.563322 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 19:35:01.705630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.705534 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp"] Jul 15 19:35:01.708966 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.708945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.714060 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.714035 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 19:35:01.714210 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.714046 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 19:35:01.714210 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.714083 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 19:35:01.714210 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.714190 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 19:35:01.714210 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.714204 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w5j8n\"" Jul 15 19:35:01.723869 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.723848 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp"] Jul 15 19:35:01.807763 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.807736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/607e80ad-00a7-4366-984b-5cbed905278d-manifests\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.807930 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.807766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/607e80ad-00a7-4366-984b-5cbed905278d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.807930 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.807803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/607e80ad-00a7-4366-984b-5cbed905278d-tmp\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.807930 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.807823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbp8j\" (UniqueName: \"kubernetes.io/projected/607e80ad-00a7-4366-984b-5cbed905278d-kube-api-access-lbp8j\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.807930 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.807863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/607e80ad-00a7-4366-984b-5cbed905278d-webhook-cert\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.909208 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.909177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/607e80ad-00a7-4366-984b-5cbed905278d-tmp\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.909208 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.909209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbp8j\" (UniqueName: \"kubernetes.io/projected/607e80ad-00a7-4366-984b-5cbed905278d-kube-api-access-lbp8j\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.909398 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.909235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/607e80ad-00a7-4366-984b-5cbed905278d-webhook-cert\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.909398 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.909286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/607e80ad-00a7-4366-984b-5cbed905278d-manifests\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.909398 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.909308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/607e80ad-00a7-4366-984b-5cbed905278d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.909730 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.909692 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/607e80ad-00a7-4366-984b-5cbed905278d-manifests\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.911575 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.911519 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/607e80ad-00a7-4366-984b-5cbed905278d-tmp\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.911780 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.911762 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/607e80ad-00a7-4366-984b-5cbed905278d-webhook-cert\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.911871 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.911851 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/607e80ad-00a7-4366-984b-5cbed905278d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:01.925812 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:01.925791 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbp8j\" (UniqueName: \"kubernetes.io/projected/607e80ad-00a7-4366-984b-5cbed905278d-kube-api-access-lbp8j\") pod \"opendatahub-operator-controller-manager-58dd997468-zwmkp\" (UID: \"607e80ad-00a7-4366-984b-5cbed905278d\") " pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:02.019847 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:02.019809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:02.161006 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:02.160982 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp"] Jul 15 19:35:02.163446 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:35:02.163424 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607e80ad_00a7_4366_984b_5cbed905278d.slice/crio-29bce61d399bf9560086211b32320a6c37a787415f4352f1168611e4ba7cf246 WatchSource:0}: Error finding container 29bce61d399bf9560086211b32320a6c37a787415f4352f1168611e4ba7cf246: Status 404 returned error can't find the container with id 29bce61d399bf9560086211b32320a6c37a787415f4352f1168611e4ba7cf246 Jul 15 19:35:02.165145 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:02.165127 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 19:35:02.213269 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:02.213242 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" event={"ID":"607e80ad-00a7-4366-984b-5cbed905278d","Type":"ContainerStarted","Data":"29bce61d399bf9560086211b32320a6c37a787415f4352f1168611e4ba7cf246"} Jul 15 19:35:06.233043 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:06.232963 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" event={"ID":"607e80ad-00a7-4366-984b-5cbed905278d","Type":"ContainerStarted","Data":"4b22001f734a7aa6642ff1708f17d257477c1be9a1788f80e38eae3b4b342b39"} Jul 15 19:35:07.238500 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:07.238462 2576 generic.go:356] "Generic (PLEG): container finished" podID="607e80ad-00a7-4366-984b-5cbed905278d" containerID="4b22001f734a7aa6642ff1708f17d257477c1be9a1788f80e38eae3b4b342b39" exitCode=0 Jul 15 19:35:07.238937 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:07.238540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" event={"ID":"607e80ad-00a7-4366-984b-5cbed905278d","Type":"ContainerDied","Data":"4b22001f734a7aa6642ff1708f17d257477c1be9a1788f80e38eae3b4b342b39"} Jul 15 19:35:08.244373 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:08.244328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" event={"ID":"607e80ad-00a7-4366-984b-5cbed905278d","Type":"ContainerStarted","Data":"c56300bb0c0906d297e1f5c76ba22324134b03c90962abc6bac68c1cec294377"} Jul 15 19:35:08.244786 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:08.244465 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:08.269102 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:08.269047 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" podStartSLOduration=2.081144722 podStartE2EDuration="7.269031868s" totalImagesPullingTime="4.102257601s" totalInitContainerRuntime="1.085629545s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:35:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:35:08.267502982 +0000 UTC m=+389.096909585" watchObservedRunningTime="2026-07-15 19:35:08.269031868 +0000 UTC m=+389.098438477" Jul 15 19:35:19.250136 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:19.250107 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58dd997468-zwmkp" Jul 15 19:35:21.988410 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:21.988378 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6"] Jul 15 19:35:21.997515 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:21.997488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.001100 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.001067 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6"] Jul 15 19:35:22.002240 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.002074 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 19:35:22.002240 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.002120 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 19:35:22.002240 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.002074 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 19:35:22.002240 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.002092 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xwxjr\"" Jul 15 19:35:22.002583 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.002536 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 19:35:22.003188 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.002860 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 19:35:22.079472 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.079440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-manager-config\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.079661 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.079519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bnvs\" (UniqueName: \"kubernetes.io/projected/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-kube-api-access-5bnvs\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.079661 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.079572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-cert\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.079661 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.079596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-metrics-cert\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.180814 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.180779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bnvs\" (UniqueName: \"kubernetes.io/projected/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-kube-api-access-5bnvs\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.180814 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.180819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-cert\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.181073 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.180838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-metrics-cert\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.181073 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.180867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-manager-config\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.181588 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.181500 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-manager-config\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.183373 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.183346 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-metrics-cert\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.183477 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.183399 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-cert\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.190126 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.190104 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bnvs\" (UniqueName: \"kubernetes.io/projected/ab84315e-9ee2-4024-9c10-5f8fe63a05a8-kube-api-access-5bnvs\") pod \"lws-controller-manager-7784c86d4c-zrkr6\" (UID: \"ab84315e-9ee2-4024-9c10-5f8fe63a05a8\") " pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.309558 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.309504 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:22.448528 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:22.448496 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6"] Jul 15 19:35:22.451953 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:35:22.451912 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab84315e_9ee2_4024_9c10_5f8fe63a05a8.slice/crio-6a1f0aedc6d954f2384cbd6dc11c1e5c005edbfe90ffe14de5b069360eda2dac WatchSource:0}: Error finding container 6a1f0aedc6d954f2384cbd6dc11c1e5c005edbfe90ffe14de5b069360eda2dac: Status 404 returned error can't find the container with id 6a1f0aedc6d954f2384cbd6dc11c1e5c005edbfe90ffe14de5b069360eda2dac Jul 15 19:35:23.303516 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:23.303476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" event={"ID":"ab84315e-9ee2-4024-9c10-5f8fe63a05a8","Type":"ContainerStarted","Data":"6a1f0aedc6d954f2384cbd6dc11c1e5c005edbfe90ffe14de5b069360eda2dac"} Jul 15 19:35:25.314079 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:25.314044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" event={"ID":"ab84315e-9ee2-4024-9c10-5f8fe63a05a8","Type":"ContainerStarted","Data":"2d0d14eecc49bd1b14c75df38674f1ec62bd1398d9b91caae91334645589d598"} Jul 15 19:35:25.314519 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:25.314164 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:35:25.330421 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:25.330377 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" podStartSLOduration=1.597808165 podStartE2EDuration="4.330362276s" totalImagesPullingTime="2.732554111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:35:25.328781765 +0000 UTC m=+406.158188386" watchObservedRunningTime="2026-07-15 19:35:25.330362276 +0000 UTC m=+406.159768884" Jul 15 19:35:30.699301 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.699267 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl"] Jul 15 19:35:30.702701 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.702685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.705893 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.705872 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 19:35:30.706037 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.706020 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 19:35:30.706382 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.706364 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 19:35:30.706563 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.706526 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 19:35:30.706681 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.706572 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 19:35:30.706681 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.706588 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 19:35:30.706801 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.706723 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pbpdz\"" Jul 15 19:35:30.715624 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.715605 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl"] Jul 15 19:35:30.865764 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.865733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.865922 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.865777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.865922 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.865840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-599pp\" (UniqueName: \"kubernetes.io/projected/a33c32bb-6dd8-4d7c-abda-7be639b69cce-kube-api-access-599pp\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.865922 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.865889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.866019 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.865939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a33c32bb-6dd8-4d7c-abda-7be639b69cce-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.866019 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.865962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.866019 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.865996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33c32bb-6dd8-4d7c-abda-7be639b69cce-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.966592 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.966488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33c32bb-6dd8-4d7c-abda-7be639b69cce-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.966592 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.966529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.966810 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.966595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.966810 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.966632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-599pp\" (UniqueName: \"kubernetes.io/projected/a33c32bb-6dd8-4d7c-abda-7be639b69cce-kube-api-access-599pp\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.966810 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.966662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.966810 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.966711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a33c32bb-6dd8-4d7c-abda-7be639b69cce-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.966810 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.966733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.967249 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.967155 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.968894 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.968867 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33c32bb-6dd8-4d7c-abda-7be639b69cce-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.969086 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.969067 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.969150 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.969087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a33c32bb-6dd8-4d7c-abda-7be639b69cce-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.969196 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.969175 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.976276 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.976250 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-599pp\" (UniqueName: \"kubernetes.io/projected/a33c32bb-6dd8-4d7c-abda-7be639b69cce-kube-api-access-599pp\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:30.976622 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:30.976602 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33c32bb-6dd8-4d7c-abda-7be639b69cce-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-977sl\" (UID: \"a33c32bb-6dd8-4d7c-abda-7be639b69cce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:31.011762 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:31.011737 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:31.151779 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:31.151754 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl"] Jul 15 19:35:31.154186 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:35:31.154164 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda33c32bb_6dd8_4d7c_abda_7be639b69cce.slice/crio-19484fb79f42af7a7a58c18c0f81a5fdb06c71eab6eecdfd304bc00d7e2807a5 WatchSource:0}: Error finding container 19484fb79f42af7a7a58c18c0f81a5fdb06c71eab6eecdfd304bc00d7e2807a5: Status 404 returned error can't find the container with id 19484fb79f42af7a7a58c18c0f81a5fdb06c71eab6eecdfd304bc00d7e2807a5 Jul 15 19:35:31.339927 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:31.339889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" event={"ID":"a33c32bb-6dd8-4d7c-abda-7be639b69cce","Type":"ContainerStarted","Data":"19484fb79f42af7a7a58c18c0f81a5fdb06c71eab6eecdfd304bc00d7e2807a5"} Jul 15 19:35:33.649906 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:33.649866 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 15 19:35:33.650303 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:33.649949 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 15 19:35:34.358500 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:34.358465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" event={"ID":"a33c32bb-6dd8-4d7c-abda-7be639b69cce","Type":"ContainerStarted","Data":"cb085a0d0608fa3586eb024f5672995c1e57321447f5bc60d4dc06f9515e1774"} Jul 15 19:35:34.358704 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:34.358624 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:34.360081 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:34.360054 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-977sl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 19:35:34.360188 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:34.360121 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" podUID="a33c32bb-6dd8-4d7c-abda-7be639b69cce" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 19:35:34.406270 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:34.406224 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" podStartSLOduration=1.9125574840000001 podStartE2EDuration="4.406209657s" totalImagesPullingTime="2.493652173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:35:34.404071033 +0000 UTC m=+415.233477643" watchObservedRunningTime="2026-07-15 19:35:34.406209657 +0000 UTC m=+415.235616265" Jul 15 19:35:35.362781 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:35.362754 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-977sl" Jul 15 19:35:36.319855 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:35:36.319823 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7784c86d4c-zrkr6" Jul 15 19:37:08.383492 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:08.383457 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h724t"] Jul 15 19:37:08.385748 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:08.385725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h724t" Jul 15 19:37:08.388480 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:08.388458 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 19:37:08.388630 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:08.388539 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 19:37:08.389709 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:08.389691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jr89n\"" Jul 15 19:37:08.395371 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:08.395349 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h724t"] Jul 15 19:37:08.487950 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:08.487907 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qss76\" (UniqueName: \"kubernetes.io/projected/9273323b-d26e-4d3d-a9b3-a5c54c3c41eb-kube-api-access-qss76\") pod \"authorino-operator-75cc8d5cb7-h724t\" (UID: \"9273323b-d26e-4d3d-a9b3-a5c54c3c41eb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h724t" Jul 15 19:37:08.588591 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:08.588524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qss76\" (UniqueName: \"kubernetes.io/projected/9273323b-d26e-4d3d-a9b3-a5c54c3c41eb-kube-api-access-qss76\") pod \"authorino-operator-75cc8d5cb7-h724t\" (UID: \"9273323b-d26e-4d3d-a9b3-a5c54c3c41eb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h724t" Jul 15 19:37:08.596514 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:08.596489 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qss76\" (UniqueName: \"kubernetes.io/projected/9273323b-d26e-4d3d-a9b3-a5c54c3c41eb-kube-api-access-qss76\") pod \"authorino-operator-75cc8d5cb7-h724t\" (UID: \"9273323b-d26e-4d3d-a9b3-a5c54c3c41eb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h724t" Jul 15 19:37:08.698850 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:08.698750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h724t" Jul 15 19:37:08.830776 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:08.830686 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h724t"] Jul 15 19:37:08.833556 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:37:08.833517 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9273323b_d26e_4d3d_a9b3_a5c54c3c41eb.slice/crio-db811ad27ce94b36ee1c820ccadd8696b50480370f6417571bed53419e4bf85d WatchSource:0}: Error finding container db811ad27ce94b36ee1c820ccadd8696b50480370f6417571bed53419e4bf85d: Status 404 returned error can't find the container with id db811ad27ce94b36ee1c820ccadd8696b50480370f6417571bed53419e4bf85d Jul 15 19:37:09.760985 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:09.760949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h724t" event={"ID":"9273323b-d26e-4d3d-a9b3-a5c54c3c41eb","Type":"ContainerStarted","Data":"db811ad27ce94b36ee1c820ccadd8696b50480370f6417571bed53419e4bf85d"} Jul 15 19:37:12.775537 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:12.775496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h724t" event={"ID":"9273323b-d26e-4d3d-a9b3-a5c54c3c41eb","Type":"ContainerStarted","Data":"918f9b2c80179d6909833ddcc0d347982762d028d33a8f93a5e1f1cf996b5d2d"} Jul 15 19:37:12.775928 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:12.775605 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h724t" Jul 15 19:37:12.793534 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:12.793448 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h724t" podStartSLOduration=1.8393799149999999 podStartE2EDuration="4.793433567s" totalImagesPullingTime="2.954053652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:37:12.792176887 +0000 UTC m=+513.621583497" watchObservedRunningTime="2026-07-15 19:37:12.793433567 +0000 UTC m=+513.622840175" Jul 15 19:37:23.782124 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:37:23.782093 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h724t" Jul 15 19:38:51.583828 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:51.583794 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fcd588797-kddqj"] Jul 15 19:38:51.587222 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:51.587205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:38:51.589925 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:51.589904 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 19:38:51.589925 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:51.589913 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tmrbb\"" Jul 15 19:38:51.590069 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:51.589913 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 19:38:51.598502 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:51.598478 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fcd588797-kddqj"] Jul 15 19:38:51.696191 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:51.696160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-webhook-cert\") pod \"maas-controller-fcd588797-kddqj\" (UID: \"e16956c8-06f3-4ce8-860e-ee6cb781fbd6\") " pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:38:51.696367 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:51.696198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsnnz\" (UniqueName: \"kubernetes.io/projected/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-kube-api-access-lsnnz\") pod \"maas-controller-fcd588797-kddqj\" (UID: \"e16956c8-06f3-4ce8-860e-ee6cb781fbd6\") " pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:38:51.796916 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:51.796880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-webhook-cert\") pod \"maas-controller-fcd588797-kddqj\" (UID: \"e16956c8-06f3-4ce8-860e-ee6cb781fbd6\") " pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:38:51.796916 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:51.796920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsnnz\" (UniqueName: \"kubernetes.io/projected/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-kube-api-access-lsnnz\") pod \"maas-controller-fcd588797-kddqj\" (UID: \"e16956c8-06f3-4ce8-860e-ee6cb781fbd6\") " pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:38:51.797163 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:38:51.797025 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 15 19:38:51.797163 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:38:51.797100 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-webhook-cert podName:e16956c8-06f3-4ce8-860e-ee6cb781fbd6 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:52.297081359 +0000 UTC m=+613.126487949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-webhook-cert") pod "maas-controller-fcd588797-kddqj" (UID: "e16956c8-06f3-4ce8-860e-ee6cb781fbd6") : secret "maas-controller-webhook-cert" not found Jul 15 19:38:51.805889 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:51.805854 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsnnz\" (UniqueName: \"kubernetes.io/projected/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-kube-api-access-lsnnz\") pod \"maas-controller-fcd588797-kddqj\" (UID: \"e16956c8-06f3-4ce8-860e-ee6cb781fbd6\") " pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:38:52.300603 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:52.300565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-webhook-cert\") pod \"maas-controller-fcd588797-kddqj\" (UID: \"e16956c8-06f3-4ce8-860e-ee6cb781fbd6\") " pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:38:52.303047 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:52.303023 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-webhook-cert\") pod \"maas-controller-fcd588797-kddqj\" (UID: \"e16956c8-06f3-4ce8-860e-ee6cb781fbd6\") " pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:38:52.500091 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:52.500057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:38:52.628667 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:52.628638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fcd588797-kddqj"] Jul 15 19:38:52.631479 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:38:52.631452 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16956c8_06f3_4ce8_860e_ee6cb781fbd6.slice/crio-a1d7943fabd8105808b6624240fd99997e20fb23d30705111845d40fbb7e6ec8 WatchSource:0}: Error finding container a1d7943fabd8105808b6624240fd99997e20fb23d30705111845d40fbb7e6ec8: Status 404 returned error can't find the container with id a1d7943fabd8105808b6624240fd99997e20fb23d30705111845d40fbb7e6ec8 Jul 15 19:38:53.206834 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:53.206761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcd588797-kddqj" event={"ID":"e16956c8-06f3-4ce8-860e-ee6cb781fbd6","Type":"ContainerStarted","Data":"a1d7943fabd8105808b6624240fd99997e20fb23d30705111845d40fbb7e6ec8"} Jul 15 19:38:55.216745 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:55.216656 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcd588797-kddqj" event={"ID":"e16956c8-06f3-4ce8-860e-ee6cb781fbd6","Type":"ContainerStarted","Data":"1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511"} Jul 15 19:38:55.217114 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:55.216791 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:38:55.235744 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:38:55.235699 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-fcd588797-kddqj" podStartSLOduration=1.9067635250000001 podStartE2EDuration="4.235683097s" totalImagesPullingTime="2.328919572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:55.23430621 +0000 UTC m=+616.063712821" watchObservedRunningTime="2026-07-15 19:38:55.235683097 +0000 UTC m=+616.065089703" Jul 15 19:39:06.223622 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:06.223519 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:39:07.617862 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:07.617825 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fcd588797-kddqj"] Jul 15 19:39:07.618230 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:07.618013 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-fcd588797-kddqj" podUID="e16956c8-06f3-4ce8-860e-ee6cb781fbd6" containerName="manager" containerID="cri-o://1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511" gracePeriod=30 Jul 15 19:39:07.854524 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:07.854499 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:39:07.928762 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:07.928679 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-webhook-cert\") pod \"e16956c8-06f3-4ce8-860e-ee6cb781fbd6\" (UID: \"e16956c8-06f3-4ce8-860e-ee6cb781fbd6\") " Jul 15 19:39:07.928762 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:07.928718 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsnnz\" (UniqueName: \"kubernetes.io/projected/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-kube-api-access-lsnnz\") pod \"e16956c8-06f3-4ce8-860e-ee6cb781fbd6\" (UID: \"e16956c8-06f3-4ce8-860e-ee6cb781fbd6\") " Jul 15 19:39:07.931017 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:07.930994 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-kube-api-access-lsnnz" (OuterVolumeSpecName: "kube-api-access-lsnnz") pod "e16956c8-06f3-4ce8-860e-ee6cb781fbd6" (UID: "e16956c8-06f3-4ce8-860e-ee6cb781fbd6"). InnerVolumeSpecName "kube-api-access-lsnnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:39:07.931115 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:07.931045 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e16956c8-06f3-4ce8-860e-ee6cb781fbd6" (UID: "e16956c8-06f3-4ce8-860e-ee6cb781fbd6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:39:08.029970 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:08.029936 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-webhook-cert\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:39:08.029970 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:08.029965 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsnnz\" (UniqueName: \"kubernetes.io/projected/e16956c8-06f3-4ce8-860e-ee6cb781fbd6-kube-api-access-lsnnz\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 19:39:08.278319 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:08.278283 2576 generic.go:356] "Generic (PLEG): container finished" podID="e16956c8-06f3-4ce8-860e-ee6cb781fbd6" containerID="1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511" exitCode=0 Jul 15 19:39:08.278520 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:08.278324 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcd588797-kddqj" event={"ID":"e16956c8-06f3-4ce8-860e-ee6cb781fbd6","Type":"ContainerDied","Data":"1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511"} Jul 15 19:39:08.278520 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:08.278403 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcd588797-kddqj" event={"ID":"e16956c8-06f3-4ce8-860e-ee6cb781fbd6","Type":"ContainerDied","Data":"a1d7943fabd8105808b6624240fd99997e20fb23d30705111845d40fbb7e6ec8"} Jul 15 19:39:08.278520 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:08.278336 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcd588797-kddqj" Jul 15 19:39:08.278520 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:08.278435 2576 scope.go:117] "RemoveContainer" containerID="1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511" Jul 15 19:39:08.287183 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:08.287168 2576 scope.go:117] "RemoveContainer" containerID="1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511" Jul 15 19:39:08.287491 ip-10-0-139-43 kubenswrapper[2576]: E0715 19:39:08.287473 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511\": container with ID starting with 1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511 not found: ID does not exist" containerID="1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511" Jul 15 19:39:08.287539 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:08.287500 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511"} err="failed to get container status \"1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511\": rpc error: code = NotFound desc = could not find container \"1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511\": container with ID starting with 1897380b5675c0a70c4715f35db20b0cba95a5e643e7611821ba7c069d4f7511 not found: ID does not exist" Jul 15 19:39:08.299577 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:08.299531 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fcd588797-kddqj"] Jul 15 19:39:08.303473 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:08.303449 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-fcd588797-kddqj"] Jul 15 19:39:09.671371 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:09.671337 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e16956c8-06f3-4ce8-860e-ee6cb781fbd6" path="/var/lib/kubelet/pods/e16956c8-06f3-4ce8-860e-ee6cb781fbd6/volumes" Jul 15 19:39:28.751040 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.751010 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f"] Jul 15 19:39:28.753604 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.751345 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e16956c8-06f3-4ce8-860e-ee6cb781fbd6" containerName="manager" Jul 15 19:39:28.753604 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.751356 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e16956c8-06f3-4ce8-860e-ee6cb781fbd6" containerName="manager" Jul 15 19:39:28.753604 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.751417 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e16956c8-06f3-4ce8-860e-ee6cb781fbd6" containerName="manager" Jul 15 19:39:28.754501 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.754486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" Jul 15 19:39:28.757074 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.757055 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 19:39:28.762194 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.762173 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f"] Jul 15 19:39:28.811678 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.811644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdwbk\" (UniqueName: \"kubernetes.io/projected/c006b388-0213-4418-bc49-7f5059a38bfb-kube-api-access-xdwbk\") pod \"payload-pre-processing-74584bb9f8-sjx2f\" (UID: \"c006b388-0213-4418-bc49-7f5059a38bfb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" Jul 15 19:39:28.811851 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.811701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c006b388-0213-4418-bc49-7f5059a38bfb-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-sjx2f\" (UID: \"c006b388-0213-4418-bc49-7f5059a38bfb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" Jul 15 19:39:28.912977 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.912943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdwbk\" (UniqueName: \"kubernetes.io/projected/c006b388-0213-4418-bc49-7f5059a38bfb-kube-api-access-xdwbk\") pod \"payload-pre-processing-74584bb9f8-sjx2f\" (UID: \"c006b388-0213-4418-bc49-7f5059a38bfb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" Jul 15 19:39:28.913133 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.912982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c006b388-0213-4418-bc49-7f5059a38bfb-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-sjx2f\" (UID: \"c006b388-0213-4418-bc49-7f5059a38bfb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" Jul 15 19:39:28.913641 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.913623 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c006b388-0213-4418-bc49-7f5059a38bfb-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-sjx2f\" (UID: \"c006b388-0213-4418-bc49-7f5059a38bfb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" Jul 15 19:39:28.921660 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:28.921635 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdwbk\" (UniqueName: \"kubernetes.io/projected/c006b388-0213-4418-bc49-7f5059a38bfb-kube-api-access-xdwbk\") pod \"payload-pre-processing-74584bb9f8-sjx2f\" (UID: \"c006b388-0213-4418-bc49-7f5059a38bfb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" Jul 15 19:39:29.066156 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:29.066054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" Jul 15 19:39:29.197277 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:29.197233 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f"] Jul 15 19:39:29.199865 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:39:29.199840 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc006b388_0213_4418_bc49_7f5059a38bfb.slice/crio-35a4d3d437da960c01ff5af4fc412d2ea42d3de9d61d9ee0d7492955137387ec WatchSource:0}: Error finding container 35a4d3d437da960c01ff5af4fc412d2ea42d3de9d61d9ee0d7492955137387ec: Status 404 returned error can't find the container with id 35a4d3d437da960c01ff5af4fc412d2ea42d3de9d61d9ee0d7492955137387ec Jul 15 19:39:29.371865 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:29.371782 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" event={"ID":"c006b388-0213-4418-bc49-7f5059a38bfb","Type":"ContainerStarted","Data":"35a4d3d437da960c01ff5af4fc412d2ea42d3de9d61d9ee0d7492955137387ec"} Jul 15 19:39:31.381391 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:31.381349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" event={"ID":"c006b388-0213-4418-bc49-7f5059a38bfb","Type":"ContainerStarted","Data":"2f1085e2ef99a720c0fdf2067b97be4bc82bacec69cdeac626acef851e887e58"} Jul 15 19:39:31.381853 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:31.381487 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" Jul 15 19:39:31.398295 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:31.398236 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" podStartSLOduration=1.8119487589999999 podStartE2EDuration="3.398219485s" totalImagesPullingTime="1.586270726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:31.397055472 +0000 UTC m=+652.226462082" watchObservedRunningTime="2026-07-15 19:39:31.398219485 +0000 UTC m=+652.227626094" Jul 15 19:39:42.388079 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:39:42.388048 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-sjx2f" Jul 15 19:40:34.238629 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.238526 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn"] Jul 15 19:40:34.241198 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.241176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.243919 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.243900 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 19:40:34.245270 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.245240 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-728wb\"" Jul 15 19:40:34.245270 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.245259 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 19:40:34.245441 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.245271 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 15 19:40:34.249738 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.249713 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn"] Jul 15 19:40:34.293585 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.293523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2429eddb-ab99-430d-a55f-e7821eb66c62-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.293767 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.293600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.293767 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.293638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.293767 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.293670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.293767 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.293707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zfb7\" (UniqueName: \"kubernetes.io/projected/2429eddb-ab99-430d-a55f-e7821eb66c62-kube-api-access-9zfb7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.293767 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.293761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.394304 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.394264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.394304 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.394309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zfb7\" (UniqueName: \"kubernetes.io/projected/2429eddb-ab99-430d-a55f-e7821eb66c62-kube-api-access-9zfb7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.394533 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.394349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.394533 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.394372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2429eddb-ab99-430d-a55f-e7821eb66c62-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.394533 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.394403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.394533 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.394419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.394803 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.394753 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.394863 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.394819 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.394916 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.394892 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.396820 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.396801 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2429eddb-ab99-430d-a55f-e7821eb66c62-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.396983 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.396964 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2429eddb-ab99-430d-a55f-e7821eb66c62-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.402375 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.402353 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zfb7\" (UniqueName: \"kubernetes.io/projected/2429eddb-ab99-430d-a55f-e7821eb66c62-kube-api-access-9zfb7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dmvcn\" (UID: \"2429eddb-ab99-430d-a55f-e7821eb66c62\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.552769 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.552730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:34.684446 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.684415 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn"] Jul 15 19:40:34.688354 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:40:34.688321 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2429eddb_ab99_430d_a55f_e7821eb66c62.slice/crio-66fd4e9b0ecd9444ddb5bad808ae0e2ce413916e1e715f0db35e1efc1fe10642 WatchSource:0}: Error finding container 66fd4e9b0ecd9444ddb5bad808ae0e2ce413916e1e715f0db35e1efc1fe10642: Status 404 returned error can't find the container with id 66fd4e9b0ecd9444ddb5bad808ae0e2ce413916e1e715f0db35e1efc1fe10642 Jul 15 19:40:34.689534 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:34.689517 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 19:40:35.657564 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:35.657515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" event={"ID":"2429eddb-ab99-430d-a55f-e7821eb66c62","Type":"ContainerStarted","Data":"66fd4e9b0ecd9444ddb5bad808ae0e2ce413916e1e715f0db35e1efc1fe10642"} Jul 15 19:40:36.663838 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:36.663807 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" event={"ID":"2429eddb-ab99-430d-a55f-e7821eb66c62","Type":"ContainerStarted","Data":"8a69982e5792ea8f684dd7bbd6bfff4491c890388ff2e730c97a67a584e69a14"} Jul 15 19:40:36.682414 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:36.682369 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" podStartSLOduration=1.54296934 podStartE2EDuration="2.682355336s" totalImagesPullingTime="1.139385996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:40:36.679864533 +0000 UTC m=+717.509271144" watchObservedRunningTime="2026-07-15 19:40:36.682355336 +0000 UTC m=+717.511761944" Jul 15 19:40:44.553410 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:44.553367 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:44.553886 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:44.553460 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:44.565762 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:44.565738 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:40:44.711271 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:40:44.711245 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dmvcn" Jul 15 19:41:16.743736 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.743707 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x"] Jul 15 19:41:16.746997 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.746973 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.749704 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.749683 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 19:41:16.758175 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.758150 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x"] Jul 15 19:41:16.876088 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.876051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.876256 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.876108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.876256 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.876173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.876256 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.876202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.876256 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.876219 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25fe389a-cb88-438f-a79e-c68a5f5c8217-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.876256 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.876235 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n6nl\" (UniqueName: \"kubernetes.io/projected/25fe389a-cb88-438f-a79e-c68a5f5c8217-kube-api-access-7n6nl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.977405 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.977368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.977405 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.977405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25fe389a-cb88-438f-a79e-c68a5f5c8217-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.977602 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.977426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n6nl\" (UniqueName: \"kubernetes.io/projected/25fe389a-cb88-438f-a79e-c68a5f5c8217-kube-api-access-7n6nl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.977602 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.977488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.977602 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.977569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.977758 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.977609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.977855 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.977829 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.977914 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.977883 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.978045 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.978029 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.979959 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.979935 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25fe389a-cb88-438f-a79e-c68a5f5c8217-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.980155 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.980137 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25fe389a-cb88-438f-a79e-c68a5f5c8217-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:16.985415 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:16.985390 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n6nl\" (UniqueName: \"kubernetes.io/projected/25fe389a-cb88-438f-a79e-c68a5f5c8217-kube-api-access-7n6nl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x\" (UID: \"25fe389a-cb88-438f-a79e-c68a5f5c8217\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:17.058180 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:17.058140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:17.198143 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:17.198115 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x"] Jul 15 19:41:17.201042 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:41:17.201008 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25fe389a_cb88_438f_a79e_c68a5f5c8217.slice/crio-f7f4e2594fdb184ed62edbe994594fbae009484a4b5efd8dcc9c2d0b0e4cd5b9 WatchSource:0}: Error finding container f7f4e2594fdb184ed62edbe994594fbae009484a4b5efd8dcc9c2d0b0e4cd5b9: Status 404 returned error can't find the container with id f7f4e2594fdb184ed62edbe994594fbae009484a4b5efd8dcc9c2d0b0e4cd5b9 Jul 15 19:41:17.842642 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:17.842606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" event={"ID":"25fe389a-cb88-438f-a79e-c68a5f5c8217","Type":"ContainerStarted","Data":"d7570c5fd8a14a5930568d3509df39d07871683b5cc2153921c7fbf88fa33e42"} Jul 15 19:41:17.843031 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:17.842657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" event={"ID":"25fe389a-cb88-438f-a79e-c68a5f5c8217","Type":"ContainerStarted","Data":"f7f4e2594fdb184ed62edbe994594fbae009484a4b5efd8dcc9c2d0b0e4cd5b9"} Jul 15 19:41:17.860325 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:17.860275 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" podStartSLOduration=1.659253425 podStartE2EDuration="1.860259194s" totalImagesPullingTime="201.005769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:41:17.859639401 +0000 UTC m=+758.689046032" watchObservedRunningTime="2026-07-15 19:41:17.860259194 +0000 UTC m=+758.689665803" Jul 15 19:41:22.229514 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.229478 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n"] Jul 15 19:41:22.233751 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.233725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.236451 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.236347 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 19:41:22.243058 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.243033 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n"] Jul 15 19:41:22.326714 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.326679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1de77542-9f92-4d76-848d-285aa9ff18e0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.326714 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.326718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.326918 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.326738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.326918 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.326817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlzwc\" (UniqueName: \"kubernetes.io/projected/1de77542-9f92-4d76-848d-285aa9ff18e0-kube-api-access-hlzwc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.326918 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.326863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.326918 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.326908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.427692 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.427647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.427692 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.427701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.427938 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.427743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1de77542-9f92-4d76-848d-285aa9ff18e0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.427938 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.427760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.427938 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.427778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.427938 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.427836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlzwc\" (UniqueName: \"kubernetes.io/projected/1de77542-9f92-4d76-848d-285aa9ff18e0-kube-api-access-hlzwc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.428186 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.428163 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.428249 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.428160 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.428302 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.428279 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.430115 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.430094 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1de77542-9f92-4d76-848d-285aa9ff18e0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.430370 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.430353 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1de77542-9f92-4d76-848d-285aa9ff18e0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.438588 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.438536 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlzwc\" (UniqueName: \"kubernetes.io/projected/1de77542-9f92-4d76-848d-285aa9ff18e0-kube-api-access-hlzwc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-smf8n\" (UID: \"1de77542-9f92-4d76-848d-285aa9ff18e0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.546286 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.546245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:22.679195 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.679172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n"] Jul 15 19:41:22.681111 ip-10-0-139-43 kubenswrapper[2576]: W0715 19:41:22.681086 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de77542_9f92_4d76_848d_285aa9ff18e0.slice/crio-3f564aef22acaa6f53d319821aa4fa8c1670524c602d57ed2e67300a4bd13c7a WatchSource:0}: Error finding container 3f564aef22acaa6f53d319821aa4fa8c1670524c602d57ed2e67300a4bd13c7a: Status 404 returned error can't find the container with id 3f564aef22acaa6f53d319821aa4fa8c1670524c602d57ed2e67300a4bd13c7a Jul 15 19:41:22.865649 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:22.865570 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" event={"ID":"1de77542-9f92-4d76-848d-285aa9ff18e0","Type":"ContainerStarted","Data":"3f564aef22acaa6f53d319821aa4fa8c1670524c602d57ed2e67300a4bd13c7a"} Jul 15 19:41:23.871643 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:23.871608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" event={"ID":"1de77542-9f92-4d76-848d-285aa9ff18e0","Type":"ContainerStarted","Data":"532c3d8707aa7144f6993e7d4f1e488b577cd84936e2aa17c680fd1d84974e0e"} Jul 15 19:41:23.889124 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:23.889071 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" podStartSLOduration=1.700658446 podStartE2EDuration="1.889052861s" totalImagesPullingTime="188.394415ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:41:23.887470071 +0000 UTC m=+764.716876683" watchObservedRunningTime="2026-07-15 19:41:23.889052861 +0000 UTC m=+764.718459470" Jul 15 19:41:27.058802 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:27.058757 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:27.059261 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:27.058836 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:27.070894 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:27.070868 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:27.904617 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:27.904590 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x" Jul 15 19:41:32.546702 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:32.546665 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:32.547181 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:32.546740 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:32.558967 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:32.558938 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 19:41:32.926130 ip-10-0-139-43 kubenswrapper[2576]: I0715 19:41:32.926042 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-smf8n" Jul 15 20:08:15.034819 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.034776 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65"] Jul 15 20:08:15.037792 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.037776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65" Jul 15 20:08:15.040381 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.040361 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 20:08:15.040493 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.040474 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nd4br\"" Jul 15 20:08:15.045323 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.045302 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65"] Jul 15 20:08:15.147236 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.147196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bf24ebe-1e72-4d1a-a738-80eb17a592a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a86716-dgk65\" (UID: \"3bf24ebe-1e72-4d1a-a738-80eb17a592a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65" Jul 15 20:08:15.248579 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.248533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bf24ebe-1e72-4d1a-a738-80eb17a592a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a86716-dgk65\" (UID: \"3bf24ebe-1e72-4d1a-a738-80eb17a592a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65" Jul 15 20:08:15.249167 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.249146 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bf24ebe-1e72-4d1a-a738-80eb17a592a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a86716-dgk65\" (UID: \"3bf24ebe-1e72-4d1a-a738-80eb17a592a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65" Jul 15 20:08:15.349576 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.349462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65" Jul 15 20:08:15.477831 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.477804 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65"] Jul 15 20:08:15.481294 ip-10-0-139-43 kubenswrapper[2576]: W0715 20:08:15.481265 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf24ebe_1e72_4d1a_a738_80eb17a592a1.slice/crio-e434847a946b371723fd9cd97afbbf96d57ebf632a6faa68ff2dcb6413e0f709 WatchSource:0}: Error finding container e434847a946b371723fd9cd97afbbf96d57ebf632a6faa68ff2dcb6413e0f709: Status 404 returned error can't find the container with id e434847a946b371723fd9cd97afbbf96d57ebf632a6faa68ff2dcb6413e0f709 Jul 15 20:08:15.483526 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.483509 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 20:08:15.774932 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:15.774896 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65" event={"ID":"3bf24ebe-1e72-4d1a-a738-80eb17a592a1","Type":"ContainerStarted","Data":"e434847a946b371723fd9cd97afbbf96d57ebf632a6faa68ff2dcb6413e0f709"} Jul 15 20:08:19.794821 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:19.794782 2576 generic.go:356] "Generic (PLEG): container finished" podID="3bf24ebe-1e72-4d1a-a738-80eb17a592a1" containerID="8634ff37a2a21a1cd06efe0d8964d7d5b7846cc1d923270ef5d4fd4ba9cbaa1c" exitCode=0 Jul 15 20:08:19.795206 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:19.794860 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65" event={"ID":"3bf24ebe-1e72-4d1a-a738-80eb17a592a1","Type":"ContainerDied","Data":"8634ff37a2a21a1cd06efe0d8964d7d5b7846cc1d923270ef5d4fd4ba9cbaa1c"} Jul 15 20:08:20.932831 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:20.932809 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65" Jul 15 20:08:20.999967 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:20.999930 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bf24ebe-1e72-4d1a-a738-80eb17a592a1-maas-api-service-ca\") pod \"3bf24ebe-1e72-4d1a-a738-80eb17a592a1\" (UID: \"3bf24ebe-1e72-4d1a-a738-80eb17a592a1\") " Jul 15 20:08:21.000283 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:21.000262 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bf24ebe-1e72-4d1a-a738-80eb17a592a1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3bf24ebe-1e72-4d1a-a738-80eb17a592a1" (UID: "3bf24ebe-1e72-4d1a-a738-80eb17a592a1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:08:21.101087 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:21.101003 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bf24ebe-1e72-4d1a-a738-80eb17a592a1-maas-api-service-ca\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 20:08:21.805919 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:21.805880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65" event={"ID":"3bf24ebe-1e72-4d1a-a738-80eb17a592a1","Type":"ContainerDied","Data":"e434847a946b371723fd9cd97afbbf96d57ebf632a6faa68ff2dcb6413e0f709"} Jul 15 20:08:21.806084 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:21.805928 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e434847a946b371723fd9cd97afbbf96d57ebf632a6faa68ff2dcb6413e0f709" Jul 15 20:08:21.806084 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:08:21.805895 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a86716-dgk65" Jul 15 20:09:13.095328 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.095293 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br"] Jul 15 20:09:13.095911 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.095789 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf24ebe-1e72-4d1a-a738-80eb17a592a1" containerName="revoke-keys" Jul 15 20:09:13.095911 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.095809 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf24ebe-1e72-4d1a-a738-80eb17a592a1" containerName="revoke-keys" Jul 15 20:09:13.096024 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.095946 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf24ebe-1e72-4d1a-a738-80eb17a592a1" containerName="revoke-keys" Jul 15 20:09:13.102906 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.102881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:13.106505 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.106485 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h855w\"" Jul 15 20:09:13.106645 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.106530 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-5306d0-serving-cert\"" Jul 15 20:09:13.106716 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.106484 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 20:09:13.108362 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.108337 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 20:09:13.111099 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.111075 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br"] Jul 15 20:09:13.170380 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.170347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plc22\" (UniqueName: \"kubernetes.io/projected/738f103a-3547-43c2-b214-153d94d9e8e3-kube-api-access-plc22\") pod \"maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:13.170574 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.170408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738f103a-3547-43c2-b214-153d94d9e8e3-maas-api-tls\") pod \"maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:13.170574 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.170467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738f103a-3547-43c2-b214-153d94d9e8e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:13.271194 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.271159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plc22\" (UniqueName: \"kubernetes.io/projected/738f103a-3547-43c2-b214-153d94d9e8e3-kube-api-access-plc22\") pod \"maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:13.271360 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.271205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738f103a-3547-43c2-b214-153d94d9e8e3-maas-api-tls\") pod \"maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:13.271360 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.271255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738f103a-3547-43c2-b214-153d94d9e8e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:13.271479 ip-10-0-139-43 kubenswrapper[2576]: E0715 20:09:13.271430 2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-serving-cert: secret "maas-api-e2e-api-b-5306d0-serving-cert" not found Jul 15 20:09:13.271574 ip-10-0-139-43 kubenswrapper[2576]: E0715 20:09:13.271497 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/738f103a-3547-43c2-b214-153d94d9e8e3-maas-api-tls podName:738f103a-3547-43c2-b214-153d94d9e8e3 nodeName:}" failed. No retries permitted until 2026-07-15 20:09:13.771481742 +0000 UTC m=+2434.600888329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/738f103a-3547-43c2-b214-153d94d9e8e3-maas-api-tls") pod "maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" (UID: "738f103a-3547-43c2-b214-153d94d9e8e3") : secret "maas-api-e2e-api-b-5306d0-serving-cert" not found Jul 15 20:09:13.271798 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.271782 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738f103a-3547-43c2-b214-153d94d9e8e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:13.280924 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.280896 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plc22\" (UniqueName: \"kubernetes.io/projected/738f103a-3547-43c2-b214-153d94d9e8e3-kube-api-access-plc22\") pod \"maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:13.774648 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.774616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738f103a-3547-43c2-b214-153d94d9e8e3-maas-api-tls\") pod \"maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:13.777180 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:13.777162 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738f103a-3547-43c2-b214-153d94d9e8e3-maas-api-tls\") pod \"maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:14.016957 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:14.016915 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:14.156249 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:14.156227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br"] Jul 15 20:09:14.158314 ip-10-0-139-43 kubenswrapper[2576]: W0715 20:09:14.158283 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738f103a_3547_43c2_b214_153d94d9e8e3.slice/crio-b2c688388d0256f076cb10bce00b6aff5e24947b83af49c060ff7879da087d6b WatchSource:0}: Error finding container b2c688388d0256f076cb10bce00b6aff5e24947b83af49c060ff7879da087d6b: Status 404 returned error can't find the container with id b2c688388d0256f076cb10bce00b6aff5e24947b83af49c060ff7879da087d6b Jul 15 20:09:15.042891 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:15.042854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" event={"ID":"738f103a-3547-43c2-b214-153d94d9e8e3","Type":"ContainerStarted","Data":"b2c688388d0256f076cb10bce00b6aff5e24947b83af49c060ff7879da087d6b"} Jul 15 20:09:16.048955 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:16.048915 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" event={"ID":"738f103a-3547-43c2-b214-153d94d9e8e3","Type":"ContainerStarted","Data":"f00c0224066d5d9a3f47ea3036a5156d0ea3d848af242701f832062176fe6ff8"} Jul 15 20:09:16.049329 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:16.049079 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:16.066847 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:16.066801 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" podStartSLOduration=1.646784504 podStartE2EDuration="3.066788064s" totalImagesPullingTime="1.42000356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:09:16.06560258 +0000 UTC m=+2436.895009183" watchObservedRunningTime="2026-07-15 20:09:16.066788064 +0000 UTC m=+2436.896194673" Jul 15 20:09:22.058560 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:22.058515 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:09:25.595166 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:25.595092 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c"] Jul 15 20:09:25.599436 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:25.599414 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c" Jul 15 20:09:25.602575 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:25.602537 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nd4br\"" Jul 15 20:09:25.609773 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:25.609672 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c"] Jul 15 20:09:25.678264 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:25.678234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a6af58-7e54-455f-9c55-9c70d27d3582-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c\" (UID: \"a2a6af58-7e54-455f-9c55-9c70d27d3582\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c" Jul 15 20:09:25.779661 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:25.779627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a6af58-7e54-455f-9c55-9c70d27d3582-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c\" (UID: \"a2a6af58-7e54-455f-9c55-9c70d27d3582\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c" Jul 15 20:09:25.780193 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:25.780175 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a6af58-7e54-455f-9c55-9c70d27d3582-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c\" (UID: \"a2a6af58-7e54-455f-9c55-9c70d27d3582\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c" Jul 15 20:09:25.911412 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:25.911331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c" Jul 15 20:09:26.045588 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:26.045540 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c"] Jul 15 20:09:26.048696 ip-10-0-139-43 kubenswrapper[2576]: W0715 20:09:26.048666 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a6af58_7e54_455f_9c55_9c70d27d3582.slice/crio-c7f1ac495ff4b32254c7e8fdaa37e7853dd06592b0f999bc557661014fab9d58 WatchSource:0}: Error finding container c7f1ac495ff4b32254c7e8fdaa37e7853dd06592b0f999bc557661014fab9d58: Status 404 returned error can't find the container with id c7f1ac495ff4b32254c7e8fdaa37e7853dd06592b0f999bc557661014fab9d58 Jul 15 20:09:26.096703 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:26.096674 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c" event={"ID":"a2a6af58-7e54-455f-9c55-9c70d27d3582","Type":"ContainerStarted","Data":"c7f1ac495ff4b32254c7e8fdaa37e7853dd06592b0f999bc557661014fab9d58"} Jul 15 20:09:27.102851 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:27.102815 2576 generic.go:356] "Generic (PLEG): container finished" podID="a2a6af58-7e54-455f-9c55-9c70d27d3582" containerID="477f5da38d5675c5513472cbc555602c7867e9f502607394a06d1749a79d83d6" exitCode=0 Jul 15 20:09:27.103219 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:27.102908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c" event={"ID":"a2a6af58-7e54-455f-9c55-9c70d27d3582","Type":"ContainerDied","Data":"477f5da38d5675c5513472cbc555602c7867e9f502607394a06d1749a79d83d6"} Jul 15 20:09:28.244014 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:28.243991 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c" Jul 15 20:09:28.302995 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:28.302959 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a6af58-7e54-455f-9c55-9c70d27d3582-maas-api-service-ca\") pod \"a2a6af58-7e54-455f-9c55-9c70d27d3582\" (UID: \"a2a6af58-7e54-455f-9c55-9c70d27d3582\") " Jul 15 20:09:28.303327 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:28.303305 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a6af58-7e54-455f-9c55-9c70d27d3582-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a2a6af58-7e54-455f-9c55-9c70d27d3582" (UID: "a2a6af58-7e54-455f-9c55-9c70d27d3582"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:09:28.404045 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:28.403962 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a6af58-7e54-455f-9c55-9c70d27d3582-maas-api-service-ca\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 20:09:29.114413 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:29.114380 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c" Jul 15 20:09:29.114631 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:29.114413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c" event={"ID":"a2a6af58-7e54-455f-9c55-9c70d27d3582","Type":"ContainerDied","Data":"c7f1ac495ff4b32254c7e8fdaa37e7853dd06592b0f999bc557661014fab9d58"} Jul 15 20:09:29.114631 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:29.114469 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7f1ac495ff4b32254c7e8fdaa37e7853dd06592b0f999bc557661014fab9d58" Jul 15 20:09:52.627007 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:52.626972 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg"] Jul 15 20:09:52.627486 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:52.627334 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a6af58-7e54-455f-9c55-9c70d27d3582" containerName="revoke-keys" Jul 15 20:09:52.627486 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:52.627349 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a6af58-7e54-455f-9c55-9c70d27d3582" containerName="revoke-keys" Jul 15 20:09:52.627486 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:52.627473 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a6af58-7e54-455f-9c55-9c70d27d3582" containerName="revoke-keys" Jul 15 20:09:52.630883 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:52.630869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg" Jul 15 20:09:52.633774 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:52.633759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nd4br\"" Jul 15 20:09:52.639061 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:52.639040 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg"] Jul 15 20:09:52.723434 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:52.723399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a04bc1d1-87c3-4a9d-99b8-64d0d87c762f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg\" (UID: \"a04bc1d1-87c3-4a9d-99b8-64d0d87c762f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg" Jul 15 20:09:52.824267 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:52.824229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a04bc1d1-87c3-4a9d-99b8-64d0d87c762f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg\" (UID: \"a04bc1d1-87c3-4a9d-99b8-64d0d87c762f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg" Jul 15 20:09:52.824859 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:52.824838 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a04bc1d1-87c3-4a9d-99b8-64d0d87c762f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg\" (UID: \"a04bc1d1-87c3-4a9d-99b8-64d0d87c762f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg" Jul 15 20:09:52.942444 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:52.942369 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg" Jul 15 20:09:53.087480 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:53.087457 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg"] Jul 15 20:09:53.090129 ip-10-0-139-43 kubenswrapper[2576]: W0715 20:09:53.090099 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04bc1d1_87c3_4a9d_99b8_64d0d87c762f.slice/crio-f55e1c536913e43393cc0e36a41d8a22a2fe6033da3086681667d79bb30c589d WatchSource:0}: Error finding container f55e1c536913e43393cc0e36a41d8a22a2fe6033da3086681667d79bb30c589d: Status 404 returned error can't find the container with id f55e1c536913e43393cc0e36a41d8a22a2fe6033da3086681667d79bb30c589d Jul 15 20:09:53.226097 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:53.226018 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg" event={"ID":"a04bc1d1-87c3-4a9d-99b8-64d0d87c762f","Type":"ContainerStarted","Data":"f55e1c536913e43393cc0e36a41d8a22a2fe6033da3086681667d79bb30c589d"} Jul 15 20:09:54.232121 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:54.232024 2576 generic.go:356] "Generic (PLEG): container finished" podID="a04bc1d1-87c3-4a9d-99b8-64d0d87c762f" containerID="aba2d472a75b1130675eebec2fba7ae87b617c3dc264d33a0bdc7eff0fb7371e" exitCode=0 Jul 15 20:09:54.232121 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:54.232071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg" event={"ID":"a04bc1d1-87c3-4a9d-99b8-64d0d87c762f","Type":"ContainerDied","Data":"aba2d472a75b1130675eebec2fba7ae87b617c3dc264d33a0bdc7eff0fb7371e"} Jul 15 20:09:55.365017 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:55.364994 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg" Jul 15 20:09:55.445958 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:55.445926 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a04bc1d1-87c3-4a9d-99b8-64d0d87c762f-maas-api-service-ca\") pod \"a04bc1d1-87c3-4a9d-99b8-64d0d87c762f\" (UID: \"a04bc1d1-87c3-4a9d-99b8-64d0d87c762f\") " Jul 15 20:09:55.446299 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:55.446276 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a04bc1d1-87c3-4a9d-99b8-64d0d87c762f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a04bc1d1-87c3-4a9d-99b8-64d0d87c762f" (UID: "a04bc1d1-87c3-4a9d-99b8-64d0d87c762f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:09:55.547264 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:55.547233 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a04bc1d1-87c3-4a9d-99b8-64d0d87c762f-maas-api-service-ca\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 20:09:55.691828 ip-10-0-139-43 kubenswrapper[2576]: E0715 20:09:55.691801 2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04bc1d1_87c3_4a9d_99b8_64d0d87c762f.slice\": RecentStats: unable to find data in memory cache]" Jul 15 20:09:56.242987 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:56.242952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg" event={"ID":"a04bc1d1-87c3-4a9d-99b8-64d0d87c762f","Type":"ContainerDied","Data":"f55e1c536913e43393cc0e36a41d8a22a2fe6033da3086681667d79bb30c589d"} Jul 15 20:09:56.242987 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:56.242987 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg" Jul 15 20:09:56.243192 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:09:56.243006 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f55e1c536913e43393cc0e36a41d8a22a2fe6033da3086681667d79bb30c589d" Jul 15 20:10:08.062960 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.062928 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br"] Jul 15 20:10:08.063460 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.063168 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" podUID="738f103a-3547-43c2-b214-153d94d9e8e3" containerName="maas-api" containerID="cri-o://f00c0224066d5d9a3f47ea3036a5156d0ea3d848af242701f832062176fe6ff8" gracePeriod=30 Jul 15 20:10:08.300686 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.300657 2576 generic.go:356] "Generic (PLEG): container finished" podID="738f103a-3547-43c2-b214-153d94d9e8e3" containerID="f00c0224066d5d9a3f47ea3036a5156d0ea3d848af242701f832062176fe6ff8" exitCode=0 Jul 15 20:10:08.300804 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.300728 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" event={"ID":"738f103a-3547-43c2-b214-153d94d9e8e3","Type":"ContainerDied","Data":"f00c0224066d5d9a3f47ea3036a5156d0ea3d848af242701f832062176fe6ff8"} Jul 15 20:10:08.300804 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.300781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" event={"ID":"738f103a-3547-43c2-b214-153d94d9e8e3","Type":"ContainerDied","Data":"b2c688388d0256f076cb10bce00b6aff5e24947b83af49c060ff7879da087d6b"} Jul 15 20:10:08.300804 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.300797 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2c688388d0256f076cb10bce00b6aff5e24947b83af49c060ff7879da087d6b" Jul 15 20:10:08.312154 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.312135 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:10:08.362581 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.362481 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738f103a-3547-43c2-b214-153d94d9e8e3-openshift-service-ca\") pod \"738f103a-3547-43c2-b214-153d94d9e8e3\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " Jul 15 20:10:08.362739 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.362575 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plc22\" (UniqueName: \"kubernetes.io/projected/738f103a-3547-43c2-b214-153d94d9e8e3-kube-api-access-plc22\") pod \"738f103a-3547-43c2-b214-153d94d9e8e3\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " Jul 15 20:10:08.362739 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.362624 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738f103a-3547-43c2-b214-153d94d9e8e3-maas-api-tls\") pod \"738f103a-3547-43c2-b214-153d94d9e8e3\" (UID: \"738f103a-3547-43c2-b214-153d94d9e8e3\") " Jul 15 20:10:08.362937 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.362910 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/738f103a-3547-43c2-b214-153d94d9e8e3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "738f103a-3547-43c2-b214-153d94d9e8e3" (UID: "738f103a-3547-43c2-b214-153d94d9e8e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:10:08.364948 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.364924 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/738f103a-3547-43c2-b214-153d94d9e8e3-kube-api-access-plc22" (OuterVolumeSpecName: "kube-api-access-plc22") pod "738f103a-3547-43c2-b214-153d94d9e8e3" (UID: "738f103a-3547-43c2-b214-153d94d9e8e3"). InnerVolumeSpecName "kube-api-access-plc22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:10:08.365028 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.364976 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/738f103a-3547-43c2-b214-153d94d9e8e3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "738f103a-3547-43c2-b214-153d94d9e8e3" (UID: "738f103a-3547-43c2-b214-153d94d9e8e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 20:10:08.463994 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.463961 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738f103a-3547-43c2-b214-153d94d9e8e3-openshift-service-ca\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 20:10:08.463994 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.463987 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plc22\" (UniqueName: \"kubernetes.io/projected/738f103a-3547-43c2-b214-153d94d9e8e3-kube-api-access-plc22\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 20:10:08.463994 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:08.463996 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738f103a-3547-43c2-b214-153d94d9e8e3-maas-api-tls\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 20:10:09.304597 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:09.304566 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br" Jul 15 20:10:09.328814 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:09.328788 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br"] Jul 15 20:10:09.333222 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:09.333197 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5306d0-5bdf7bff7b-tr7br"] Jul 15 20:10:09.671855 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:09.671770 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="738f103a-3547-43c2-b214-153d94d9e8e3" path="/var/lib/kubelet/pods/738f103a-3547-43c2-b214-153d94d9e8e3/volumes" Jul 15 20:10:22.740180 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.740143 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j"] Jul 15 20:10:22.740786 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.740663 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738f103a-3547-43c2-b214-153d94d9e8e3" containerName="maas-api" Jul 15 20:10:22.740786 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.740678 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="738f103a-3547-43c2-b214-153d94d9e8e3" containerName="maas-api" Jul 15 20:10:22.740786 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.740695 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a04bc1d1-87c3-4a9d-99b8-64d0d87c762f" containerName="revoke-keys" Jul 15 20:10:22.740786 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.740704 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a04bc1d1-87c3-4a9d-99b8-64d0d87c762f" containerName="revoke-keys" Jul 15 20:10:22.740987 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.740790 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a04bc1d1-87c3-4a9d-99b8-64d0d87c762f" containerName="revoke-keys" Jul 15 20:10:22.740987 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.740801 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="738f103a-3547-43c2-b214-153d94d9e8e3" containerName="maas-api" Jul 15 20:10:22.744295 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.744274 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:22.748060 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.748041 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h855w\"" Jul 15 20:10:22.748182 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.748045 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 20:10:22.749127 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.749106 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-826a0f-serving-cert\"" Jul 15 20:10:22.749206 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.749117 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 20:10:22.755687 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.755654 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j"] Jul 15 20:10:22.893317 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.893284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2gg2\" (UniqueName: \"kubernetes.io/projected/8280992f-39ab-475f-b8df-5af7f3dcccee-kube-api-access-z2gg2\") pod \"maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:22.893499 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.893368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8280992f-39ab-475f-b8df-5af7f3dcccee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:22.893499 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.893397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8280992f-39ab-475f-b8df-5af7f3dcccee-maas-api-tls\") pod \"maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:22.994294 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.994212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2gg2\" (UniqueName: \"kubernetes.io/projected/8280992f-39ab-475f-b8df-5af7f3dcccee-kube-api-access-z2gg2\") pod \"maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:22.994462 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.994318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8280992f-39ab-475f-b8df-5af7f3dcccee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:22.994462 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.994355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8280992f-39ab-475f-b8df-5af7f3dcccee-maas-api-tls\") pod \"maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:22.994614 ip-10-0-139-43 kubenswrapper[2576]: E0715 20:10:22.994470 2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-serving-cert: secret "maas-api-e2e-shared-a-826a0f-serving-cert" not found Jul 15 20:10:22.994614 ip-10-0-139-43 kubenswrapper[2576]: E0715 20:10:22.994581 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8280992f-39ab-475f-b8df-5af7f3dcccee-maas-api-tls podName:8280992f-39ab-475f-b8df-5af7f3dcccee nodeName:}" failed. No retries permitted until 2026-07-15 20:10:23.494559423 +0000 UTC m=+2504.323966024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8280992f-39ab-475f-b8df-5af7f3dcccee-maas-api-tls") pod "maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" (UID: "8280992f-39ab-475f-b8df-5af7f3dcccee") : secret "maas-api-e2e-shared-a-826a0f-serving-cert" not found Jul 15 20:10:22.995021 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:22.994995 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8280992f-39ab-475f-b8df-5af7f3dcccee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:23.003086 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:23.003060 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2gg2\" (UniqueName: \"kubernetes.io/projected/8280992f-39ab-475f-b8df-5af7f3dcccee-kube-api-access-z2gg2\") pod \"maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:23.498590 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:23.498532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8280992f-39ab-475f-b8df-5af7f3dcccee-maas-api-tls\") pod \"maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:23.501093 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:23.501073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8280992f-39ab-475f-b8df-5af7f3dcccee-maas-api-tls\") pod \"maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:23.655720 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:23.655680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:23.792281 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:23.792260 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j"] Jul 15 20:10:23.794650 ip-10-0-139-43 kubenswrapper[2576]: W0715 20:10:23.794619 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8280992f_39ab_475f_b8df_5af7f3dcccee.slice/crio-ee8b07f7cc8c7cc19e08615273ce475e99593cc3ec054a99f69cec418fe89f6c WatchSource:0}: Error finding container ee8b07f7cc8c7cc19e08615273ce475e99593cc3ec054a99f69cec418fe89f6c: Status 404 returned error can't find the container with id ee8b07f7cc8c7cc19e08615273ce475e99593cc3ec054a99f69cec418fe89f6c Jul 15 20:10:24.376366 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:24.376329 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" event={"ID":"8280992f-39ab-475f-b8df-5af7f3dcccee","Type":"ContainerStarted","Data":"5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12"} Jul 15 20:10:24.376537 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:24.376378 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" event={"ID":"8280992f-39ab-475f-b8df-5af7f3dcccee","Type":"ContainerStarted","Data":"ee8b07f7cc8c7cc19e08615273ce475e99593cc3ec054a99f69cec418fe89f6c"} Jul 15 20:10:24.376537 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:24.376409 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:10:24.393561 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:24.393461 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" podStartSLOduration=2.053233907 podStartE2EDuration="2.393447043s" totalImagesPullingTime="340.213136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:10:24.392513851 +0000 UTC m=+2505.221920462" watchObservedRunningTime="2026-07-15 20:10:24.393447043 +0000 UTC m=+2505.222853705" Jul 15 20:10:30.387281 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:10:30.387207 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:15:39.847315 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:15:39.847286 2576 scope.go:117] "RemoveContainer" containerID="f00c0224066d5d9a3f47ea3036a5156d0ea3d848af242701f832062176fe6ff8" Jul 15 20:16:07.198493 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.198444 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j"] Jul 15 20:16:07.199048 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.198782 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" podUID="8280992f-39ab-475f-b8df-5af7f3dcccee" containerName="maas-api" containerID="cri-o://5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12" gracePeriod=30 Jul 15 20:16:07.447620 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.447596 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:16:07.599615 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.599574 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8280992f-39ab-475f-b8df-5af7f3dcccee-maas-api-tls\") pod \"8280992f-39ab-475f-b8df-5af7f3dcccee\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " Jul 15 20:16:07.599813 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.599692 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8280992f-39ab-475f-b8df-5af7f3dcccee-openshift-service-ca\") pod \"8280992f-39ab-475f-b8df-5af7f3dcccee\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " Jul 15 20:16:07.599813 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.599741 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2gg2\" (UniqueName: \"kubernetes.io/projected/8280992f-39ab-475f-b8df-5af7f3dcccee-kube-api-access-z2gg2\") pod \"8280992f-39ab-475f-b8df-5af7f3dcccee\" (UID: \"8280992f-39ab-475f-b8df-5af7f3dcccee\") " Jul 15 20:16:07.600110 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.600080 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8280992f-39ab-475f-b8df-5af7f3dcccee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8280992f-39ab-475f-b8df-5af7f3dcccee" (UID: "8280992f-39ab-475f-b8df-5af7f3dcccee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:16:07.601794 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.601768 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8280992f-39ab-475f-b8df-5af7f3dcccee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8280992f-39ab-475f-b8df-5af7f3dcccee" (UID: "8280992f-39ab-475f-b8df-5af7f3dcccee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 20:16:07.601896 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.601844 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8280992f-39ab-475f-b8df-5af7f3dcccee-kube-api-access-z2gg2" (OuterVolumeSpecName: "kube-api-access-z2gg2") pod "8280992f-39ab-475f-b8df-5af7f3dcccee" (UID: "8280992f-39ab-475f-b8df-5af7f3dcccee"). InnerVolumeSpecName "kube-api-access-z2gg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:16:07.700923 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.700896 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2gg2\" (UniqueName: \"kubernetes.io/projected/8280992f-39ab-475f-b8df-5af7f3dcccee-kube-api-access-z2gg2\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 20:16:07.700923 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.700919 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8280992f-39ab-475f-b8df-5af7f3dcccee-maas-api-tls\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 20:16:07.701084 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.700929 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8280992f-39ab-475f-b8df-5af7f3dcccee-openshift-service-ca\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 20:16:07.939851 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.939768 2576 generic.go:356] "Generic (PLEG): container finished" podID="8280992f-39ab-475f-b8df-5af7f3dcccee" containerID="5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12" exitCode=0 Jul 15 20:16:07.939851 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.939820 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" Jul 15 20:16:07.939851 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.939816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" event={"ID":"8280992f-39ab-475f-b8df-5af7f3dcccee","Type":"ContainerDied","Data":"5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12"} Jul 15 20:16:07.940070 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.939882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j" event={"ID":"8280992f-39ab-475f-b8df-5af7f3dcccee","Type":"ContainerDied","Data":"ee8b07f7cc8c7cc19e08615273ce475e99593cc3ec054a99f69cec418fe89f6c"} Jul 15 20:16:07.940070 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.939915 2576 scope.go:117] "RemoveContainer" containerID="5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12" Jul 15 20:16:07.948579 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.948538 2576 scope.go:117] "RemoveContainer" containerID="5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12" Jul 15 20:16:07.948846 ip-10-0-139-43 kubenswrapper[2576]: E0715 20:16:07.948826 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12\": container with ID starting with 5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12 not found: ID does not exist" containerID="5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12" Jul 15 20:16:07.948905 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.948856 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12"} err="failed to get container status \"5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12\": rpc error: code = NotFound desc = could not find container \"5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12\": container with ID starting with 5bc844bfd078c36c5c0db622e52455c7e302835e6d25c528c37d969e8fd54e12 not found: ID does not exist" Jul 15 20:16:07.957290 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.957268 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j"] Jul 15 20:16:07.960714 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:07.960685 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-826a0f-69d98bf87f-k229j"] Jul 15 20:16:09.671665 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:09.671629 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8280992f-39ab-475f-b8df-5af7f3dcccee" path="/var/lib/kubelet/pods/8280992f-39ab-475f-b8df-5af7f3dcccee/volumes" Jul 15 20:16:18.800205 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:18.800171 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt"] Jul 15 20:16:18.800596 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:18.800518 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8280992f-39ab-475f-b8df-5af7f3dcccee" containerName="maas-api" Jul 15 20:16:18.800596 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:18.800529 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8280992f-39ab-475f-b8df-5af7f3dcccee" containerName="maas-api" Jul 15 20:16:18.800685 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:18.800615 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8280992f-39ab-475f-b8df-5af7f3dcccee" containerName="maas-api" Jul 15 20:16:18.803433 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:18.803417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt" Jul 15 20:16:18.806854 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:18.806827 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 20:16:18.806854 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:18.806842 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nd4br\"" Jul 15 20:16:18.812751 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:18.812727 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt"] Jul 15 20:16:18.900197 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:18.900161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd36384-679d-4e10-874f-dde2ee95432a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt\" (UID: \"6fd36384-679d-4e10-874f-dde2ee95432a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt" Jul 15 20:16:19.001316 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:19.001285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd36384-679d-4e10-874f-dde2ee95432a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt\" (UID: \"6fd36384-679d-4e10-874f-dde2ee95432a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt" Jul 15 20:16:19.001876 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:19.001857 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd36384-679d-4e10-874f-dde2ee95432a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt\" (UID: \"6fd36384-679d-4e10-874f-dde2ee95432a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt" Jul 15 20:16:19.113903 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:19.113827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt" Jul 15 20:16:19.246614 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:19.245198 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt"] Jul 15 20:16:19.998617 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:19.998586 2576 generic.go:356] "Generic (PLEG): container finished" podID="6fd36384-679d-4e10-874f-dde2ee95432a" containerID="56753df163ab1e7876e3490855ea90f68a85d500d5ae06b27d70e230f3c9e33d" exitCode=0 Jul 15 20:16:19.999023 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:19.998681 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt" event={"ID":"6fd36384-679d-4e10-874f-dde2ee95432a","Type":"ContainerDied","Data":"56753df163ab1e7876e3490855ea90f68a85d500d5ae06b27d70e230f3c9e33d"} Jul 15 20:16:19.999023 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:19.998747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt" event={"ID":"6fd36384-679d-4e10-874f-dde2ee95432a","Type":"ContainerStarted","Data":"14b13d1fe60b0d7518884537f25e532342e112c3c2dfbd65b3e61fa4e53c874a"} Jul 15 20:16:21.133932 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:21.133911 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt" Jul 15 20:16:21.323036 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:21.322955 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd36384-679d-4e10-874f-dde2ee95432a-maas-api-service-ca\") pod \"6fd36384-679d-4e10-874f-dde2ee95432a\" (UID: \"6fd36384-679d-4e10-874f-dde2ee95432a\") " Jul 15 20:16:21.323342 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:21.323318 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd36384-679d-4e10-874f-dde2ee95432a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6fd36384-679d-4e10-874f-dde2ee95432a" (UID: "6fd36384-679d-4e10-874f-dde2ee95432a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:16:21.424521 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:21.424486 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd36384-679d-4e10-874f-dde2ee95432a-maas-api-service-ca\") on node \"ip-10-0-139-43.ec2.internal\" DevicePath \"\"" Jul 15 20:16:22.008802 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:22.008773 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt" Jul 15 20:16:22.008802 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:22.008793 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt" event={"ID":"6fd36384-679d-4e10-874f-dde2ee95432a","Type":"ContainerDied","Data":"14b13d1fe60b0d7518884537f25e532342e112c3c2dfbd65b3e61fa4e53c874a"} Jul 15 20:16:22.009043 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:22.008836 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14b13d1fe60b0d7518884537f25e532342e112c3c2dfbd65b3e61fa4e53c874a" Jul 15 20:16:47.995898 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:47.995868 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dd997468-zwmkp_607e80ad-00a7-4366-984b-5cbed905278d/copy-manifests/0.log" Jul 15 20:16:48.008058 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:48.008028 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dd997468-zwmkp_607e80ad-00a7-4366-984b-5cbed905278d/manager/0.log" Jul 15 20:16:49.118057 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:49.118026 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-fc7b22-w8z9c_a2a6af58-7e54-455f-9c55-9c70d27d3582/revoke-keys/0.log" Jul 15 20:16:49.248908 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:49.248871 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-5306d0-7k8pg_a04bc1d1-87c3-4a9d-99b8-64d0d87c762f/revoke-keys/0.log" Jul 15 20:16:49.492007 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:49.491924 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-a86716-dgk65_3bf24ebe-1e72-4d1a-a738-80eb17a592a1/revoke-keys/0.log" Jul 15 20:16:50.208687 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:50.208658 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-b72424-9z2pt_6fd36384-679d-4e10-874f-dde2ee95432a/revoke-keys/0.log" Jul 15 20:16:51.803920 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:51.803887 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h724t_9273323b-d26e-4d3d-a9b3-a5c54c3c41eb/manager/0.log" Jul 15 20:16:53.029710 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:53.029683 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-977sl_a33c32bb-6dd8-4d7c-abda-7be639b69cce/discovery/0.log" Jul 15 20:16:53.529041 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:53.529017 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-sjx2f_c006b388-0213-4418-bc49-7f5059a38bfb/payload-pre-processing/0.log" Jul 15 20:16:54.296086 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:54.296058 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dmvcn_2429eddb-ab99-430d-a55f-e7821eb66c62/main/0.log" Jul 15 20:16:54.545344 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:54.545316 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6ng6x_25fe389a-cb88-438f-a79e-c68a5f5c8217/main/0.log" Jul 15 20:16:54.675370 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:16:54.675302 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-smf8n_1de77542-9f92-4d76-848d-285aa9ff18e0/main/0.log" Jul 15 20:17:04.459539 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:04.459506 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8t59l_219a812a-b04f-46ab-8705-aa296d4dfb48/global-pull-secret-syncer/0.log" Jul 15 20:17:04.576586 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:04.576537 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rphkg_472350f9-ddd8-4b28-a81a-2a1de81bc3f5/konnectivity-agent/0.log" Jul 15 20:17:04.649979 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:04.649948 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-43.ec2.internal_0425377e9b6e234689d75fb08e2e44f2/haproxy/0.log" Jul 15 20:17:09.837701 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:09.837612 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h724t_9273323b-d26e-4d3d-a9b3-a5c54c3c41eb/manager/0.log" Jul 15 20:17:12.232062 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.232033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-9f72w_b871de46-813a-41f7-a434-2e430220f44c/cluster-monitoring-operator/0.log" Jul 15 20:17:12.256707 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.256685 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9mjlh_ad866d62-06cd-4d37-9286-085f3dbd9866/kube-state-metrics/0.log" Jul 15 20:17:12.275512 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.275490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9mjlh_ad866d62-06cd-4d37-9286-085f3dbd9866/kube-rbac-proxy-main/0.log" Jul 15 20:17:12.295660 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.295635 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9mjlh_ad866d62-06cd-4d37-9286-085f3dbd9866/kube-rbac-proxy-self/0.log" Jul 15 20:17:12.347839 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.347808 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-tm5k7_32627078-5cff-4c1d-a8c0-09ed104ce92a/monitoring-plugin/0.log" Jul 15 20:17:12.376888 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.376862 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7knnc_e151d879-2975-4ea2-8274-68b9f9197849/node-exporter/0.log" Jul 15 20:17:12.400987 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.400937 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7knnc_e151d879-2975-4ea2-8274-68b9f9197849/kube-rbac-proxy/0.log" Jul 15 20:17:12.420298 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.420277 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7knnc_e151d879-2975-4ea2-8274-68b9f9197849/init-textfile/0.log" Jul 15 20:17:12.688592 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.688560 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da817844-fb85-4993-b4c6-f47f8427b526/prometheus/0.log" Jul 15 20:17:12.709191 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.709165 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da817844-fb85-4993-b4c6-f47f8427b526/config-reloader/0.log" Jul 15 20:17:12.750289 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.750264 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da817844-fb85-4993-b4c6-f47f8427b526/thanos-sidecar/0.log" Jul 15 20:17:12.772582 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.772539 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da817844-fb85-4993-b4c6-f47f8427b526/kube-rbac-proxy-web/0.log" Jul 15 20:17:12.794199 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.794133 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da817844-fb85-4993-b4c6-f47f8427b526/kube-rbac-proxy/0.log" Jul 15 20:17:12.816185 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.816166 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da817844-fb85-4993-b4c6-f47f8427b526/kube-rbac-proxy-thanos/0.log" Jul 15 20:17:12.836404 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:12.836381 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da817844-fb85-4993-b4c6-f47f8427b526/init-config-reloader/0.log" Jul 15 20:17:14.965095 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:14.965059 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh"] Jul 15 20:17:14.965454 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:14.965397 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fd36384-679d-4e10-874f-dde2ee95432a" containerName="revoke-keys" Jul 15 20:17:14.965454 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:14.965408 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd36384-679d-4e10-874f-dde2ee95432a" containerName="revoke-keys" Jul 15 20:17:14.965522 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:14.965458 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fd36384-679d-4e10-874f-dde2ee95432a" containerName="revoke-keys" Jul 15 20:17:14.968828 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:14.968807 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:14.971885 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:14.971860 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7q79m\"/\"openshift-service-ca.crt\"" Jul 15 20:17:14.971986 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:14.971906 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7q79m\"/\"kube-root-ca.crt\"" Jul 15 20:17:14.973077 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:14.973058 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7q79m\"/\"default-dockercfg-ptx96\"" Jul 15 20:17:14.978367 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:14.978344 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh"] Jul 15 20:17:15.008764 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.008740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q97vq\" (UniqueName: \"kubernetes.io/projected/f11a004b-f309-4625-835c-ff8cf96c2929-kube-api-access-q97vq\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.008905 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.008836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-lib-modules\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.008905 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.008870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-podres\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.009007 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.008906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-proc\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.009007 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.008934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-sys\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.109975 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.109936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q97vq\" (UniqueName: \"kubernetes.io/projected/f11a004b-f309-4625-835c-ff8cf96c2929-kube-api-access-q97vq\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.110147 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.110008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-lib-modules\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.110147 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.110032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-podres\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.110147 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.110054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-proc\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.110147 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.110071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-sys\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.110368 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.110154 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-sys\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.110368 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.110156 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-proc\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.110368 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.110184 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-podres\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.110368 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.110208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f11a004b-f309-4625-835c-ff8cf96c2929-lib-modules\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.119000 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.118978 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q97vq\" (UniqueName: \"kubernetes.io/projected/f11a004b-f309-4625-835c-ff8cf96c2929-kube-api-access-q97vq\") pod \"perf-node-gather-daemonset-29vhh\" (UID: \"f11a004b-f309-4625-835c-ff8cf96c2929\") " pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.279461 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.279429 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:15.409796 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:15.409740 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh"] Jul 15 20:17:15.412338 ip-10-0-139-43 kubenswrapper[2576]: W0715 20:17:15.412309 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf11a004b_f309_4625_835c_ff8cf96c2929.slice/crio-c166b86d371a36f577fdab0e611671aea89c41d5716f1295b8abaecafe5ec947 WatchSource:0}: Error finding container c166b86d371a36f577fdab0e611671aea89c41d5716f1295b8abaecafe5ec947: Status 404 returned error can't find the container with id c166b86d371a36f577fdab0e611671aea89c41d5716f1295b8abaecafe5ec947 Jul 15 20:17:16.260694 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:16.260659 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" event={"ID":"f11a004b-f309-4625-835c-ff8cf96c2929","Type":"ContainerStarted","Data":"d706eb3dcabf57d117d2844ad72146cae5a7f8b476404f0c83b7fc3356c1a861"} Jul 15 20:17:16.261098 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:16.260707 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" event={"ID":"f11a004b-f309-4625-835c-ff8cf96c2929","Type":"ContainerStarted","Data":"c166b86d371a36f577fdab0e611671aea89c41d5716f1295b8abaecafe5ec947"} Jul 15 20:17:16.261098 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:16.260796 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:16.277791 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:16.277744 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" podStartSLOduration=2.277730013 podStartE2EDuration="2.277730013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:17:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:17:16.276735654 +0000 UTC m=+2917.106142287" watchObservedRunningTime="2026-07-15 20:17:16.277730013 +0000 UTC m=+2917.107136672" Jul 15 20:17:17.188656 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:17.188623 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-65zbp_b17b42a6-5a2c-48ed-9832-72da1543b98e/dns/0.log" Jul 15 20:17:17.207529 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:17.207501 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-65zbp_b17b42a6-5a2c-48ed-9832-72da1543b98e/kube-rbac-proxy/0.log" Jul 15 20:17:17.327584 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:17.327555 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wvxs6_c1515d98-02a9-4074-962a-a34146ea1fd1/dns-node-resolver/0.log" Jul 15 20:17:17.855874 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:17.855848 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d5886ff86-f7ztn_45700e73-b422-4d3b-81b8-c74618b322c1/registry/0.log" Jul 15 20:17:17.875245 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:17.875220 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6724x_49d0c4b5-6e3d-4b82-b3b2-a6c6f37942be/node-ca/0.log" Jul 15 20:17:18.945560 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:18.945513 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-977sl_a33c32bb-6dd8-4d7c-abda-7be639b69cce/discovery/0.log" Jul 15 20:17:19.080776 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:19.080746 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-sjx2f_c006b388-0213-4418-bc49-7f5059a38bfb/payload-pre-processing/0.log" Jul 15 20:17:19.812886 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:19.812859 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-457fm_90a7d0ca-fa3f-47cc-a770-fa1151efb4bf/serve-healthcheck-canary/0.log" Jul 15 20:17:20.467670 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:20.467638 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r8dph_da77df0b-887a-4c53-82a8-69ee8556be83/kube-rbac-proxy/0.log" Jul 15 20:17:20.487514 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:20.487489 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r8dph_da77df0b-887a-4c53-82a8-69ee8556be83/exporter/0.log" Jul 15 20:17:20.506646 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:20.506616 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r8dph_da77df0b-887a-4c53-82a8-69ee8556be83/extractor/0.log" Jul 15 20:17:22.276380 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:22.276350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7q79m/perf-node-gather-daemonset-29vhh" Jul 15 20:17:23.165055 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:23.165023 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dd997468-zwmkp_607e80ad-00a7-4366-984b-5cbed905278d/manager/0.log" Jul 15 20:17:23.182033 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:23.182010 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dd997468-zwmkp_607e80ad-00a7-4366-984b-5cbed905278d/copy-manifests/0.log" Jul 15 20:17:24.600706 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:24.600674 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7784c86d4c-zrkr6_ab84315e-9ee2-4024-9c10-5f8fe63a05a8/manager/0.log" Jul 15 20:17:25.646991 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:25.646960 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-977sl_a33c32bb-6dd8-4d7c-abda-7be639b69cce/discovery/0.log" Jul 15 20:17:25.746232 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:25.746204 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-sjx2f_c006b388-0213-4418-bc49-7f5059a38bfb/payload-pre-processing/0.log" Jul 15 20:17:27.173154 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:27.173118 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-977sl_a33c32bb-6dd8-4d7c-abda-7be639b69cce/discovery/0.log" Jul 15 20:17:27.275936 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:27.275909 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-sjx2f_c006b388-0213-4418-bc49-7f5059a38bfb/payload-pre-processing/0.log" Jul 15 20:17:30.048934 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:30.048906 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-t5hbm_6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831/kube-storage-version-migrator-operator/1.log" Jul 15 20:17:30.049784 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:30.049766 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-t5hbm_6bddbb7f-e5a6-4108-95a5-b6d3e8cd0831/kube-storage-version-migrator-operator/0.log" Jul 15 20:17:31.060610 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:31.060584 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48hp5_8552de76-e2d1-4ae9-b054-e9c3ff8ceb12/kube-multus-additional-cni-plugins/0.log" Jul 15 20:17:31.085223 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:31.085194 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48hp5_8552de76-e2d1-4ae9-b054-e9c3ff8ceb12/egress-router-binary-copy/0.log" Jul 15 20:17:31.105227 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:31.105206 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48hp5_8552de76-e2d1-4ae9-b054-e9c3ff8ceb12/cni-plugins/0.log" Jul 15 20:17:31.123933 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:31.123905 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48hp5_8552de76-e2d1-4ae9-b054-e9c3ff8ceb12/bond-cni-plugin/0.log" Jul 15 20:17:31.143350 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:31.143330 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48hp5_8552de76-e2d1-4ae9-b054-e9c3ff8ceb12/routeoverride-cni/0.log" Jul 15 20:17:31.161423 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:31.161405 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48hp5_8552de76-e2d1-4ae9-b054-e9c3ff8ceb12/whereabouts-cni-bincopy/0.log" Jul 15 20:17:31.180277 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:31.180260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48hp5_8552de76-e2d1-4ae9-b054-e9c3ff8ceb12/whereabouts-cni/0.log" Jul 15 20:17:31.508196 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:31.508169 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sqjfn_d69a1fcd-fb8b-4f39-b083-0915ae531986/kube-multus/0.log" Jul 15 20:17:31.556092 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:31.556064 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6g5mh_996e2f7c-c517-41a8-a1f8-16bde57358e2/network-metrics-daemon/0.log" Jul 15 20:17:31.575455 ip-10-0-139-43 kubenswrapper[2576]: I0715 20:17:31.575432 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6g5mh_996e2f7c-c517-41a8-a1f8-16bde57358e2/kube-rbac-proxy/0.log"