Jul 14 14:44:44.235363 ip-10-0-142-186 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 14:44:44.235379 ip-10-0-142-186 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 14:44:44.235388 ip-10-0-142-186 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 14:44:44.235768 ip-10-0-142-186 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 14:44:54.347875 ip-10-0-142-186 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 14:44:54.347897 ip-10-0-142-186 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 441c349b82684a8ebf93089c85af93fd -- Jul 14 14:46:42.133980 ip-10-0-142-186 systemd[1]: Starting Kubernetes Kubelet... Jul 14 14:46:42.451804 ip-10-0-142-186 kubenswrapper[2541]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 14:46:42.451804 ip-10-0-142-186 kubenswrapper[2541]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 14:46:42.451804 ip-10-0-142-186 kubenswrapper[2541]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 14:46:42.451804 ip-10-0-142-186 kubenswrapper[2541]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 14:46:42.451804 ip-10-0-142-186 kubenswrapper[2541]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 14:46:42.452667 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.452590 2541 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 14:46:42.456404 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456390 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:46:42.456404 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456404 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456407 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456411 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456414 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456417 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456420 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456423 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456425 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456428 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456430 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456433 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456435 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456437 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456440 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456443 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456446 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456449 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456452 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456454 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:46:42.456468 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456457 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456461 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456464 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456468 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456470 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456474 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456476 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456479 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456482 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456485 2541 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456487 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456490 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456492 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456495 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456497 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456500 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456502 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456504 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456507 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456510 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:46:42.456931 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456512 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456514 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456518 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456522 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456525 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456528 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456532 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456534 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456537 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456540 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456543 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456546 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456548 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456551 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456554 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456557 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456559 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456561 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456564 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:46:42.457400 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456567 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456569 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456572 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456574 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456576 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456579 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456581 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456583 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456586 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456588 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456591 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456594 2541 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456596 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456599 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456604 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456607 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456610 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456613 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456616 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456618 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:46:42.457867 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456621 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456623 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456626 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456629 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456631 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456634 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456637 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456640 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456643 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456646 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456649 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456652 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456654 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456657 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456660 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456662 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456665 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456667 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456670 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.456673 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:46:42.458377 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457365 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457372 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457374 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457378 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457380 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457383 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457388 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457392 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457395 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457400 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457405 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457409 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457412 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457415 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457418 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457421 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457423 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457426 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457429 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:46:42.458893 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457431 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457434 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457436 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457439 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457442 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457444 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457447 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457450 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457452 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457456 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457459 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457462 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457465 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457467 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457470 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457472 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457475 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457478 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457480 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:46:42.459448 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457482 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457485 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457488 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457491 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457494 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457497 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457499 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457501 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457504 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457506 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457508 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457511 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457514 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457516 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457519 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457521 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457524 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457526 2541 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457529 2541 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457531 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:46:42.460206 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457533 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457536 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457538 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457541 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457543 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457545 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457548 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457550 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457553 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457555 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457558 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457560 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457563 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457565 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457568 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457571 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457574 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457576 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457578 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:46:42.460875 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457581 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457583 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457586 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457588 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457591 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457594 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457596 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457598 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457601 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457603 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457606 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457608 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457610 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457613 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457616 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457618 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457620 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457623 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457626 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457628 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:46:42.461324 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457631 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457633 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457990 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457995 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.457998 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458000 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458003 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458006 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458009 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458011 2541 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458014 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458016 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458019 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458024 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458027 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458030 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458032 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458035 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458037 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458040 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:46:42.461858 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458043 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458045 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458048 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458051 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458053 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458055 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458058 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458062 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458065 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458068 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458071 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458074 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458077 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458080 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458082 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458085 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458088 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458090 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458092 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:46:42.462341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458095 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458098 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458101 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458103 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458105 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458108 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458111 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458114 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458116 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458119 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458121 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458123 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458126 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458128 2541 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458130 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458133 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458135 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458138 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458140 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458143 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:46:42.462793 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458145 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458147 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458149 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458153 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458157 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458160 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458163 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458165 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458168 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458170 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458173 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458175 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458177 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458180 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458182 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458185 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458187 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458190 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458193 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:46:42.463284 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458196 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458198 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458561 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458564 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458566 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458569 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458571 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458574 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458576 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458579 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458581 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458583 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458586 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458588 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458591 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458593 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458595 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458599 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458601 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458604 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:46:42.463781 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458607 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458610 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.458613 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458682 2541 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458688 2541 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458694 2541 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458698 2541 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458717 2541 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458722 2541 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458728 2541 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458733 2541 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458740 2541 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458743 2541 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458747 2541 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458750 2541 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458753 2541 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458755 2541 flags.go:64] FLAG: --cgroup-root="" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458758 2541 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458761 2541 flags.go:64] FLAG: --client-ca-file="" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458764 2541 flags.go:64] FLAG: --cloud-provider="external" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458766 2541 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458770 2541 flags.go:64] FLAG: --cluster-domain="" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458773 2541 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 14:46:42.464304 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458776 2541 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458779 2541 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458782 2541 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458786 2541 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458789 2541 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458792 2541 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458795 2541 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458798 2541 flags.go:64] FLAG: --contention-profiling="false" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458801 2541 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458803 2541 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458806 2541 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458809 2541 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458813 2541 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458816 2541 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458819 2541 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458821 2541 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458824 2541 flags.go:64] FLAG: --enable-server="true" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458827 2541 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458831 2541 flags.go:64] FLAG: --event-burst="100" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458834 2541 flags.go:64] FLAG: --event-qps="50" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458838 2541 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458841 2541 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458844 2541 flags.go:64] FLAG: --eviction-hard="" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458848 2541 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 14:46:42.464859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458850 2541 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458853 2541 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458856 2541 flags.go:64] FLAG: --eviction-soft="" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458858 2541 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458861 2541 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458865 2541 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458868 2541 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458871 2541 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458873 2541 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458876 2541 flags.go:64] FLAG: --feature-gates="" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458880 2541 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458883 2541 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458886 2541 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458889 2541 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458891 2541 flags.go:64] FLAG: --healthz-port="10248" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458894 2541 flags.go:64] FLAG: --help="false" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458897 2541 flags.go:64] FLAG: --hostname-override="ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458901 2541 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458904 2541 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458907 2541 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458910 2541 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458913 2541 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458916 2541 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 14:46:42.465420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458918 2541 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458921 2541 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458923 2541 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458926 2541 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458929 2541 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458933 2541 flags.go:64] FLAG: --kube-reserved="" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458936 2541 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458939 2541 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458942 2541 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458944 2541 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458947 2541 flags.go:64] FLAG: --lock-file="" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458949 2541 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458952 2541 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458955 2541 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458961 2541 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458964 2541 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458966 2541 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458969 2541 flags.go:64] FLAG: --logging-format="text" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458972 2541 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458975 2541 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458978 2541 flags.go:64] FLAG: --manifest-url="" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458980 2541 flags.go:64] FLAG: --manifest-url-header="" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458984 2541 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458987 2541 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458991 2541 flags.go:64] FLAG: --max-pods="110" Jul 14 14:46:42.466030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458994 2541 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458996 2541 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.458999 2541 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459002 2541 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459004 2541 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459007 2541 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459010 2541 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459016 2541 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459019 2541 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459021 2541 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459024 2541 flags.go:64] FLAG: --pod-cidr="" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459027 2541 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459032 2541 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459036 2541 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459039 2541 flags.go:64] FLAG: --pods-per-core="0" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459042 2541 flags.go:64] FLAG: --port="10250" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459044 2541 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459047 2541 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-006a7c587bd10a4af" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459050 2541 flags.go:64] FLAG: --qos-reserved="" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459053 2541 flags.go:64] FLAG: --read-only-port="10255" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459056 2541 flags.go:64] FLAG: --register-node="true" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459060 2541 flags.go:64] FLAG: --register-with-taints="" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459063 2541 flags.go:64] FLAG: --registry-burst="10" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459066 2541 flags.go:64] FLAG: --registry-qps="5" Jul 14 14:46:42.466662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459069 2541 flags.go:64] FLAG: --reserved-cpus="" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459071 2541 flags.go:64] FLAG: --reserved-memory="" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459074 2541 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459077 2541 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459080 2541 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459083 2541 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459085 2541 flags.go:64] FLAG: --runonce="false" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459088 2541 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459091 2541 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459094 2541 flags.go:64] FLAG: --seccomp-default="false" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459096 2541 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459099 2541 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459102 2541 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459104 2541 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459107 2541 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459109 2541 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459112 2541 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459114 2541 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459117 2541 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459120 2541 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459123 2541 flags.go:64] FLAG: --system-cgroups="" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459127 2541 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459132 2541 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459135 2541 flags.go:64] FLAG: --tls-cert-file="" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459138 2541 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 14:46:42.467250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459141 2541 flags.go:64] FLAG: --tls-min-version="" Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459143 2541 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459146 2541 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459149 2541 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459153 2541 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459156 2541 flags.go:64] FLAG: --v="2" Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459159 2541 flags.go:64] FLAG: --version="false" Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459163 2541 flags.go:64] FLAG: --vmodule="" Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459166 2541 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.459169 2541 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459821 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459834 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459840 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459844 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459849 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459853 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459857 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459862 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459866 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459871 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459875 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459884 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:46:42.467857 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459889 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459893 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459897 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459901 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459906 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459910 2541 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459917 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459922 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459927 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459931 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459936 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459940 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459949 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459953 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459959 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459963 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459967 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459971 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459978 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459983 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:46:42.468393 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459988 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459992 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.459997 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460001 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460010 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460014 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460018 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460023 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460027 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460031 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460035 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460039 2541 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460043 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460047 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460051 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460055 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460059 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460068 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460074 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:46:42.468886 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460078 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460083 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460087 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460092 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460096 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460100 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460104 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460111 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460116 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460120 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460129 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460133 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460137 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460142 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460145 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460150 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460154 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460158 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460162 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:46:42.469336 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460167 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460171 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460176 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460203 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460208 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460233 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460237 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460242 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460247 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460399 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460410 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460415 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460419 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460422 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460427 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460431 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460434 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460437 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460440 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:46:42.469987 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460443 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460446 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460448 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460451 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460453 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460456 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460458 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460461 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460463 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.460466 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.461107 2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.467482 2541 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.467498 2541 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.468173 2541 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.468180 2541 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 14:46:42.470441 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468242 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468247 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468251 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468255 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468259 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468263 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468266 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468269 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468272 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468276 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468279 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468282 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468285 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468287 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468290 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468292 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468295 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468297 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468300 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:46:42.470873 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468302 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468305 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468307 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468310 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468312 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468314 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468317 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468319 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468322 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468325 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468328 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468331 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468333 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468336 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468338 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468341 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468343 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468346 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468348 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:46:42.471328 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468351 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468355 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468358 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468361 2541 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468364 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468366 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468370 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468373 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468375 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468378 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468380 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468383 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468385 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468388 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468390 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468393 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468395 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468398 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468400 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:46:42.471804 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468403 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468406 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468408 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468411 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468414 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468416 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468419 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468421 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468424 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468426 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468429 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468431 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468434 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468436 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468439 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468441 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468443 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468446 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468448 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468451 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:46:42.472289 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468457 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468460 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468462 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468465 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468468 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468470 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468473 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468475 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468478 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468480 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468483 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468485 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468487 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468490 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468492 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468495 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468498 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468500 2541 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468503 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468506 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:46:42.472825 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468509 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468511 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.468517 2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468624 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468628 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468631 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468634 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468637 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468640 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468642 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468645 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468647 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468650 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468653 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468655 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:46:42.473341 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468658 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468660 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468662 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468665 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468667 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468670 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468672 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468675 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468677 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468679 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468682 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468684 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468687 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468690 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468692 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468694 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468697 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468717 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468720 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:46:42.473925 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468723 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468725 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468728 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468731 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468733 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468736 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468738 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468741 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468743 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468746 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468748 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468750 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468754 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468756 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468759 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468761 2541 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468764 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468766 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468769 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468771 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:46:42.474495 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468774 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468776 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468778 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468781 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468783 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468786 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468789 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468792 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468794 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468797 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468799 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468802 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468805 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468809 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468812 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468814 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468817 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468820 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468823 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:46:42.475097 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468826 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468829 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468831 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468834 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468837 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468839 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468842 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468845 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468847 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468849 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468852 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468854 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468857 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468859 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468861 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468864 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468866 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468868 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468871 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468874 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:46:42.475882 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468877 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468879 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468882 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468884 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468887 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468890 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468892 2541 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468895 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:42.468897 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.468902 2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.468994 2541 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.472199 2541 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.473338 2541 server.go:1019] "Starting client certificate rotation" Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.473454 2541 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 14:46:42.476406 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.473504 2541 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 14:46:42.476946 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.475331 2541 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 14:46:42.476946 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.476395 2541 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 14:46:42.486632 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.486615 2541 log.go:25] "Validated CRI v1 runtime API" Jul 14 14:46:42.488535 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.488522 2541 log.go:25] "Validated CRI v1 image API" Jul 14 14:46:42.492516 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.492500 2541 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 14:46:42.495314 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.495295 2541 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a7bf5a71-1e87-4c35-910d-9815963d5366:/dev/nvme0n1p3 f1eae2a8-5995-4e27-81fa-a50f397bf8d1:/dev/nvme0n1p4] Jul 14 14:46:42.495389 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.495315 2541 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 14:46:42.501447 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.501331 2541 manager.go:216] Machine: {Timestamp:2026-07-14 14:46:42.500824503 +0000 UTC m=+0.272399830 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3126419 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b5a4c877c25d49a9a58eb9d56be88 SystemUUID:ec2b5a4c-877c-25d4-9a9a-58eb9d56be88 BootID:441c349b-8268-4a8e-bf93-089c85af93fd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:18:9b:35:37:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:18:9b:35:37:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:e9:8f:6f:c3:61 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 14:46:42.501447 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.501438 2541 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 14:46:42.501605 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.501511 2541 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 14:46:42.502517 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.502491 2541 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 14:46:42.502662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.502517 2541 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 14:46:42.503164 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.503152 2541 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 14:46:42.503223 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.503172 2541 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 14:46:42.503223 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.503182 2541 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 14:46:42.503812 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.503800 2541 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 14:46:42.504610 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.504599 2541 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 14:46:42.504931 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.504913 2541 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 14:46:42.508826 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.508812 2541 state_mem.go:36] "Initialized new in-memory state store" Jul 14 14:46:42.508955 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.508944 2541 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 14:46:42.509011 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.508981 2541 kubelet.go:486] "Attempting to sync node with API server" Jul 14 14:46:42.509011 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.508995 2541 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 14:46:42.509011 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.509010 2541 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 14:46:42.509130 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.509022 2541 kubelet.go:398] "Adding apiserver pod source" Jul 14 14:46:42.509130 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.509035 2541 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 14:46:42.509377 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.509364 2541 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 14:46:42.509438 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.509389 2541 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 14:46:42.511051 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.511036 2541 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 14:46:42.512198 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512186 2541 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 14:46:42.512243 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512223 2541 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 14:46:42.512857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512844 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 14:46:42.512892 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512860 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 14:46:42.512892 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512866 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 14:46:42.512892 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512872 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 14:46:42.512892 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512880 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 14:46:42.512892 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512886 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 14:46:42.512892 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512894 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 14:46:42.513039 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512899 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 14:46:42.513039 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512906 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 14:46:42.513039 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512912 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 14:46:42.513039 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512920 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 14:46:42.513039 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.512925 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 14:46:42.514102 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.514092 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 14:46:42.514102 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.514102 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 14:46:42.517106 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.517092 2541 server.go:1268] "Started kubelet" Jul 14 14:46:42.517194 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.517175 2541 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 14:46:42.517247 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.517221 2541 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 14:46:42.517614 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.517455 2541 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 14:46:42.518019 ip-10-0-142-186 systemd[1]: Started Kubernetes Kubelet. Jul 14 14:46:42.518375 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.518338 2541 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 14:46:42.520559 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.520544 2541 server.go:310] "Adding debug handlers to kubelet server" Jul 14 14:46:42.521417 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.521393 2541 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 14:46:42.522347 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.522326 2541 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 14:46:42.522347 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.522342 2541 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 14:46:42.522503 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.522469 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:42.522964 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.522945 2541 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 14:46:42.523051 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.522946 2541 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 14:46:42.523051 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.522978 2541 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 14:46:42.523320 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.523248 2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 14:46:42.523320 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.523261 2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 14:46:42.523320 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.523316 2541 reconstruct.go:97] "Volume reconstruction finished" Jul 14 14:46:42.523454 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.523332 2541 reconciler.go:29] "Reconciler: start to sync state" Jul 14 14:46:42.523535 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.523511 2541 factory.go:55] Registering systemd factory Jul 14 14:46:42.523535 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.523531 2541 factory.go:223] Registration of the systemd container factory successfully Jul 14 14:46:42.525776 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.525645 2541 factory.go:153] Registering CRI-O factory Jul 14 14:46:42.525870 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.525787 2541 factory.go:223] Registration of the crio container factory successfully Jul 14 14:46:42.525870 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.525852 2541 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 14:46:42.525966 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.525882 2541 factory.go:103] Registering Raw factory Jul 14 14:46:42.526078 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.523494 2541 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-186.ec2.internal.18c22f4b38f98572 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-186.ec2.internal,UID:ip-10-0-142-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-186.ec2.internal,},FirstTimestamp:2026-07-14 14:46:42.517067122 +0000 UTC m=+0.288642450,LastTimestamp:2026-07-14 14:46:42.517067122 +0000 UTC m=+0.288642450,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-186.ec2.internal,}" Jul 14 14:46:42.526164 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.526082 2541 manager.go:1196] Started watching for new ooms in manager Jul 14 14:46:42.526164 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.523757 2541 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 14:46:42.526773 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.526755 2541 manager.go:349] Starting recovery of all containers Jul 14 14:46:42.534208 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.534059 2541 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8ddzp" Jul 14 14:46:42.534915 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.534873 2541 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 14:46:42.536438 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.536396 2541 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 14:46:42.536519 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.536471 2541 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 14:46:42.539397 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.539374 2541 manager.go:354] Recovery completed Jul 14 14:46:42.543479 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.543460 2541 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8ddzp" Jul 14 14:46:42.543653 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.543640 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:46:42.545731 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.545716 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:46:42.545796 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.545743 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:46:42.545796 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.545759 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:46:42.546221 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.546209 2541 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 14:46:42.546280 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.546221 2541 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 14:46:42.546280 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.546238 2541 state_mem.go:36] "Initialized new in-memory state store" Jul 14 14:46:42.546280 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.546271 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:46:42.548097 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.548028 2541 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-186.ec2.internal.18c22f4b3aaee318 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-186.ec2.internal,UID:ip-10-0-142-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-186.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-186.ec2.internal,},FirstTimestamp:2026-07-14 14:46:42.545730328 +0000 UTC m=+0.317305659,LastTimestamp:2026-07-14 14:46:42.545730328 +0000 UTC m=+0.317305659,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-186.ec2.internal,}" Jul 14 14:46:42.548266 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.548249 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:46:42.548356 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.548282 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:46:42.548356 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.548296 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:46:42.548356 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.548354 2541 policy_none.go:49] "None policy: Start" Jul 14 14:46:42.548499 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.548371 2541 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 14:46:42.548499 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.548385 2541 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 14:46:42.550423 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.550410 2541 policy_none.go:47] "Start" Jul 14 14:46:42.583198 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.583184 2541 manager.go:337] "Starting Device Plugin manager" Jul 14 14:46:42.583266 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.583217 2541 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 14:46:42.583266 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.583227 2541 server.go:87] "Starting device plugin registration server" Jul 14 14:46:42.583411 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.583399 2541 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 14:46:42.583460 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.583410 2541 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 14:46:42.583511 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.583495 2541 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 14:46:42.583585 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.583573 2541 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 14:46:42.583632 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.583588 2541 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 14:46:42.584127 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.584111 2541 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 14:46:42.584197 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.584157 2541 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:42.628574 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.628552 2541 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 14:46:42.635673 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.628586 2541 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 14:46:42.635673 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.628603 2541 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 14:46:42.635673 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.628631 2541 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 14:46:42.635673 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.631068 2541 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:46:42.684279 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.684258 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:46:42.685133 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.685116 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:46:42.685214 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.685149 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:46:42.685214 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.685165 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:46:42.685214 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.685191 2541 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.693684 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.693669 2541 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.693762 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.693694 2541 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-186.ec2.internal\": node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:42.709522 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.709481 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:42.728824 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.728804 2541 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal"] Jul 14 14:46:42.728890 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.728855 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:46:42.729514 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.729501 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:46:42.729572 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.729524 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:46:42.729572 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.729533 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:46:42.731912 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.731901 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:46:42.732028 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.732014 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.732074 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.732040 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:46:42.732557 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.732543 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:46:42.732621 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.732566 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:46:42.732621 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.732545 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:46:42.732621 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.732575 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:46:42.732621 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.732585 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:46:42.732621 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.732594 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:46:42.734848 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.734836 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.734915 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.734858 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:46:42.735467 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.735451 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:46:42.735550 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.735484 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:46:42.735550 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.735498 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:46:42.751247 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.751229 2541 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-186.ec2.internal\" not found" node="ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.755561 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.755546 2541 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-186.ec2.internal\" not found" node="ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.809751 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.809731 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:42.825803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.825784 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.825861 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.825812 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.825861 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.825835 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/065a773ad515b5bc840f4897c38a83d1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-186.ec2.internal\" (UID: \"065a773ad515b5bc840f4897c38a83d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.910766 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:42.910739 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:42.926177 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.926139 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.926280 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.926186 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.926280 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.926210 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/065a773ad515b5bc840f4897c38a83d1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-186.ec2.internal\" (UID: \"065a773ad515b5bc840f4897c38a83d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.926280 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.926256 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/065a773ad515b5bc840f4897c38a83d1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-186.ec2.internal\" (UID: \"065a773ad515b5bc840f4897c38a83d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.926396 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.926256 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 14 14:46:42.926396 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:42.926257 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 14 14:46:43.011566 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:43.011501 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:43.054072 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:43.054040 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 14 14:46:43.057863 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:43.057845 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 14 14:46:43.111649 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:43.111623 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:43.212147 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:43.212126 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:43.312726 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:43.312629 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:43.360267 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:43.360242 2541 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:46:43.413624 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:43.413601 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:44.689042 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:44.689022 2541 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 14:46:44.689577 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:44.689141 2541 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 14:46:44.689577 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:44.689180 2541 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 14:46:44.722960 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:44.722939 2541 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:46:44.729762 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:44.729744 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:44.763965 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:44.763934 2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 14:41:43 +0000 UTC" deadline="2028-02-02 22:03:15.444140698 +0000 UTC" Jul 14 14:46:44.763965 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:44.763962 2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13639h16m30.680181965s" Jul 14 14:46:44.830302 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:44.830248 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:44.930827 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:44.930762 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:44.982367 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:44.982319 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01791c68bd38683d67bccbd056d2f10.slice/crio-61a17338a686a9d04bf8bfc91d80fc752c3ee35eb7084e98edd5c39304646294 WatchSource:0}: Error finding container 61a17338a686a9d04bf8bfc91d80fc752c3ee35eb7084e98edd5c39304646294: Status 404 returned error can't find the container with id 61a17338a686a9d04bf8bfc91d80fc752c3ee35eb7084e98edd5c39304646294 Jul 14 14:46:44.982583 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:44.982564 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod065a773ad515b5bc840f4897c38a83d1.slice/crio-3b8bb7f9cf585c89e4a30d243bb13cd33d7c98280fb34bddfca47d3283c20fc0 WatchSource:0}: Error finding container 3b8bb7f9cf585c89e4a30d243bb13cd33d7c98280fb34bddfca47d3283c20fc0: Status 404 returned error can't find the container with id 3b8bb7f9cf585c89e4a30d243bb13cd33d7c98280fb34bddfca47d3283c20fc0 Jul 14 14:46:44.986641 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:44.986610 2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 14:46:45.031831 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.031810 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 14 14:46:45.097824 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.097752 2541 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:46:45.138981 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.138954 2541 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 14 14:46:45.150222 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.150205 2541 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 14:46:45.151043 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.151031 2541 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 14 14:46:45.159626 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.159605 2541 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 14:46:45.725760 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.725723 2541 apiserver.go:52] "Watching apiserver" Jul 14 14:46:45.733875 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.733851 2541 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 14:46:45.734497 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.734445 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-76rll","openshift-dns/node-resolver-2xlbv","openshift-multus/multus-htn7w","openshift-network-operator/iptables-alerter-ztw2l","openshift-ovn-kubernetes/ovnkube-node-vxtlv","kube-system/global-pull-secret-syncer-drxfb","kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2","openshift-image-registry/node-ca-wzkz8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal","openshift-multus/multus-additional-cni-plugins-7tcll","openshift-multus/network-metrics-daemon-wzbf5","openshift-network-diagnostics/network-check-target-x4wsf","kube-system/konnectivity-agent-cnffx"] Jul 14 14:46:45.737119 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.737092 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:45.737207 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.737178 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:46:45.739413 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.739383 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ztw2l" Jul 14 14:46:45.739838 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.739816 2541 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 14:46:45.741632 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.741597 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.742942 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.742922 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:46:45.742942 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.742922 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k5pfq\"" Jul 14 14:46:45.743070 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.743011 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 14:46:45.743070 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.743012 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 14:46:45.745064 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.745045 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qdp6g\"" Jul 14 14:46:45.745248 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.745234 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 14:46:45.745792 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.745761 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:46:45.747809 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.746091 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.749347 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.748668 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 14:46:45.749347 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.749157 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wzkz8" Jul 14 14:46:45.749519 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.749382 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 14:46:45.749869 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.749662 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-spkfr\"" Jul 14 14:46:45.749869 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.749673 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 14:46:45.752647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.751702 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 14:46:45.752647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.751978 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w9qfl\"" Jul 14 14:46:45.752647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752181 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 14:46:45.752647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752335 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 14:46:45.752647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752526 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-modprobe-d\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.752647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752543 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-sysctl-d\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.752647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752558 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-sysctl-conf\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.752647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752572 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-run\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.752647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752588 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-tmp\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.752647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752611 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfpjr\" (UniqueName: \"kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr\") pod \"network-check-target-x4wsf\" (UID: \"1d142ebc-14cc-4663-9b48-5bed0b839e73\") " pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:45.752647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752655 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-sysconfig\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.753081 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752677 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/991bf242-0c8b-4c74-a67a-6322a65d0a5e-iptables-alerter-script\") pod \"iptables-alerter-ztw2l\" (UID: \"991bf242-0c8b-4c74-a67a-6322a65d0a5e\") " pod="openshift-network-operator/iptables-alerter-ztw2l" Jul 14 14:46:45.753081 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752701 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcqdd\" (UniqueName: \"kubernetes.io/projected/991bf242-0c8b-4c74-a67a-6322a65d0a5e-kube-api-access-xcqdd\") pod \"iptables-alerter-ztw2l\" (UID: \"991bf242-0c8b-4c74-a67a-6322a65d0a5e\") " pod="openshift-network-operator/iptables-alerter-ztw2l" Jul 14 14:46:45.753081 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752721 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-sys\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.753081 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752740 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-lib-modules\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.753081 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752759 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-var-lib-kubelet\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.753081 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752774 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gwf2\" (UniqueName: \"kubernetes.io/projected/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-kube-api-access-8gwf2\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.753081 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752790 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-kubernetes\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.753081 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752804 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-systemd\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.753081 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752824 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-host\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.753081 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752845 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-tuned\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.753081 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.752868 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/991bf242-0c8b-4c74-a67a-6322a65d0a5e-host-slash\") pod \"iptables-alerter-ztw2l\" (UID: \"991bf242-0c8b-4c74-a67a-6322a65d0a5e\") " pod="openshift-network-operator/iptables-alerter-ztw2l" Jul 14 14:46:45.753779 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.753235 2541 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 14:46:45.753779 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.753432 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:46:45.754188 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.754173 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.756132 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.755968 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 14:46:45.756132 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.756047 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 14:46:45.756132 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.756107 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-64vdp\"" Jul 14 14:46:45.756779 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.756723 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 14:46:45.756855 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.756778 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fnhjs\"" Jul 14 14:46:45.756855 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.756820 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 14:46:45.756961 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.756821 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 14:46:45.756961 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.756941 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 14:46:45.757060 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.757012 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 14:46:45.760559 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.760323 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:45.760559 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.760397 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:46:45.762501 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.762256 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2xlbv" Jul 14 14:46:45.764397 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.764377 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8kbr5\"" Jul 14 14:46:45.764657 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.764642 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 14:46:45.764830 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.764815 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 14:46:45.765825 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.765806 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.768315 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.767939 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9j5f7\"" Jul 14 14:46:45.768315 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.768127 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 14:46:45.770106 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.769378 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.771330 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.771309 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:45.771435 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.771377 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:46:45.773047 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.773027 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 14:46:45.773238 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.773221 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 14:46:45.773451 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.773434 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-524mk\"" Jul 14 14:46:45.773722 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.773703 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 14:46:45.773941 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.773889 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 14:46:45.774106 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.774088 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 14:46:45.774286 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.774272 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 14:46:45.776954 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.776804 2541 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x9czb" Jul 14 14:46:45.784710 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.784690 2541 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x9czb" Jul 14 14:46:45.839580 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.839556 2541 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 14:46:45.850300 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.850254 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" event={"ID":"065a773ad515b5bc840f4897c38a83d1","Type":"ContainerStarted","Data":"3b8bb7f9cf585c89e4a30d243bb13cd33d7c98280fb34bddfca47d3283c20fc0"} Jul 14 14:46:45.851988 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.851962 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" event={"ID":"e01791c68bd38683d67bccbd056d2f10","Type":"ContainerStarted","Data":"61a17338a686a9d04bf8bfc91d80fc752c3ee35eb7084e98edd5c39304646294"} Jul 14 14:46:45.853326 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853301 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-cni-netd\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.853404 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853341 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:45.853404 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853376 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-systemd\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.853404 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853399 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-etc-openvswitch\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.853560 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853424 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-modprobe-d\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.853560 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853447 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfpjr\" (UniqueName: \"kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr\") pod \"network-check-target-x4wsf\" (UID: \"1d142ebc-14cc-4663-9b48-5bed0b839e73\") " pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:45.853560 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853472 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-cni-dir\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.853560 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853495 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-var-lib-cni-bin\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.853560 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853518 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcqdd\" (UniqueName: \"kubernetes.io/projected/991bf242-0c8b-4c74-a67a-6322a65d0a5e-kube-api-access-xcqdd\") pod \"iptables-alerter-ztw2l\" (UID: \"991bf242-0c8b-4c74-a67a-6322a65d0a5e\") " pod="openshift-network-operator/iptables-alerter-ztw2l" Jul 14 14:46:45.853560 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853542 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.853860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853567 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.853860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853593 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-cnibin\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.853860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853630 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-node-log\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.853860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853654 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.853860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853677 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-sys\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.853860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853701 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-os-release\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.853860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853748 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-hostroot\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.853860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853774 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-ovnkube-config\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.853860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853798 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec5e38d0-07c1-4ec3-9d2d-310c5c41192f-agent-certs\") pod \"konnectivity-agent-cnffx\" (UID: \"ec5e38d0-07c1-4ec3-9d2d-310c5c41192f\") " pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:46:45.853860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853825 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-kubernetes\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.853860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853849 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-tuned\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853872 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/991bf242-0c8b-4c74-a67a-6322a65d0a5e-host-slash\") pod \"iptables-alerter-ztw2l\" (UID: \"991bf242-0c8b-4c74-a67a-6322a65d0a5e\") " pod="openshift-network-operator/iptables-alerter-ztw2l" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853896 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-os-release\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853930 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853955 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgg24\" (UniqueName: \"kubernetes.io/projected/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-kube-api-access-fgg24\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.853980 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41936526-5a0b-4f4a-b73b-114da1d56ac7-hosts-file\") pod \"node-resolver-2xlbv\" (UID: \"41936526-5a0b-4f4a-b73b-114da1d56ac7\") " pod="openshift-dns/node-resolver-2xlbv" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854005 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7544136c-f86b-4065-a311-c908c9fbb4e6-kubelet-config\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854031 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-sysctl-conf\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854063 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-socket-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854086 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-device-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854110 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-sys-fs\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854135 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec7482f3-a534-4bf4-808b-7605a929d1aa-host\") pod \"node-ca-wzkz8\" (UID: \"ec7482f3-a534-4bf4-808b-7605a929d1aa\") " pod="openshift-image-registry/node-ca-wzkz8" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854160 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-sysconfig\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854184 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxd9\" (UniqueName: \"kubernetes.io/projected/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-kube-api-access-8cxd9\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854214 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-cni-binary-copy\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854238 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-socket-dir-parent\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.854365 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854262 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-conf-dir\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854285 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-run-netns\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854308 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-run-systemd\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854332 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-var-lib-openvswitch\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854358 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gwf2\" (UniqueName: \"kubernetes.io/projected/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-kube-api-access-8gwf2\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854390 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-var-lib-kubelet\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854414 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-systemd-units\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854438 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-cni-bin\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854466 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec5e38d0-07c1-4ec3-9d2d-310c5c41192f-konnectivity-ca\") pod \"konnectivity-agent-cnffx\" (UID: \"ec5e38d0-07c1-4ec3-9d2d-310c5c41192f\") " pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854499 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec7482f3-a534-4bf4-808b-7605a929d1aa-serviceca\") pod \"node-ca-wzkz8\" (UID: \"ec7482f3-a534-4bf4-808b-7605a929d1aa\") " pod="openshift-image-registry/node-ca-wzkz8" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854523 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854552 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-run-netns\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854576 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-run-openvswitch\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854600 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-ovn-node-metrics-cert\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854646 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-sysctl-d\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854672 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-run\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854696 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxxfb\" (UniqueName: \"kubernetes.io/projected/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-kube-api-access-bxxfb\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.855099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854720 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-ovnkube-script-lib\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854751 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854776 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-system-cni-dir\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854801 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-cnibin\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854824 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-daemon-config\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854848 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-env-overrides\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854871 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41936526-5a0b-4f4a-b73b-114da1d56ac7-tmp-dir\") pod \"node-resolver-2xlbv\" (UID: \"41936526-5a0b-4f4a-b73b-114da1d56ac7\") " pod="openshift-dns/node-resolver-2xlbv" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854896 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzhdl\" (UniqueName: \"kubernetes.io/projected/41936526-5a0b-4f4a-b73b-114da1d56ac7-kube-api-access-rzhdl\") pod \"node-resolver-2xlbv\" (UID: \"41936526-5a0b-4f4a-b73b-114da1d56ac7\") " pod="openshift-dns/node-resolver-2xlbv" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854921 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l7hf\" (UniqueName: \"kubernetes.io/projected/ec7482f3-a534-4bf4-808b-7605a929d1aa-kube-api-access-7l7hf\") pod \"node-ca-wzkz8\" (UID: \"ec7482f3-a534-4bf4-808b-7605a929d1aa\") " pod="openshift-image-registry/node-ca-wzkz8" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854946 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-lib-modules\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.854971 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-var-lib-kubelet\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855003 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855026 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7544136c-f86b-4065-a311-c908c9fbb4e6-dbus\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855054 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855082 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-host\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855116 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-run-k8s-cni-cncf-io\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.855990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855141 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-var-lib-cni-multus\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855175 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cvgx\" (UniqueName: \"kubernetes.io/projected/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-kube-api-access-5cvgx\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855202 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-tmp\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855227 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855252 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-system-cni-dir\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855277 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-kubelet\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855302 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-slash\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855331 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-run-ovn\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855347 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-log-socket\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855362 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-registration-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855379 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/991bf242-0c8b-4c74-a67a-6322a65d0a5e-iptables-alerter-script\") pod \"iptables-alerter-ztw2l\" (UID: \"991bf242-0c8b-4c74-a67a-6322a65d0a5e\") " pod="openshift-network-operator/iptables-alerter-ztw2l" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855395 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-run-multus-certs\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855411 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-etc-kubernetes\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855426 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn9tl\" (UniqueName: \"kubernetes.io/projected/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-kube-api-access-bn9tl\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855526 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-systemd\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855632 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-modprobe-d\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.855910 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-sys\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.856803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.856083 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-sysctl-d\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.857587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.856214 2541 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 14:46:45.857587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.856541 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-run\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.857587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.856594 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-sysconfig\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.857587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.856655 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/991bf242-0c8b-4c74-a67a-6322a65d0a5e-host-slash\") pod \"iptables-alerter-ztw2l\" (UID: \"991bf242-0c8b-4c74-a67a-6322a65d0a5e\") " pod="openshift-network-operator/iptables-alerter-ztw2l" Jul 14 14:46:45.857587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.856772 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-sysctl-conf\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.857587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.856866 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-lib-modules\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.857587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.856911 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-var-lib-kubelet\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.857587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.857002 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-host\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.857587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.857093 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/991bf242-0c8b-4c74-a67a-6322a65d0a5e-iptables-alerter-script\") pod \"iptables-alerter-ztw2l\" (UID: \"991bf242-0c8b-4c74-a67a-6322a65d0a5e\") " pod="openshift-network-operator/iptables-alerter-ztw2l" Jul 14 14:46:45.857587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.857186 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-kubernetes\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.861021 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.860999 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-etc-tuned\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.861385 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.861366 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:46:45.861474 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.861391 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:46:45.861474 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.861404 2541 projected.go:196] Error preparing data for projected volume kube-api-access-bfpjr for pod openshift-network-diagnostics/network-check-target-x4wsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:46:45.861474 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.861470 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr podName:1d142ebc-14cc-4663-9b48-5bed0b839e73 nodeName:}" failed. No retries permitted until 2026-07-14 14:46:46.361450886 +0000 UTC m=+2.917112969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bfpjr" (UniqueName: "kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr") pod "network-check-target-x4wsf" (UID: "1d142ebc-14cc-4663-9b48-5bed0b839e73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:46:45.862975 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.862955 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-tmp\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.872220 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.872196 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcqdd\" (UniqueName: \"kubernetes.io/projected/991bf242-0c8b-4c74-a67a-6322a65d0a5e-kube-api-access-xcqdd\") pod \"iptables-alerter-ztw2l\" (UID: \"991bf242-0c8b-4c74-a67a-6322a65d0a5e\") " pod="openshift-network-operator/iptables-alerter-ztw2l" Jul 14 14:46:45.874706 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.874680 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gwf2\" (UniqueName: \"kubernetes.io/projected/81a8c2a8-d9e6-444f-9b64-3dfb9db591a9-kube-api-access-8gwf2\") pod \"tuned-76rll\" (UID: \"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9\") " pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:45.946786 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.946756 2541 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:46:45.955762 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.955724 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-etc-openvswitch\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.955911 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.955780 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-cni-dir\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.955911 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.955860 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-cni-dir\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.955911 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.955859 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-etc-openvswitch\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.955911 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.955896 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-var-lib-cni-bin\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.956030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.955924 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.956030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.955948 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.956030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.955970 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-cnibin\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.956030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.955991 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-node-log\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.956030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956014 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.956172 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956052 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-os-release\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.956172 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956075 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-hostroot\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.956172 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956098 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-ovnkube-config\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.956172 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956121 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec5e38d0-07c1-4ec3-9d2d-310c5c41192f-agent-certs\") pod \"konnectivity-agent-cnffx\" (UID: \"ec5e38d0-07c1-4ec3-9d2d-310c5c41192f\") " pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:46:45.956172 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956153 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-cnibin\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.956172 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956155 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-os-release\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.956342 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956195 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.956342 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956217 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-os-release\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.956342 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956225 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgg24\" (UniqueName: \"kubernetes.io/projected/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-kube-api-access-fgg24\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.956342 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956248 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41936526-5a0b-4f4a-b73b-114da1d56ac7-hosts-file\") pod \"node-resolver-2xlbv\" (UID: \"41936526-5a0b-4f4a-b73b-114da1d56ac7\") " pod="openshift-dns/node-resolver-2xlbv" Jul 14 14:46:45.956342 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956256 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-node-log\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.956342 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956263 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7544136c-f86b-4065-a311-c908c9fbb4e6-kubelet-config\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:45.956342 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956294 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-socket-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.956342 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956310 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-device-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.956342 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956324 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-sys-fs\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.956342 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956334 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-os-release\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.956608 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956362 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-var-lib-cni-bin\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.956608 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956372 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec7482f3-a534-4bf4-808b-7605a929d1aa-host\") pod \"node-ca-wzkz8\" (UID: \"ec7482f3-a534-4bf4-808b-7605a929d1aa\") " pod="openshift-image-registry/node-ca-wzkz8" Jul 14 14:46:45.956884 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956868 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.956925 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956905 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.956958 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956950 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-socket-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.956990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956963 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41936526-5a0b-4f4a-b73b-114da1d56ac7-hosts-file\") pod \"node-resolver-2xlbv\" (UID: \"41936526-5a0b-4f4a-b73b-114da1d56ac7\") " pod="openshift-dns/node-resolver-2xlbv" Jul 14 14:46:45.956990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956965 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-hostroot\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.956990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956293 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.957071 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.956338 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec7482f3-a534-4bf4-808b-7605a929d1aa-host\") pod \"node-ca-wzkz8\" (UID: \"ec7482f3-a534-4bf4-808b-7605a929d1aa\") " pod="openshift-image-registry/node-ca-wzkz8" Jul 14 14:46:45.957071 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957005 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7544136c-f86b-4065-a311-c908c9fbb4e6-kubelet-config\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:45.957071 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957035 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.957188 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957091 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-device-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.957188 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957134 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-sys-fs\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.957188 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957167 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxd9\" (UniqueName: \"kubernetes.io/projected/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-kube-api-access-8cxd9\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.957271 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957203 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-cni-binary-copy\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.957271 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957228 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-socket-dir-parent\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.957328 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957267 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-conf-dir\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.957328 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957291 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-run-netns\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.957328 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957315 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-run-systemd\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957447 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-var-lib-openvswitch\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957462 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-ovnkube-config\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957470 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-run-netns\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957479 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-var-lib-kubelet\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957503 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-socket-dir-parent\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957534 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-systemd-units\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957560 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-conf-dir\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957558 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-run-systemd\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957571 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-cni-bin\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957598 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-systemd-units\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957602 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-var-lib-openvswitch\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957632 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec5e38d0-07c1-4ec3-9d2d-310c5c41192f-konnectivity-ca\") pod \"konnectivity-agent-cnffx\" (UID: \"ec5e38d0-07c1-4ec3-9d2d-310c5c41192f\") " pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957607 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-cni-bin\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957661 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-var-lib-kubelet\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957666 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec7482f3-a534-4bf4-808b-7605a929d1aa-serviceca\") pod \"node-ca-wzkz8\" (UID: \"ec7482f3-a534-4bf4-808b-7605a929d1aa\") " pod="openshift-image-registry/node-ca-wzkz8" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957735 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957788 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-run-netns\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.958325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957837 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-run-netns\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957878 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-run-openvswitch\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957907 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-ovn-node-metrics-cert\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957937 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxxfb\" (UniqueName: \"kubernetes.io/projected/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-kube-api-access-bxxfb\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957961 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-ovnkube-script-lib\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.957985 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958010 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-system-cni-dir\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958034 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-cnibin\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958057 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-daemon-config\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958081 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-env-overrides\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958104 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41936526-5a0b-4f4a-b73b-114da1d56ac7-tmp-dir\") pod \"node-resolver-2xlbv\" (UID: \"41936526-5a0b-4f4a-b73b-114da1d56ac7\") " pod="openshift-dns/node-resolver-2xlbv" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958121 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec7482f3-a534-4bf4-808b-7605a929d1aa-serviceca\") pod \"node-ca-wzkz8\" (UID: \"ec7482f3-a534-4bf4-808b-7605a929d1aa\") " pod="openshift-image-registry/node-ca-wzkz8" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958128 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzhdl\" (UniqueName: \"kubernetes.io/projected/41936526-5a0b-4f4a-b73b-114da1d56ac7-kube-api-access-rzhdl\") pod \"node-resolver-2xlbv\" (UID: \"41936526-5a0b-4f4a-b73b-114da1d56ac7\") " pod="openshift-dns/node-resolver-2xlbv" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958151 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l7hf\" (UniqueName: \"kubernetes.io/projected/ec7482f3-a534-4bf4-808b-7605a929d1aa-kube-api-access-7l7hf\") pod \"node-ca-wzkz8\" (UID: \"ec7482f3-a534-4bf4-808b-7605a929d1aa\") " pod="openshift-image-registry/node-ca-wzkz8" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958165 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec5e38d0-07c1-4ec3-9d2d-310c5c41192f-konnectivity-ca\") pod \"konnectivity-agent-cnffx\" (UID: \"ec5e38d0-07c1-4ec3-9d2d-310c5c41192f\") " pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958441 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958478 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-run-openvswitch\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.959445 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958494 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-cnibin\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958498 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41936526-5a0b-4f4a-b73b-114da1d56ac7-tmp-dir\") pod \"node-resolver-2xlbv\" (UID: \"41936526-5a0b-4f4a-b73b-114da1d56ac7\") " pod="openshift-dns/node-resolver-2xlbv" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958542 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-system-cni-dir\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958589 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958656 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958696 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7544136c-f86b-4065-a311-c908c9fbb4e6-dbus\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958720 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958733 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-env-overrides\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958737 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-ovnkube-script-lib\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958758 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-run-k8s-cni-cncf-io\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.958815 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958832 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-cni-binary-copy\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958870 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-var-lib-cni-multus\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958877 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-run-k8s-cni-cncf-io\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958896 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cvgx\" (UniqueName: \"kubernetes.io/projected/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-kube-api-access-5cvgx\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958925 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-var-lib-cni-multus\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958900 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.958956 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7544136c-f86b-4065-a311-c908c9fbb4e6-dbus\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:45.960273 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959044 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959073 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-system-cni-dir\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959137 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-system-cni-dir\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.959144 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs podName:61182e15-0a65-44ab-a9f7-7e1bd827cd2f nodeName:}" failed. No retries permitted until 2026-07-14 14:46:46.459126324 +0000 UTC m=+3.014788405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs") pod "network-metrics-daemon-wzbf5" (UID: "61182e15-0a65-44ab-a9f7-7e1bd827cd2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959177 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-kubelet\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959206 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-slash\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959248 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-run-ovn\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959279 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-log-socket\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959296 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-kubelet\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959332 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-log-socket\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959334 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-slash\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959334 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-multus-daemon-config\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959364 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-registration-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959367 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-run-ovn\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959393 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959402 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-run-multus-certs\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959405 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-registration-dir\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.961101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959432 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-etc-kubernetes\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.961719 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959436 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-host-run-multus-certs\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.961719 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959459 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn9tl\" (UniqueName: \"kubernetes.io/projected/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-kube-api-access-bn9tl\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:45.961719 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959507 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-etc-kubernetes\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.961719 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959530 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-cni-netd\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.961719 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959646 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:45.961719 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.959695 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-host-cni-netd\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.961719 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.959753 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:46:45.961719 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:45.959794 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret podName:7544136c-f86b-4065-a311-c908c9fbb4e6 nodeName:}" failed. No retries permitted until 2026-07-14 14:46:46.459777825 +0000 UTC m=+3.015439892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret") pod "global-pull-secret-syncer-drxfb" (UID: "7544136c-f86b-4065-a311-c908c9fbb4e6") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:46:45.961719 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.960948 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-ovn-node-metrics-cert\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.961719 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.960974 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec5e38d0-07c1-4ec3-9d2d-310c5c41192f-agent-certs\") pod \"konnectivity-agent-cnffx\" (UID: \"ec5e38d0-07c1-4ec3-9d2d-310c5c41192f\") " pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:46:45.967258 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.966864 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l7hf\" (UniqueName: \"kubernetes.io/projected/ec7482f3-a534-4bf4-808b-7605a929d1aa-kube-api-access-7l7hf\") pod \"node-ca-wzkz8\" (UID: \"ec7482f3-a534-4bf4-808b-7605a929d1aa\") " pod="openshift-image-registry/node-ca-wzkz8" Jul 14 14:46:45.967258 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.967104 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxd9\" (UniqueName: \"kubernetes.io/projected/ae78b13c-dd26-4a0e-9de9-7bcfd1227f51-kube-api-access-8cxd9\") pod \"multus-additional-cni-plugins-7tcll\" (UID: \"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51\") " pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:45.967982 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.967601 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgg24\" (UniqueName: \"kubernetes.io/projected/c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd-kube-api-access-fgg24\") pod \"ovnkube-node-vxtlv\" (UID: \"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:45.967982 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.967795 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzhdl\" (UniqueName: \"kubernetes.io/projected/41936526-5a0b-4f4a-b73b-114da1d56ac7-kube-api-access-rzhdl\") pod \"node-resolver-2xlbv\" (UID: \"41936526-5a0b-4f4a-b73b-114da1d56ac7\") " pod="openshift-dns/node-resolver-2xlbv" Jul 14 14:46:45.968871 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.968828 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxxfb\" (UniqueName: \"kubernetes.io/projected/8e052f4b-3af7-4582-bacc-63e51d9dfe3f-kube-api-access-bxxfb\") pod \"multus-htn7w\" (UID: \"8e052f4b-3af7-4582-bacc-63e51d9dfe3f\") " pod="openshift-multus/multus-htn7w" Jul 14 14:46:45.969666 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.969645 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cvgx\" (UniqueName: \"kubernetes.io/projected/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-kube-api-access-5cvgx\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:45.970351 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:45.970333 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn9tl\" (UniqueName: \"kubernetes.io/projected/887bec1b-9be3-4bdc-9e26-2ed30cb26e1e-kube-api-access-bn9tl\") pod \"aws-ebs-csi-driver-node-kj7l2\" (UID: \"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:46.058109 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.058023 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ztw2l" Jul 14 14:46:46.066957 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.066928 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-76rll" Jul 14 14:46:46.076817 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.076792 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" Jul 14 14:46:46.083507 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.083489 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wzkz8" Jul 14 14:46:46.092669 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.092651 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:46:46.103282 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.103260 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7tcll" Jul 14 14:46:46.110992 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.110971 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2xlbv" Jul 14 14:46:46.120661 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.120641 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-htn7w" Jul 14 14:46:46.132420 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.132398 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:46:46.362607 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.362520 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfpjr\" (UniqueName: \"kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr\") pod \"network-check-target-x4wsf\" (UID: \"1d142ebc-14cc-4663-9b48-5bed0b839e73\") " pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:46.362762 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:46.362729 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:46:46.362762 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:46.362752 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:46:46.362762 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:46.362764 2541 projected.go:196] Error preparing data for projected volume kube-api-access-bfpjr for pod openshift-network-diagnostics/network-check-target-x4wsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:46:46.362859 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:46.362813 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr podName:1d142ebc-14cc-4663-9b48-5bed0b839e73 nodeName:}" failed. No retries permitted until 2026-07-14 14:46:47.362799249 +0000 UTC m=+3.918461316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfpjr" (UniqueName: "kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr") pod "network-check-target-x4wsf" (UID: "1d142ebc-14cc-4663-9b48-5bed0b839e73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:46:46.463128 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.463091 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:46.463305 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.463153 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:46.463305 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:46.463238 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:46:46.463305 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:46.463297 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:46:46.463467 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:46.463310 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs podName:61182e15-0a65-44ab-a9f7-7e1bd827cd2f nodeName:}" failed. No retries permitted until 2026-07-14 14:46:47.463287614 +0000 UTC m=+4.018949712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs") pod "network-metrics-daemon-wzbf5" (UID: "61182e15-0a65-44ab-a9f7-7e1bd827cd2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:46:46.463467 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:46.463342 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret podName:7544136c-f86b-4065-a311-c908c9fbb4e6 nodeName:}" failed. No retries permitted until 2026-07-14 14:46:47.46332965 +0000 UTC m=+4.018991717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret") pod "global-pull-secret-syncer-drxfb" (UID: "7544136c-f86b-4065-a311-c908c9fbb4e6") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:46:46.788103 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.788050 2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 14:41:45 +0000 UTC" deadline="2028-01-30 01:07:26.15870914 +0000 UTC" Jul 14 14:46:46.788103 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.788094 2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13546h20m39.370617702s" Jul 14 14:46:46.845526 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:46.845501 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:46.845682 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:46.845612 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:46:47.096576 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:47.096546 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e052f4b_3af7_4582_bacc_63e51d9dfe3f.slice/crio-3988aea0b00075ad9d16fea61466373d1d61bc0ab1d9312b68607bbac2a04f07 WatchSource:0}: Error finding container 3988aea0b00075ad9d16fea61466373d1d61bc0ab1d9312b68607bbac2a04f07: Status 404 returned error can't find the container with id 3988aea0b00075ad9d16fea61466373d1d61bc0ab1d9312b68607bbac2a04f07 Jul 14 14:46:47.100208 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:47.100186 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887bec1b_9be3_4bdc_9e26_2ed30cb26e1e.slice/crio-1db26eb69bfabb885a26a76cd7553d8040e1d12f52dcec50651bf15e2813c6db WatchSource:0}: Error finding container 1db26eb69bfabb885a26a76cd7553d8040e1d12f52dcec50651bf15e2813c6db: Status 404 returned error can't find the container with id 1db26eb69bfabb885a26a76cd7553d8040e1d12f52dcec50651bf15e2813c6db Jul 14 14:46:47.101110 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:47.101088 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a8c2a8_d9e6_444f_9b64_3dfb9db591a9.slice/crio-5c216a0d315999088c9823a13a5af43a94ef6ecc3a4fe4d2d1a73afda0bc0472 WatchSource:0}: Error finding container 5c216a0d315999088c9823a13a5af43a94ef6ecc3a4fe4d2d1a73afda0bc0472: Status 404 returned error can't find the container with id 5c216a0d315999088c9823a13a5af43a94ef6ecc3a4fe4d2d1a73afda0bc0472 Jul 14 14:46:47.101880 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:46:47.101854 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae78b13c_dd26_4a0e_9de9_7bcfd1227f51.slice/crio-01c4a5decde6daf4eab7f9ef21784f7ea2b0fa9ba87ba1ab9b5a93bf2d7abf0c WatchSource:0}: Error finding container 01c4a5decde6daf4eab7f9ef21784f7ea2b0fa9ba87ba1ab9b5a93bf2d7abf0c: Status 404 returned error can't find the container with id 01c4a5decde6daf4eab7f9ef21784f7ea2b0fa9ba87ba1ab9b5a93bf2d7abf0c Jul 14 14:46:47.369162 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.369081 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfpjr\" (UniqueName: \"kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr\") pod \"network-check-target-x4wsf\" (UID: \"1d142ebc-14cc-4663-9b48-5bed0b839e73\") " pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:47.369270 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:47.369227 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:46:47.369270 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:47.369246 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:46:47.369270 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:47.369257 2541 projected.go:196] Error preparing data for projected volume kube-api-access-bfpjr for pod openshift-network-diagnostics/network-check-target-x4wsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:46:47.369417 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:47.369321 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr podName:1d142ebc-14cc-4663-9b48-5bed0b839e73 nodeName:}" failed. No retries permitted until 2026-07-14 14:46:49.36930014 +0000 UTC m=+5.924962223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfpjr" (UniqueName: "kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr") pod "network-check-target-x4wsf" (UID: "1d142ebc-14cc-4663-9b48-5bed0b839e73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:46:47.469376 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.469351 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:47.469530 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.469398 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:47.469530 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:47.469489 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:46:47.469641 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:47.469544 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs podName:61182e15-0a65-44ab-a9f7-7e1bd827cd2f nodeName:}" failed. No retries permitted until 2026-07-14 14:46:49.469525482 +0000 UTC m=+6.025187551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs") pod "network-metrics-daemon-wzbf5" (UID: "61182e15-0a65-44ab-a9f7-7e1bd827cd2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:46:47.469641 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:47.469563 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:46:47.469641 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:47.469640 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret podName:7544136c-f86b-4065-a311-c908c9fbb4e6 nodeName:}" failed. No retries permitted until 2026-07-14 14:46:49.469603736 +0000 UTC m=+6.025265817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret") pod "global-pull-secret-syncer-drxfb" (UID: "7544136c-f86b-4065-a311-c908c9fbb4e6") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:46:47.522990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.522965 2541 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:46:47.789271 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.789194 2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 14:41:45 +0000 UTC" deadline="2028-03-11 02:40:28.797897769 +0000 UTC" Jul 14 14:46:47.789271 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.789241 2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14531h53m41.008661534s" Jul 14 14:46:47.847956 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.847279 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:47.847956 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:47.847411 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:46:47.847956 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.847811 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:47.847956 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:47.847902 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:46:47.864248 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.864216 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" event={"ID":"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd","Type":"ContainerStarted","Data":"78904569a40006885e68750a7d2f2c78e1c528d4dc23584733dbf762af3b4e77"} Jul 14 14:46:47.866776 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.866747 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ztw2l" event={"ID":"991bf242-0c8b-4c74-a67a-6322a65d0a5e","Type":"ContainerStarted","Data":"ab2884040cc19c5636775e90e214c0b1f43fa796bc48f4bdea96c88f702f62fd"} Jul 14 14:46:47.874197 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.874165 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cnffx" event={"ID":"ec5e38d0-07c1-4ec3-9d2d-310c5c41192f","Type":"ContainerStarted","Data":"e59adf4d35a2ad3a1850367dedf907a276e11206d87f6269516070a10b4679d9"} Jul 14 14:46:47.878553 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.878522 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wzkz8" event={"ID":"ec7482f3-a534-4bf4-808b-7605a929d1aa","Type":"ContainerStarted","Data":"b405ae339d9cf0350f2cf36cffb5c3999bff073825ad904e50c7de6c52d71862"} Jul 14 14:46:47.881583 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.881518 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tcll" event={"ID":"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51","Type":"ContainerStarted","Data":"01c4a5decde6daf4eab7f9ef21784f7ea2b0fa9ba87ba1ab9b5a93bf2d7abf0c"} Jul 14 14:46:47.891244 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.890720 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-htn7w" event={"ID":"8e052f4b-3af7-4582-bacc-63e51d9dfe3f","Type":"ContainerStarted","Data":"3988aea0b00075ad9d16fea61466373d1d61bc0ab1d9312b68607bbac2a04f07"} Jul 14 14:46:47.898052 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.897402 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" event={"ID":"065a773ad515b5bc840f4897c38a83d1","Type":"ContainerStarted","Data":"4f2860aea7ff14d2f4f48a35a96eff920dcef48652f74c1a6bb1960bcd071389"} Jul 14 14:46:47.903543 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.902954 2541 generic.go:356] "Generic (PLEG): container finished" podID="e01791c68bd38683d67bccbd056d2f10" containerID="6910f423110a74b612d83f7beab30ef99ba7eeda824d4c3330744ee73dfa0f8a" exitCode=0 Jul 14 14:46:47.903543 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.903025 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" event={"ID":"e01791c68bd38683d67bccbd056d2f10","Type":"ContainerDied","Data":"6910f423110a74b612d83f7beab30ef99ba7eeda824d4c3330744ee73dfa0f8a"} Jul 14 14:46:47.907023 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.906947 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2xlbv" event={"ID":"41936526-5a0b-4f4a-b73b-114da1d56ac7","Type":"ContainerStarted","Data":"f5b8fdccd8fa46748007766bc271438f82becad5034c5ff1f7e4eff51a620131"} Jul 14 14:46:47.911806 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.911741 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-76rll" event={"ID":"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9","Type":"ContainerStarted","Data":"5c216a0d315999088c9823a13a5af43a94ef6ecc3a4fe4d2d1a73afda0bc0472"} Jul 14 14:46:47.916546 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.916380 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" event={"ID":"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e","Type":"ContainerStarted","Data":"1db26eb69bfabb885a26a76cd7553d8040e1d12f52dcec50651bf15e2813c6db"} Jul 14 14:46:47.934909 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:47.934438 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" podStartSLOduration=2.93442565 podStartE2EDuration="2.93442565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:46:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:46:47.916175525 +0000 UTC m=+4.471837595" watchObservedRunningTime="2026-07-14 14:46:47.93442565 +0000 UTC m=+4.490087739" Jul 14 14:46:48.845418 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:48.845384 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:48.845896 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:48.845505 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:46:48.955147 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:48.955113 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" event={"ID":"e01791c68bd38683d67bccbd056d2f10","Type":"ContainerStarted","Data":"2322a25c90ff1a223873ffbf3fd705eb13bd9009330cc15521052e386be5026f"} Jul 14 14:46:49.384485 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:49.384442 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfpjr\" (UniqueName: \"kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr\") pod \"network-check-target-x4wsf\" (UID: \"1d142ebc-14cc-4663-9b48-5bed0b839e73\") " pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:49.385339 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:49.384806 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:46:49.385339 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:49.384835 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:46:49.385339 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:49.384848 2541 projected.go:196] Error preparing data for projected volume kube-api-access-bfpjr for pod openshift-network-diagnostics/network-check-target-x4wsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:46:49.385339 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:49.384943 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr podName:1d142ebc-14cc-4663-9b48-5bed0b839e73 nodeName:}" failed. No retries permitted until 2026-07-14 14:46:53.384924391 +0000 UTC m=+9.940586464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfpjr" (UniqueName: "kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr") pod "network-check-target-x4wsf" (UID: "1d142ebc-14cc-4663-9b48-5bed0b839e73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:46:49.485447 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:49.485410 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:49.485649 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:49.485511 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:49.485716 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:49.485667 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:46:49.485791 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:49.485729 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs podName:61182e15-0a65-44ab-a9f7-7e1bd827cd2f nodeName:}" failed. No retries permitted until 2026-07-14 14:46:53.485710411 +0000 UTC m=+10.041372482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs") pod "network-metrics-daemon-wzbf5" (UID: "61182e15-0a65-44ab-a9f7-7e1bd827cd2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:46:49.486242 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:49.486127 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:46:49.486242 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:49.486178 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret podName:7544136c-f86b-4065-a311-c908c9fbb4e6 nodeName:}" failed. No retries permitted until 2026-07-14 14:46:53.486163094 +0000 UTC m=+10.041825165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret") pod "global-pull-secret-syncer-drxfb" (UID: "7544136c-f86b-4065-a311-c908c9fbb4e6") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:46:49.848693 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:49.847816 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:49.848693 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:49.847971 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:46:49.848693 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:49.848448 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:49.848693 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:49.848552 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:46:50.845653 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:50.845473 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:50.845653 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:50.845583 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:46:51.845140 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:51.844748 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:51.845140 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:51.844791 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:51.845140 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:51.844864 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:46:51.845140 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:51.845051 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:46:52.846894 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:52.846854 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:52.847358 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:52.846987 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:46:53.420309 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:53.420265 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfpjr\" (UniqueName: \"kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr\") pod \"network-check-target-x4wsf\" (UID: \"1d142ebc-14cc-4663-9b48-5bed0b839e73\") " pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:53.420531 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:53.420449 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:46:53.420531 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:53.420474 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:46:53.420531 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:53.420488 2541 projected.go:196] Error preparing data for projected volume kube-api-access-bfpjr for pod openshift-network-diagnostics/network-check-target-x4wsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:46:53.420752 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:53.420556 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr podName:1d142ebc-14cc-4663-9b48-5bed0b839e73 nodeName:}" failed. No retries permitted until 2026-07-14 14:47:01.420536237 +0000 UTC m=+17.976198308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfpjr" (UniqueName: "kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr") pod "network-check-target-x4wsf" (UID: "1d142ebc-14cc-4663-9b48-5bed0b839e73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:46:53.520755 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:53.520714 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:53.520938 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:53.520809 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:53.520938 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:53.520883 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:46:53.521032 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:53.520951 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs podName:61182e15-0a65-44ab-a9f7-7e1bd827cd2f nodeName:}" failed. No retries permitted until 2026-07-14 14:47:01.520933091 +0000 UTC m=+18.076595160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs") pod "network-metrics-daemon-wzbf5" (UID: "61182e15-0a65-44ab-a9f7-7e1bd827cd2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:46:53.521032 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:53.520961 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:46:53.521032 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:53.521020 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret podName:7544136c-f86b-4065-a311-c908c9fbb4e6 nodeName:}" failed. No retries permitted until 2026-07-14 14:47:01.521002622 +0000 UTC m=+18.076664692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret") pod "global-pull-secret-syncer-drxfb" (UID: "7544136c-f86b-4065-a311-c908c9fbb4e6") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:46:53.846643 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:53.846556 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:53.846760 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:53.846671 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:46:53.846760 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:53.846729 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:53.846828 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:53.846807 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:46:54.844901 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:54.844869 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:54.845338 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:54.845007 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:46:55.846053 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:55.845708 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:55.846053 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:55.845854 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:46:55.847099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:55.846837 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:55.847099 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:55.846936 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:46:56.845596 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:56.845565 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:56.845778 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:56.845701 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:46:57.844875 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:57.844841 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:57.845228 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:57.844886 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:57.845228 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:57.844988 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:46:57.845228 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:57.845089 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:46:58.845247 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:58.845212 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:46:58.845700 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:58.845347 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:46:59.845404 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:59.845367 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:46:59.845838 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:59.845515 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:46:59.845838 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:46:59.845579 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:46:59.845838 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:46:59.845690 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:00.845731 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:00.845698 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:00.846105 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:00.845805 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:01.488070 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:01.488031 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfpjr\" (UniqueName: \"kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr\") pod \"network-check-target-x4wsf\" (UID: \"1d142ebc-14cc-4663-9b48-5bed0b839e73\") " pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:01.488258 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:01.488242 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:47:01.488310 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:01.488265 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:47:01.488310 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:01.488282 2541 projected.go:196] Error preparing data for projected volume kube-api-access-bfpjr for pod openshift-network-diagnostics/network-check-target-x4wsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:47:01.488399 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:01.488342 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr podName:1d142ebc-14cc-4663-9b48-5bed0b839e73 nodeName:}" failed. No retries permitted until 2026-07-14 14:47:17.488321343 +0000 UTC m=+34.043983434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfpjr" (UniqueName: "kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr") pod "network-check-target-x4wsf" (UID: "1d142ebc-14cc-4663-9b48-5bed0b839e73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:47:01.588951 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:01.588916 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:01.589109 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:01.588973 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:01.589109 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:01.589091 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:47:01.589109 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:01.589092 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:47:01.589275 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:01.589146 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret podName:7544136c-f86b-4065-a311-c908c9fbb4e6 nodeName:}" failed. No retries permitted until 2026-07-14 14:47:17.589132103 +0000 UTC m=+34.144794170 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret") pod "global-pull-secret-syncer-drxfb" (UID: "7544136c-f86b-4065-a311-c908c9fbb4e6") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:47:01.589517 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:01.589500 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs podName:61182e15-0a65-44ab-a9f7-7e1bd827cd2f nodeName:}" failed. No retries permitted until 2026-07-14 14:47:17.589482878 +0000 UTC m=+34.145144944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs") pod "network-metrics-daemon-wzbf5" (UID: "61182e15-0a65-44ab-a9f7-7e1bd827cd2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:47:01.845792 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:01.845715 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:01.846218 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:01.845850 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:01.846218 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:01.845907 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:01.846218 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:01.846052 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:02.845514 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:02.845437 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:02.845707 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:02.845566 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:03.846335 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:03.846306 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:03.846768 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:03.846401 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:03.846768 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:03.846492 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:03.846768 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:03.846604 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:04.845237 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:04.845205 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:04.845417 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:04.845322 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:05.845729 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:05.845242 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:05.845729 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:05.845371 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:05.845729 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:05.845428 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:05.845729 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:05.845537 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:06.845285 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:06.845122 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:06.845412 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:06.845369 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:06.993184 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:06.993017 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2xlbv" event={"ID":"41936526-5a0b-4f4a-b73b-114da1d56ac7","Type":"ContainerStarted","Data":"a2de3519746e1e4e795e0acd17400f9450fa80c5f50ceb4b4914af2853c8f0b9"} Jul 14 14:47:06.994353 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:06.994335 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-76rll" event={"ID":"81a8c2a8-d9e6-444f-9b64-3dfb9db591a9","Type":"ContainerStarted","Data":"26a4f4d23fec5ca6f35667876b31d0d6cf586cbb9ea9292e83bdb0b2bf8fde8c"} Jul 14 14:47:06.995698 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:06.995677 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" event={"ID":"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e","Type":"ContainerStarted","Data":"95a07b3a52f6fc235d8197c0ba6de1b33ade1ef345c80001672a528b4ee1d353"} Jul 14 14:47:06.997270 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:06.997253 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 14:47:07.000022 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:06.997818 2541 generic.go:356] "Generic (PLEG): container finished" podID="c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd" containerID="14374db3271df42df8e63bea370a090b0de267ba13263f8ddcedded7b85ad70f" exitCode=1 Jul 14 14:47:07.000022 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:06.997934 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" event={"ID":"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd","Type":"ContainerStarted","Data":"efba4036fc447e3a214c5c6103aff2571c76993461e73f63b837851723e1add7"} Jul 14 14:47:07.000022 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:06.998092 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" event={"ID":"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd","Type":"ContainerDied","Data":"14374db3271df42df8e63bea370a090b0de267ba13263f8ddcedded7b85ad70f"} Jul 14 14:47:07.000022 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:06.998175 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" event={"ID":"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd","Type":"ContainerStarted","Data":"0317ab1538f92e1a8af5cd05977445da297f8220b6a649c34017c7a7ce883318"} Jul 14 14:47:07.001937 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.001912 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cnffx" event={"ID":"ec5e38d0-07c1-4ec3-9d2d-310c5c41192f","Type":"ContainerStarted","Data":"0d23c60d55c477cbe5997b03e9f7f86441a452e6ff57de71c18d0a3d750a75fb"} Jul 14 14:47:07.003287 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.003259 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wzkz8" event={"ID":"ec7482f3-a534-4bf4-808b-7605a929d1aa","Type":"ContainerStarted","Data":"a1d5c238dc804e03bf0a0fc739a0732926b5c722cacc4148320bb0785b1adfb1"} Jul 14 14:47:07.004887 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.004867 2541 generic.go:356] "Generic (PLEG): container finished" podID="ae78b13c-dd26-4a0e-9de9-7bcfd1227f51" containerID="e0303fdbfca4c543017848bf4f2471f69a58dcaed2c39b8b78402fc7f330b8c9" exitCode=0 Jul 14 14:47:07.004998 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.004889 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tcll" event={"ID":"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51","Type":"ContainerDied","Data":"e0303fdbfca4c543017848bf4f2471f69a58dcaed2c39b8b78402fc7f330b8c9"} Jul 14 14:47:07.006347 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.006328 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-htn7w" event={"ID":"8e052f4b-3af7-4582-bacc-63e51d9dfe3f","Type":"ContainerStarted","Data":"a032110dc682bc6615c767150e3125daa0637991d416f5dc309d9c5ea068d5bb"} Jul 14 14:47:07.019133 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.019090 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" podStartSLOduration=22.019079323 podStartE2EDuration="22.019079323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:46:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:46:48.972872833 +0000 UTC m=+5.528534931" watchObservedRunningTime="2026-07-14 14:47:07.019079323 +0000 UTC m=+23.574741413" Jul 14 14:47:07.035850 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.035815 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-76rll" podStartSLOduration=4.715478116 podStartE2EDuration="24.035802111s" totalImagesPullingTime="19.320323995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:07.019830319 +0000 UTC m=+23.575492408" watchObservedRunningTime="2026-07-14 14:47:07.035802111 +0000 UTC m=+23.591464190" Jul 14 14:47:07.035983 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.035961 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2xlbv" podStartSLOduration=3.7925381700000003 podStartE2EDuration="23.035952078s" totalImagesPullingTime="19.243413908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:07.035768322 +0000 UTC m=+23.591430411" watchObservedRunningTime="2026-07-14 14:47:07.035952078 +0000 UTC m=+23.591614170" Jul 14 14:47:07.051149 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.051114 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wzkz8" podStartSLOduration=8.538428933 podStartE2EDuration="24.051101077s" totalImagesPullingTime="15.512672144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:07.05061017 +0000 UTC m=+23.606272280" watchObservedRunningTime="2026-07-14 14:47:07.051101077 +0000 UTC m=+23.606763166" Jul 14 14:47:07.087088 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.087050 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cnffx" podStartSLOduration=4.778512746 podStartE2EDuration="24.087037531s" totalImagesPullingTime="19.308524785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:07.08674964 +0000 UTC m=+23.642411729" watchObservedRunningTime="2026-07-14 14:47:07.087037531 +0000 UTC m=+23.642699620" Jul 14 14:47:07.845724 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.845698 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:07.845951 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:07.845796 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:07.845951 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:07.845854 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:07.845951 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:07.845931 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:08.012454 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.012432 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 14:47:08.013036 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.013006 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" event={"ID":"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd","Type":"ContainerStarted","Data":"a64ad860e05f7f0e0839a44d20f82098ce4b84c228bfc77be4d45d90ac883953"} Jul 14 14:47:08.013130 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.013090 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" event={"ID":"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd","Type":"ContainerStarted","Data":"c140a2897f68c91874c2518857e4bab54412e0cbf2c762d6974069469bdccb00"} Jul 14 14:47:08.013190 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.013143 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" event={"ID":"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd","Type":"ContainerStarted","Data":"edaf515fa78f298ac3764f83eef068294af93208581a457d2f302b6780a072ec"} Jul 14 14:47:08.015383 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.015363 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ztw2l" event={"ID":"991bf242-0c8b-4c74-a67a-6322a65d0a5e","Type":"ContainerStarted","Data":"35fd6125acaaab74944e89b0412b76b1f2767fc36399505a866a8d455d5b049f"} Jul 14 14:47:08.035050 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.035000 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-htn7w" podStartSLOduration=4.488485201 podStartE2EDuration="24.034985831s" totalImagesPullingTime="19.54650063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:07.104455846 +0000 UTC m=+23.660117936" watchObservedRunningTime="2026-07-14 14:47:08.034985831 +0000 UTC m=+24.590647920" Jul 14 14:47:08.035194 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.035168 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ztw2l" podStartSLOduration=5.718738994 podStartE2EDuration="25.035160328s" totalImagesPullingTime="19.316421334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:08.033793967 +0000 UTC m=+24.589456055" watchObservedRunningTime="2026-07-14 14:47:08.035160328 +0000 UTC m=+24.590822416" Jul 14 14:47:08.065192 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.065155 2541 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 14:47:08.808788 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.808232 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:47:08.809052 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.808921 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:47:08.813862 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.813779 2541 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T14:47:08.065172087Z","UUID":"067e81d5-e1ed-4c9c-8468-042338c60627","Handler":null,"Name":"","Endpoint":""} Jul 14 14:47:08.815284 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.815263 2541 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 14:47:08.815385 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.815345 2541 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 14:47:08.845736 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:08.845686 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:08.845882 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:08.845780 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:09.020514 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:09.020481 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" event={"ID":"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e","Type":"ContainerStarted","Data":"9b263d51262120b46cb44d11146f7f42dcbb6f68278b63a53515d0980696a5f3"} Jul 14 14:47:09.020945 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:09.020547 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:47:09.021480 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:09.021457 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cnffx" Jul 14 14:47:09.844838 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:09.844806 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:09.844838 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:09.844822 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:09.845175 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:09.844948 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:09.845332 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:09.845307 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:10.025714 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:10.025689 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 14:47:10.026216 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:10.026167 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" event={"ID":"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd","Type":"ContainerStarted","Data":"af3bcc07afd3f78e57c4aa73a6f778dd3224d330bd6254041e9b5a55ff8a35a6"} Jul 14 14:47:10.028698 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:10.028670 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" event={"ID":"887bec1b-9be3-4bdc-9e26-2ed30cb26e1e","Type":"ContainerStarted","Data":"6d59fbd3d92bf80c183fce223e11b1cdcdd11e3a0141be60d2e6a87e3a0df3c6"} Jul 14 14:47:10.048754 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:10.048713 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj7l2" podStartSLOduration=5.211618802 podStartE2EDuration="27.048697114s" totalImagesPullingTime="21.837078312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:46:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:10.048533435 +0000 UTC m=+26.604195523" watchObservedRunningTime="2026-07-14 14:47:10.048697114 +0000 UTC m=+26.604359203" Jul 14 14:47:10.844720 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:10.844690 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:10.844902 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:10.844786 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:11.845929 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:11.845693 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:11.846533 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:11.845693 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:11.846533 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:11.845942 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:11.846533 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:11.846043 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:12.034929 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:12.034910 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 14:47:12.035310 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:12.035287 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" event={"ID":"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd","Type":"ContainerStarted","Data":"1640431943b494455f67314c008e7e03ff957cf0a0156ae16734a4e1952ec7c7"} Jul 14 14:47:12.035562 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:12.035526 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:47:12.035790 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:12.035770 2541 scope.go:117] "RemoveContainer" containerID="14374db3271df42df8e63bea370a090b0de267ba13263f8ddcedded7b85ad70f" Jul 14 14:47:12.051289 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:12.051270 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:47:12.845653 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:12.845629 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:12.845815 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:12.845722 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:13.042327 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.042255 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 14:47:13.042911 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.042722 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" event={"ID":"c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd","Type":"ContainerStarted","Data":"13df26d52f825e050f34e43b6f956c316dbd3b8c7a9efb9062cdfeef8076e485"} Jul 14 14:47:13.042991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.042978 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:47:13.043067 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.043054 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:47:13.045163 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.045135 2541 generic.go:356] "Generic (PLEG): container finished" podID="ae78b13c-dd26-4a0e-9de9-7bcfd1227f51" containerID="db0bffaaa0158f727b93c9d9d6ae680a34ab93c8eb8e0663349150f30c9f4cc4" exitCode=0 Jul 14 14:47:13.045307 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.045184 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tcll" event={"ID":"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51","Type":"ContainerDied","Data":"db0bffaaa0158f727b93c9d9d6ae680a34ab93c8eb8e0663349150f30c9f4cc4"} Jul 14 14:47:13.067637 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.062098 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:47:13.082137 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.080144 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" podStartSLOduration=9.572563903 podStartE2EDuration="29.080126643s" totalImagesPullingTime="19.50756274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:13.079407507 +0000 UTC m=+29.635069582" watchObservedRunningTime="2026-07-14 14:47:13.080126643 +0000 UTC m=+29.635788734" Jul 14 14:47:13.846253 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.846101 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:13.846457 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:13.846314 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:13.846457 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.846189 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:13.846457 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:13.846374 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:13.923203 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.923168 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-drxfb"] Jul 14 14:47:13.928120 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.928093 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x4wsf"] Jul 14 14:47:13.928281 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.928242 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:13.928383 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:13.928355 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:13.929241 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:13.929219 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wzbf5"] Jul 14 14:47:14.047767 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:14.047696 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:14.048189 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:14.047696 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:14.048189 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:14.047830 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:14.048189 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:14.047945 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:14.291086 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:14.291064 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2xlbv_41936526-5a0b-4f4a-b73b-114da1d56ac7/dns-node-resolver/0.log" Jul 14 14:47:15.052041 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:15.052009 2541 generic.go:356] "Generic (PLEG): container finished" podID="ae78b13c-dd26-4a0e-9de9-7bcfd1227f51" containerID="a33a2aa0b0132eb1ee4b42e87023ca66abda43b8ccc31a00c5fa7b27e83fe72f" exitCode=0 Jul 14 14:47:15.052669 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:15.052093 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tcll" event={"ID":"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51","Type":"ContainerDied","Data":"a33a2aa0b0132eb1ee4b42e87023ca66abda43b8ccc31a00c5fa7b27e83fe72f"} Jul 14 14:47:15.631969 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:15.631949 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wzkz8_ec7482f3-a534-4bf4-808b-7605a929d1aa/node-ca/0.log" Jul 14 14:47:15.845048 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:15.845018 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:15.845203 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:15.845024 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:15.845203 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:15.845178 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:15.845203 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:15.845188 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:15.845339 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:15.845284 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:15.845391 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:15.845371 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:17.059254 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:17.059224 2541 generic.go:356] "Generic (PLEG): container finished" podID="ae78b13c-dd26-4a0e-9de9-7bcfd1227f51" containerID="4ae76d92336653873081796ecba4508bcbe0a52cfcc675ff02efe7a0623238a8" exitCode=0 Jul 14 14:47:17.059862 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:17.059261 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tcll" event={"ID":"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51","Type":"ContainerDied","Data":"4ae76d92336653873081796ecba4508bcbe0a52cfcc675ff02efe7a0623238a8"} Jul 14 14:47:17.518906 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:17.518881 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfpjr\" (UniqueName: \"kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr\") pod \"network-check-target-x4wsf\" (UID: \"1d142ebc-14cc-4663-9b48-5bed0b839e73\") " pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:17.519048 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:17.518984 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:47:17.519048 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:17.518997 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:47:17.519048 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:17.519006 2541 projected.go:196] Error preparing data for projected volume kube-api-access-bfpjr for pod openshift-network-diagnostics/network-check-target-x4wsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:47:17.519146 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:17.519067 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr podName:1d142ebc-14cc-4663-9b48-5bed0b839e73 nodeName:}" failed. No retries permitted until 2026-07-14 14:47:49.51905361 +0000 UTC m=+66.074715679 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfpjr" (UniqueName: "kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr") pod "network-check-target-x4wsf" (UID: "1d142ebc-14cc-4663-9b48-5bed0b839e73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:47:17.619818 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:17.619791 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:17.619990 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:17.619829 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:17.622752 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:17.620214 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:47:17.622752 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:17.620209 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:47:17.622752 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:17.620318 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret podName:7544136c-f86b-4065-a311-c908c9fbb4e6 nodeName:}" failed. No retries permitted until 2026-07-14 14:47:49.620287357 +0000 UTC m=+66.175949434 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret") pod "global-pull-secret-syncer-drxfb" (UID: "7544136c-f86b-4065-a311-c908c9fbb4e6") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:47:17.622752 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:17.620338 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs podName:61182e15-0a65-44ab-a9f7-7e1bd827cd2f nodeName:}" failed. No retries permitted until 2026-07-14 14:47:49.620328146 +0000 UTC m=+66.175990215 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs") pod "network-metrics-daemon-wzbf5" (UID: "61182e15-0a65-44ab-a9f7-7e1bd827cd2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:47:17.845034 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:17.844968 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:17.845034 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:17.844994 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:17.845237 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:17.844968 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:17.845237 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:17.845050 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:17.845237 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:17.845181 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:17.845366 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:17.845271 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:19.845671 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:19.845636 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:19.846118 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:19.845639 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:19.846118 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:19.845767 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:19.846118 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:19.845842 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:19.846118 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:19.845642 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:19.846118 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:19.845916 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:21.845705 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:21.845676 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:21.846120 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:21.845688 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:21.846120 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:21.845805 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:21.846120 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:21.845798 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:21.846120 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:21.845899 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:21.846120 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:21.846021 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:23.075314 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:23.075282 2541 generic.go:356] "Generic (PLEG): container finished" podID="ae78b13c-dd26-4a0e-9de9-7bcfd1227f51" containerID="23a5f18f7202ee231a566e3a851a9d9a38cbd253c11a6a4af98160fab0b2b72a" exitCode=0 Jul 14 14:47:23.075721 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:23.075338 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tcll" event={"ID":"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51","Type":"ContainerDied","Data":"23a5f18f7202ee231a566e3a851a9d9a38cbd253c11a6a4af98160fab0b2b72a"} Jul 14 14:47:23.845495 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:23.845424 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:23.845654 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:23.845515 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:23.845654 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:23.845550 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:23.845654 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:23.845650 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:23.845824 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:23.845651 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:23.845824 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:23.845705 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:24.079908 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:24.079874 2541 generic.go:356] "Generic (PLEG): container finished" podID="ae78b13c-dd26-4a0e-9de9-7bcfd1227f51" containerID="7ea8203fea3e09696612be3514c18f457ea42806e3ae96ea422374c38ea2b86f" exitCode=0 Jul 14 14:47:24.080359 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:24.079932 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tcll" event={"ID":"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51","Type":"ContainerDied","Data":"7ea8203fea3e09696612be3514c18f457ea42806e3ae96ea422374c38ea2b86f"} Jul 14 14:47:25.085378 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:25.085344 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tcll" event={"ID":"ae78b13c-dd26-4a0e-9de9-7bcfd1227f51","Type":"ContainerStarted","Data":"c4bfa077c72b401b1453f438911bec6fb45e1ab6af0c0a57bf9520d0536fe5ac"} Jul 14 14:47:25.123422 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:25.123377 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7tcll" podStartSLOduration=10.274456118 podStartE2EDuration="42.12336309s" totalImagesPullingTime="31.848906972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:46:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:25.122069178 +0000 UTC m=+41.677731285" watchObservedRunningTime="2026-07-14 14:47:25.12336309 +0000 UTC m=+41.679025179" Jul 14 14:47:25.845335 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:25.845306 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:25.845335 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:25.845330 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:25.845523 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:25.845397 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:25.845523 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:25.845478 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:25.845593 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:25.845541 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:25.845659 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:25.845641 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:27.845479 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:27.845449 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:27.845479 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:27.845468 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:27.845898 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:27.845456 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:27.845898 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:27.845556 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:27.845898 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:27.845612 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:27.845898 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:27.845705 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:29.845436 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:29.845407 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:29.845898 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:29.845407 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:29.845898 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:29.845500 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:29.845898 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:29.845581 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:29.845898 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:29.845666 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:29.845898 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:29.845744 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:31.845207 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:31.845177 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:31.845207 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:31.845196 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:31.845730 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:31.845177 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:31.845730 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:31.845296 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:31.845730 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:31.845411 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:31.845730 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:31.845465 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:33.845507 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:33.845475 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:33.845899 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:33.845567 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:33.845899 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:33.845587 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:33.845899 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:33.845652 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:33.845899 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:33.845720 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:33.845899 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:33.845796 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:35.844998 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:35.844971 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:35.844998 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:35.844988 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:35.845395 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:35.845056 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:35.845395 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:35.845088 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:35.845395 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:35.845158 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:35.845395 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:35.845221 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:37.845512 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:37.845479 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:37.845512 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:37.845487 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:37.845512 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:37.845500 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:37.846037 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:37.845612 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:37.846037 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:37.845679 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:37.846037 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:37.845732 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:39.845732 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:39.845702 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:39.846102 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:39.845702 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:39.846102 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:39.845805 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drxfb" podUID="7544136c-f86b-4065-a311-c908c9fbb4e6" Jul 14 14:47:39.846102 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:39.845852 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzbf5" podUID="61182e15-0a65-44ab-a9f7-7e1bd827cd2f" Jul 14 14:47:39.846102 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:39.845890 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:39.846102 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:39.845960 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4wsf" podUID="1d142ebc-14cc-4663-9b48-5bed0b839e73" Jul 14 14:47:40.337770 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.337748 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeReady" Jul 14 14:47:40.337932 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.337862 2541 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 14:47:40.438350 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.438320 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77cfc8956d-7286b"] Jul 14 14:47:40.440496 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.440482 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.445708 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.445686 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 14:47:40.445815 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.445753 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 14:47:40.446515 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.446497 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 14:47:40.452740 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.452721 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vrw5j\"" Jul 14 14:47:40.458391 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.458374 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 14:47:40.482475 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.482452 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c444d387-3a11-48bc-bb40-55be3e03263f-image-registry-private-configuration\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.482568 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.482478 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c444d387-3a11-48bc-bb40-55be3e03263f-bound-sa-token\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.482568 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.482507 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk6t2\" (UniqueName: \"kubernetes.io/projected/c444d387-3a11-48bc-bb40-55be3e03263f-kube-api-access-sk6t2\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.482709 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.482561 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c444d387-3a11-48bc-bb40-55be3e03263f-ca-trust-extracted\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.482709 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.482610 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c444d387-3a11-48bc-bb40-55be3e03263f-trusted-ca\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.482709 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.482662 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c444d387-3a11-48bc-bb40-55be3e03263f-installation-pull-secrets\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.482709 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.482694 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c444d387-3a11-48bc-bb40-55be3e03263f-registry-tls\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.482867 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.482733 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c444d387-3a11-48bc-bb40-55be3e03263f-registry-certificates\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.495998 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.495979 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-796g9"] Jul 14 14:47:40.497849 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.497835 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.505727 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.505709 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 14:47:40.506012 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.505988 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 14:47:40.506272 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.506256 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 14:47:40.506339 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.506329 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 14:47:40.506418 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.506400 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x4cnb\"" Jul 14 14:47:40.509276 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.509256 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77cfc8956d-7286b"] Jul 14 14:47:40.533016 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.532993 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-796g9"] Jul 14 14:47:40.580986 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.580965 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4n8nt"] Jul 14 14:47:40.582949 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.582935 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.583055 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583035 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a48b73e-8f68-47b9-b81e-033c58587857-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.583111 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583077 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk6t2\" (UniqueName: \"kubernetes.io/projected/c444d387-3a11-48bc-bb40-55be3e03263f-kube-api-access-sk6t2\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.583162 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583114 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c444d387-3a11-48bc-bb40-55be3e03263f-ca-trust-extracted\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.583212 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583184 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c444d387-3a11-48bc-bb40-55be3e03263f-trusted-ca\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.583260 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583228 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjhq9\" (UniqueName: \"kubernetes.io/projected/1a48b73e-8f68-47b9-b81e-033c58587857-kube-api-access-kjhq9\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.583312 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583261 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c444d387-3a11-48bc-bb40-55be3e03263f-installation-pull-secrets\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.583312 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583295 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c444d387-3a11-48bc-bb40-55be3e03263f-registry-tls\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.583409 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583336 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c444d387-3a11-48bc-bb40-55be3e03263f-registry-certificates\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.583409 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583374 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a48b73e-8f68-47b9-b81e-033c58587857-crio-socket\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.583409 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583397 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a48b73e-8f68-47b9-b81e-033c58587857-data-volume\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.583552 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583422 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a48b73e-8f68-47b9-b81e-033c58587857-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.583552 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583462 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c444d387-3a11-48bc-bb40-55be3e03263f-image-registry-private-configuration\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.583552 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583488 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c444d387-3a11-48bc-bb40-55be3e03263f-bound-sa-token\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.583552 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.583501 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c444d387-3a11-48bc-bb40-55be3e03263f-ca-trust-extracted\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.584076 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.584050 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c444d387-3a11-48bc-bb40-55be3e03263f-registry-certificates\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.584751 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.584599 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c444d387-3a11-48bc-bb40-55be3e03263f-trusted-ca\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.586852 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.586832 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zv5xw"] Jul 14 14:47:40.587843 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.587819 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c444d387-3a11-48bc-bb40-55be3e03263f-installation-pull-secrets\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.587921 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.587889 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c444d387-3a11-48bc-bb40-55be3e03263f-image-registry-private-configuration\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.587969 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.587957 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c444d387-3a11-48bc-bb40-55be3e03263f-registry-tls\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.589043 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.589026 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zv5xw" Jul 14 14:47:40.592170 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.592153 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8gwp2\"" Jul 14 14:47:40.593650 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.593634 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 14:47:40.604279 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.604259 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 14:47:40.604817 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.604778 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 14:47:40.605247 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.605227 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jtn79\"" Jul 14 14:47:40.606939 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.606914 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk6t2\" (UniqueName: \"kubernetes.io/projected/c444d387-3a11-48bc-bb40-55be3e03263f-kube-api-access-sk6t2\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.613783 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.613767 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 14:47:40.620587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.620572 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 14:47:40.626487 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.626467 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zv5xw"] Jul 14 14:47:40.651429 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.651391 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4n8nt"] Jul 14 14:47:40.652719 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.652696 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c444d387-3a11-48bc-bb40-55be3e03263f-bound-sa-token\") pod \"image-registry-77cfc8956d-7286b\" (UID: \"c444d387-3a11-48bc-bb40-55be3e03263f\") " pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.684766 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.684742 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a48b73e-8f68-47b9-b81e-033c58587857-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.684847 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.684773 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13b858cb-904e-4ed2-9b43-2799f9db7967-cert\") pod \"ingress-canary-zv5xw\" (UID: \"13b858cb-904e-4ed2-9b43-2799f9db7967\") " pod="openshift-ingress-canary/ingress-canary-zv5xw" Jul 14 14:47:40.684847 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.684792 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p6m9\" (UniqueName: \"kubernetes.io/projected/cc8335aa-48ec-4491-8e70-50eead5d7ca2-kube-api-access-8p6m9\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.684847 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.684812 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjhq9\" (UniqueName: \"kubernetes.io/projected/1a48b73e-8f68-47b9-b81e-033c58587857-kube-api-access-kjhq9\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.684941 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.684880 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8335aa-48ec-4491-8e70-50eead5d7ca2-metrics-tls\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.684984 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.684959 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc8335aa-48ec-4491-8e70-50eead5d7ca2-config-volume\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.685020 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.684987 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms9fb\" (UniqueName: \"kubernetes.io/projected/13b858cb-904e-4ed2-9b43-2799f9db7967-kube-api-access-ms9fb\") pod \"ingress-canary-zv5xw\" (UID: \"13b858cb-904e-4ed2-9b43-2799f9db7967\") " pod="openshift-ingress-canary/ingress-canary-zv5xw" Jul 14 14:47:40.685062 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.685021 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a48b73e-8f68-47b9-b81e-033c58587857-crio-socket\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.685062 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.685052 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a48b73e-8f68-47b9-b81e-033c58587857-data-volume\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.685140 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.685080 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a48b73e-8f68-47b9-b81e-033c58587857-crio-socket\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.685140 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.685079 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a48b73e-8f68-47b9-b81e-033c58587857-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.685140 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.685117 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc8335aa-48ec-4491-8e70-50eead5d7ca2-tmp-dir\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.685337 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.685321 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a48b73e-8f68-47b9-b81e-033c58587857-data-volume\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.685803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.685783 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a48b73e-8f68-47b9-b81e-033c58587857-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.687006 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.686991 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a48b73e-8f68-47b9-b81e-033c58587857-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.700733 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.700686 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjhq9\" (UniqueName: \"kubernetes.io/projected/1a48b73e-8f68-47b9-b81e-033c58587857-kube-api-access-kjhq9\") pod \"insights-runtime-extractor-796g9\" (UID: \"1a48b73e-8f68-47b9-b81e-033c58587857\") " pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.748747 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.748724 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:40.786534 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.785876 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc8335aa-48ec-4491-8e70-50eead5d7ca2-tmp-dir\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.786534 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.785956 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13b858cb-904e-4ed2-9b43-2799f9db7967-cert\") pod \"ingress-canary-zv5xw\" (UID: \"13b858cb-904e-4ed2-9b43-2799f9db7967\") " pod="openshift-ingress-canary/ingress-canary-zv5xw" Jul 14 14:47:40.786534 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.785990 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p6m9\" (UniqueName: \"kubernetes.io/projected/cc8335aa-48ec-4491-8e70-50eead5d7ca2-kube-api-access-8p6m9\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.786534 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.786025 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8335aa-48ec-4491-8e70-50eead5d7ca2-metrics-tls\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.786534 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.786073 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc8335aa-48ec-4491-8e70-50eead5d7ca2-config-volume\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.786534 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.786096 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms9fb\" (UniqueName: \"kubernetes.io/projected/13b858cb-904e-4ed2-9b43-2799f9db7967-kube-api-access-ms9fb\") pod \"ingress-canary-zv5xw\" (UID: \"13b858cb-904e-4ed2-9b43-2799f9db7967\") " pod="openshift-ingress-canary/ingress-canary-zv5xw" Jul 14 14:47:40.786926 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.786864 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc8335aa-48ec-4491-8e70-50eead5d7ca2-tmp-dir\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.787236 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.787174 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc8335aa-48ec-4491-8e70-50eead5d7ca2-config-volume\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.788767 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.788748 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8335aa-48ec-4491-8e70-50eead5d7ca2-metrics-tls\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.788952 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.788937 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13b858cb-904e-4ed2-9b43-2799f9db7967-cert\") pod \"ingress-canary-zv5xw\" (UID: \"13b858cb-904e-4ed2-9b43-2799f9db7967\") " pod="openshift-ingress-canary/ingress-canary-zv5xw" Jul 14 14:47:40.805845 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.805818 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-796g9" Jul 14 14:47:40.816814 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.816791 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p6m9\" (UniqueName: \"kubernetes.io/projected/cc8335aa-48ec-4491-8e70-50eead5d7ca2-kube-api-access-8p6m9\") pod \"dns-default-4n8nt\" (UID: \"cc8335aa-48ec-4491-8e70-50eead5d7ca2\") " pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.842965 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.842936 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms9fb\" (UniqueName: \"kubernetes.io/projected/13b858cb-904e-4ed2-9b43-2799f9db7967-kube-api-access-ms9fb\") pod \"ingress-canary-zv5xw\" (UID: \"13b858cb-904e-4ed2-9b43-2799f9db7967\") " pod="openshift-ingress-canary/ingress-canary-zv5xw" Jul 14 14:47:40.899934 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.899906 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:40.905030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.905010 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zv5xw" Jul 14 14:47:40.998079 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:40.998045 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-796g9"] Jul 14 14:47:41.004080 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:47:41.004053 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a48b73e_8f68_47b9_b81e_033c58587857.slice/crio-4b73ed8350fa1ec58fa241c7d1d2613fd7344685c67c88f35dae972c0cb9f5be WatchSource:0}: Error finding container 4b73ed8350fa1ec58fa241c7d1d2613fd7344685c67c88f35dae972c0cb9f5be: Status 404 returned error can't find the container with id 4b73ed8350fa1ec58fa241c7d1d2613fd7344685c67c88f35dae972c0cb9f5be Jul 14 14:47:41.009904 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.009883 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77cfc8956d-7286b"] Jul 14 14:47:41.013643 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:47:41.013600 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc444d387_3a11_48bc_bb40_55be3e03263f.slice/crio-72a2339e892fdd59ce03904786351d46cee631fd76cede2a3f1ec55179ef27bc WatchSource:0}: Error finding container 72a2339e892fdd59ce03904786351d46cee631fd76cede2a3f1ec55179ef27bc: Status 404 returned error can't find the container with id 72a2339e892fdd59ce03904786351d46cee631fd76cede2a3f1ec55179ef27bc Jul 14 14:47:41.116407 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.116381 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zv5xw"] Jul 14 14:47:41.118204 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.118174 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-796g9" event={"ID":"1a48b73e-8f68-47b9-b81e-033c58587857","Type":"ContainerStarted","Data":"4b73ed8350fa1ec58fa241c7d1d2613fd7344685c67c88f35dae972c0cb9f5be"} Jul 14 14:47:41.124503 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.124475 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77cfc8956d-7286b" event={"ID":"c444d387-3a11-48bc-bb40-55be3e03263f","Type":"ContainerStarted","Data":"b15c6d3d8e15b8a376c2953b22983dc2cf699b37321086040571fd29411a5368"} Jul 14 14:47:41.124597 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.124559 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77cfc8956d-7286b" event={"ID":"c444d387-3a11-48bc-bb40-55be3e03263f","Type":"ContainerStarted","Data":"72a2339e892fdd59ce03904786351d46cee631fd76cede2a3f1ec55179ef27bc"} Jul 14 14:47:41.124679 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.124598 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4n8nt"] Jul 14 14:47:41.124784 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.124742 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:47:41.126364 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:47:41.126338 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8335aa_48ec_4491_8e70_50eead5d7ca2.slice/crio-757ee8bbbe8e00288f9bb10b5cd5b148a8868243333d6c101fa6d18fc6a0d3b0 WatchSource:0}: Error finding container 757ee8bbbe8e00288f9bb10b5cd5b148a8868243333d6c101fa6d18fc6a0d3b0: Status 404 returned error can't find the container with id 757ee8bbbe8e00288f9bb10b5cd5b148a8868243333d6c101fa6d18fc6a0d3b0 Jul 14 14:47:41.693139 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.693074 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77cfc8956d-7286b" podStartSLOduration=2.693050855 podStartE2EDuration="2.693050855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:41.174431732 +0000 UTC m=+57.730093821" watchObservedRunningTime="2026-07-14 14:47:41.693050855 +0000 UTC m=+58.248712947" Jul 14 14:47:41.693907 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.693882 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk"] Jul 14 14:47:41.697015 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.696993 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk" Jul 14 14:47:41.703527 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.703505 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 14 14:47:41.703653 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.703568 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-55l45\"" Jul 14 14:47:41.730980 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.730960 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk"] Jul 14 14:47:41.794567 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.794483 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/552d9e2e-8c46-4fe7-8c06-08cdab38ad74-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fqxpk\" (UID: \"552d9e2e-8c46-4fe7-8c06-08cdab38ad74\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk" Jul 14 14:47:41.846230 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.846201 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:41.846367 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.846201 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:41.846367 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.846360 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:41.855100 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.854420 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 14:47:41.855100 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.854796 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7ww75\"" Jul 14 14:47:41.855100 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.855098 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 14:47:41.855492 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.855475 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bbv25\"" Jul 14 14:47:41.855938 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.855744 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 14:47:41.855938 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.855757 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 14:47:41.895409 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:41.895387 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/552d9e2e-8c46-4fe7-8c06-08cdab38ad74-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fqxpk\" (UID: \"552d9e2e-8c46-4fe7-8c06-08cdab38ad74\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk" Jul 14 14:47:41.895824 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:41.895529 2541 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 14 14:47:41.895824 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:41.895592 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552d9e2e-8c46-4fe7-8c06-08cdab38ad74-tls-certificates podName:552d9e2e-8c46-4fe7-8c06-08cdab38ad74 nodeName:}" failed. No retries permitted until 2026-07-14 14:47:42.395572286 +0000 UTC m=+58.951234353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/552d9e2e-8c46-4fe7-8c06-08cdab38ad74-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-fqxpk" (UID: "552d9e2e-8c46-4fe7-8c06-08cdab38ad74") : secret "prometheus-operator-admission-webhook-tls" not found Jul 14 14:47:42.133180 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:42.132997 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zv5xw" event={"ID":"13b858cb-904e-4ed2-9b43-2799f9db7967","Type":"ContainerStarted","Data":"44c0b471ee163085e3b46011954823ea9a293470e9ed1e8d8dc7a871313119cd"} Jul 14 14:47:42.136471 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:42.136365 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4n8nt" event={"ID":"cc8335aa-48ec-4491-8e70-50eead5d7ca2","Type":"ContainerStarted","Data":"757ee8bbbe8e00288f9bb10b5cd5b148a8868243333d6c101fa6d18fc6a0d3b0"} Jul 14 14:47:42.401145 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:42.401062 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/552d9e2e-8c46-4fe7-8c06-08cdab38ad74-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fqxpk\" (UID: \"552d9e2e-8c46-4fe7-8c06-08cdab38ad74\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk" Jul 14 14:47:42.410341 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:42.410313 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/552d9e2e-8c46-4fe7-8c06-08cdab38ad74-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fqxpk\" (UID: \"552d9e2e-8c46-4fe7-8c06-08cdab38ad74\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk" Jul 14 14:47:42.608130 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:42.608089 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk" Jul 14 14:47:45.064644 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:45.064593 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxtlv" Jul 14 14:47:46.499971 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:46.496909 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk"] Jul 14 14:47:46.499971 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:47:46.499677 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552d9e2e_8c46_4fe7_8c06_08cdab38ad74.slice/crio-9e1a21bf7a190599b45e7d6a1033845960f3aa2879233ce5c0821aa86c351bf7 WatchSource:0}: Error finding container 9e1a21bf7a190599b45e7d6a1033845960f3aa2879233ce5c0821aa86c351bf7: Status 404 returned error can't find the container with id 9e1a21bf7a190599b45e7d6a1033845960f3aa2879233ce5c0821aa86c351bf7 Jul 14 14:47:47.153500 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:47.153465 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4n8nt" event={"ID":"cc8335aa-48ec-4491-8e70-50eead5d7ca2","Type":"ContainerStarted","Data":"d7e4eeddfe5d15c41ca96036133b8f84c8856b9f9910f39a29cc8a7c671e25b2"} Jul 14 14:47:47.153679 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:47.153522 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4n8nt" event={"ID":"cc8335aa-48ec-4491-8e70-50eead5d7ca2","Type":"ContainerStarted","Data":"e308390a66ce19d1695d9e3a21016992c1dae1864e933aa40449d6592610b113"} Jul 14 14:47:47.153679 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:47.153583 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:47.155759 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:47.155702 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk" event={"ID":"552d9e2e-8c46-4fe7-8c06-08cdab38ad74","Type":"ContainerStarted","Data":"9e1a21bf7a190599b45e7d6a1033845960f3aa2879233ce5c0821aa86c351bf7"} Jul 14 14:47:47.157294 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:47.157262 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zv5xw" event={"ID":"13b858cb-904e-4ed2-9b43-2799f9db7967","Type":"ContainerStarted","Data":"1e221af65b1ce93f342e28411e453b0883e3d6e74eaea21cf71de8532269d173"} Jul 14 14:47:47.159216 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:47.159183 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-796g9" event={"ID":"1a48b73e-8f68-47b9-b81e-033c58587857","Type":"ContainerStarted","Data":"fa3715e11b5cd9e1098ca4401773e6bf2d55a9e62a827d8f02c3bed8636f97b6"} Jul 14 14:47:47.181433 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:47.181384 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4n8nt" podStartSLOduration=1.904450268 podStartE2EDuration="7.181367972s" totalImagesPullingTime="5.276917704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:47.17978352 +0000 UTC m=+63.735445610" watchObservedRunningTime="2026-07-14 14:47:47.181367972 +0000 UTC m=+63.737030061" Jul 14 14:47:47.204907 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:47.204862 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zv5xw" podStartSLOduration=1.914946349 podStartE2EDuration="7.204847903s" totalImagesPullingTime="5.289901554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:47.203927154 +0000 UTC m=+63.759589242" watchObservedRunningTime="2026-07-14 14:47:47.204847903 +0000 UTC m=+63.760509992" Jul 14 14:47:48.164966 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:48.164933 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-796g9" event={"ID":"1a48b73e-8f68-47b9-b81e-033c58587857","Type":"ContainerStarted","Data":"9cfe1e9ae7b8198c57a331650702f477837b95954c9afcbb7e2503289b81adc5"} Jul 14 14:47:48.166548 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:48.166522 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk" event={"ID":"552d9e2e-8c46-4fe7-8c06-08cdab38ad74","Type":"ContainerStarted","Data":"cbe92b654cd4f57d7780c7504593c1fe4c1da582d826de087b50557d0425075b"} Jul 14 14:47:48.167070 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:48.167046 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk" Jul 14 14:47:48.172378 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:48.172358 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk" Jul 14 14:47:48.191488 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:48.191445 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqxpk" podStartSLOduration=5.944525448 podStartE2EDuration="7.191432459s" totalImagesPullingTime="1.246907011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:48.187549248 +0000 UTC m=+64.743211336" watchObservedRunningTime="2026-07-14 14:47:48.191432459 +0000 UTC m=+64.747094547" Jul 14 14:47:49.560808 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.560773 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfpjr\" (UniqueName: \"kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr\") pod \"network-check-target-x4wsf\" (UID: \"1d142ebc-14cc-4663-9b48-5bed0b839e73\") " pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:49.563764 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.563740 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 14:47:49.573773 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.573746 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 14:47:49.584728 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.584701 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfpjr\" (UniqueName: \"kubernetes.io/projected/1d142ebc-14cc-4663-9b48-5bed0b839e73-kube-api-access-bfpjr\") pod \"network-check-target-x4wsf\" (UID: \"1d142ebc-14cc-4663-9b48-5bed0b839e73\") " pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:49.661997 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.661956 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:49.662124 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.662017 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:49.664745 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.664723 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 14:47:49.664832 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.664721 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 14:47:49.675286 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.675260 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61182e15-0a65-44ab-a9f7-7e1bd827cd2f-metrics-certs\") pod \"network-metrics-daemon-wzbf5\" (UID: \"61182e15-0a65-44ab-a9f7-7e1bd827cd2f\") " pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:49.675397 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.675297 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7544136c-f86b-4065-a311-c908c9fbb4e6-original-pull-secret\") pod \"global-pull-secret-syncer-drxfb\" (UID: \"7544136c-f86b-4065-a311-c908c9fbb4e6\") " pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:49.677803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.677785 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7ww75\"" Jul 14 14:47:49.686025 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.686005 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:49.943962 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.943943 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x4wsf"] Jul 14 14:47:49.945696 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:47:49.945673 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d142ebc_14cc_4663_9b48_5bed0b839e73.slice/crio-26fe15b180f639db554aafd01a68372a0326435a0a3bd359edf3997f909873fa WatchSource:0}: Error finding container 26fe15b180f639db554aafd01a68372a0326435a0a3bd359edf3997f909873fa: Status 404 returned error can't find the container with id 26fe15b180f639db554aafd01a68372a0326435a0a3bd359edf3997f909873fa Jul 14 14:47:49.959395 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.959377 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drxfb" Jul 14 14:47:49.971241 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.971222 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bbv25\"" Jul 14 14:47:49.979196 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:49.978665 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzbf5" Jul 14 14:47:50.094333 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:50.094267 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-drxfb"] Jul 14 14:47:50.097029 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:47:50.097004 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7544136c_f86b_4065_a311_c908c9fbb4e6.slice/crio-5c1df5eb53d21141dfe9f804c4dc4632df120f6afbc67f852fa1732fd3303a28 WatchSource:0}: Error finding container 5c1df5eb53d21141dfe9f804c4dc4632df120f6afbc67f852fa1732fd3303a28: Status 404 returned error can't find the container with id 5c1df5eb53d21141dfe9f804c4dc4632df120f6afbc67f852fa1732fd3303a28 Jul 14 14:47:50.110383 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:50.110359 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wzbf5"] Jul 14 14:47:50.112970 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:47:50.112951 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61182e15_0a65_44ab_a9f7_7e1bd827cd2f.slice/crio-a95117b4ab08995dbe798e27076337b91d9ff6f4b4f946d1685ba31e7899d8a0 WatchSource:0}: Error finding container a95117b4ab08995dbe798e27076337b91d9ff6f4b4f946d1685ba31e7899d8a0: Status 404 returned error can't find the container with id a95117b4ab08995dbe798e27076337b91d9ff6f4b4f946d1685ba31e7899d8a0 Jul 14 14:47:50.173720 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:50.173687 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-796g9" event={"ID":"1a48b73e-8f68-47b9-b81e-033c58587857","Type":"ContainerStarted","Data":"61aeead85955c554d7f2c068505fbf0dce157138fe8ac39b51199265cf5235d0"} Jul 14 14:47:50.174872 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:50.174855 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzbf5" event={"ID":"61182e15-0a65-44ab-a9f7-7e1bd827cd2f","Type":"ContainerStarted","Data":"a95117b4ab08995dbe798e27076337b91d9ff6f4b4f946d1685ba31e7899d8a0"} Jul 14 14:47:50.175874 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:50.175857 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-drxfb" event={"ID":"7544136c-f86b-4065-a311-c908c9fbb4e6","Type":"ContainerStarted","Data":"5c1df5eb53d21141dfe9f804c4dc4632df120f6afbc67f852fa1732fd3303a28"} Jul 14 14:47:50.176884 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:50.176863 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x4wsf" event={"ID":"1d142ebc-14cc-4663-9b48-5bed0b839e73","Type":"ContainerStarted","Data":"26fe15b180f639db554aafd01a68372a0326435a0a3bd359edf3997f909873fa"} Jul 14 14:47:50.195154 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:50.195111 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-796g9" podStartSLOduration=1.478449299 podStartE2EDuration="10.195100231s" totalImagesPullingTime="8.716650932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:47:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:50.193573794 +0000 UTC m=+66.749235903" watchObservedRunningTime="2026-07-14 14:47:50.195100231 +0000 UTC m=+66.750762338" Jul 14 14:47:51.185531 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:51.185499 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzbf5" event={"ID":"61182e15-0a65-44ab-a9f7-7e1bd827cd2f","Type":"ContainerStarted","Data":"3cf46988ab9b552a65d7f7bad9d7ba0a19b7935bf75a1649a2292a58ee94956a"} Jul 14 14:47:52.192662 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:52.192605 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzbf5" event={"ID":"61182e15-0a65-44ab-a9f7-7e1bd827cd2f","Type":"ContainerStarted","Data":"29c3fd06bb3f011f7b5e5896728f19fee4c875f1d58615056cce501d6a8e5a21"} Jul 14 14:47:52.212016 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:52.211957 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wzbf5" podStartSLOduration=68.255331799 podStartE2EDuration="1m9.211933041s" totalImagesPullingTime="956.601242ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:52.21106248 +0000 UTC m=+68.766724590" watchObservedRunningTime="2026-07-14 14:47:52.211933041 +0000 UTC m=+68.767595131" Jul 14 14:47:55.113009 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.112976 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q"] Jul 14 14:47:55.116102 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.116087 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.118727 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.118695 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 14:47:55.119779 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.119742 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 14:47:55.120032 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.119819 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 14 14:47:55.120032 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.119842 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9zhd2\"" Jul 14 14:47:55.120032 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.119895 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 14:47:55.120032 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.119899 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 14 14:47:55.129019 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.129000 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q"] Jul 14 14:47:55.151611 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.151593 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-sxnd9"] Jul 14 14:47:55.154594 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.154577 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.157741 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.157722 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 14 14:47:55.157979 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.157965 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 14 14:47:55.158318 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.158297 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 14 14:47:55.158507 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.158495 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p778p\"" Jul 14 14:47:55.160006 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.159990 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-prh66"] Jul 14 14:47:55.163203 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.163189 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.167269 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.167246 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2np64\"" Jul 14 14:47:55.167374 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.167252 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 14:47:55.167374 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.167292 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 14:47:55.167550 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.167530 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 14:47:55.172914 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.172889 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-sxnd9"] Jul 14 14:47:55.198718 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.198693 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf46951e-b6b7-4ae6-a859-8febe46c3045-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.198809 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.198724 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf46951e-b6b7-4ae6-a859-8febe46c3045-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.198809 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.198747 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf46951e-b6b7-4ae6-a859-8febe46c3045-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.198809 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.198771 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwwr5\" (UniqueName: \"kubernetes.io/projected/cf46951e-b6b7-4ae6-a859-8febe46c3045-kube-api-access-lwwr5\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.203317 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.203294 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-drxfb" event={"ID":"7544136c-f86b-4065-a311-c908c9fbb4e6","Type":"ContainerStarted","Data":"fb089581da29e422fb69badb7ccf3f00327aa9b56077d0f33f2160cd6eb69336"} Jul 14 14:47:55.204610 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.204592 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x4wsf" event={"ID":"1d142ebc-14cc-4663-9b48-5bed0b839e73","Type":"ContainerStarted","Data":"94a22f7262e8576e8a7c688b6631c6706db3259fa60aaec24458c8f4bd81d29a"} Jul 14 14:47:55.204748 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.204730 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:47:55.262250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.262211 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-drxfb" podStartSLOduration=66.759544981 podStartE2EDuration="1m11.262198849s" totalImagesPullingTime="4.502653868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:55.261298653 +0000 UTC m=+71.816960755" watchObservedRunningTime="2026-07-14 14:47:55.262198849 +0000 UTC m=+71.817860938" Jul 14 14:47:55.280830 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.280792 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x4wsf" podStartSLOduration=67.631233221 podStartE2EDuration="1m12.280781056s" totalImagesPullingTime="4.649547835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:55.28045759 +0000 UTC m=+71.836119689" watchObservedRunningTime="2026-07-14 14:47:55.280781056 +0000 UTC m=+71.836443144" Jul 14 14:47:55.299271 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299244 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxt5j\" (UniqueName: \"kubernetes.io/projected/56196967-dc3f-4366-bdd1-811b510e946f-kube-api-access-fxt5j\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.299366 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299276 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf46951e-b6b7-4ae6-a859-8febe46c3045-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.299366 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299302 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.299366 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299326 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-wtmp\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.299366 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299345 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.299564 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299491 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.299564 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299521 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96141f5f-ddf0-431d-9d3a-5306269c84ba-sys\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.299564 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299555 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmdkt\" (UniqueName: \"kubernetes.io/projected/96141f5f-ddf0-431d-9d3a-5306269c84ba-kube-api-access-zmdkt\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.299739 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299580 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56196967-dc3f-4366-bdd1-811b510e946f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.299739 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299684 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.299739 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299723 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96141f5f-ddf0-431d-9d3a-5306269c84ba-metrics-client-ca\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.299875 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299746 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56196967-dc3f-4366-bdd1-811b510e946f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.299875 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299761 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96141f5f-ddf0-431d-9d3a-5306269c84ba-root\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.299875 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299780 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.299875 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299806 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf46951e-b6b7-4ae6-a859-8febe46c3045-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.299875 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299829 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-tls\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.300096 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299926 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf46951e-b6b7-4ae6-a859-8febe46c3045-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.300096 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299945 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwwr5\" (UniqueName: \"kubernetes.io/projected/cf46951e-b6b7-4ae6-a859-8febe46c3045-kube-api-access-lwwr5\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.300096 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.299985 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-textfile\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.300505 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.300482 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf46951e-b6b7-4ae6-a859-8febe46c3045-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.301895 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.301877 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf46951e-b6b7-4ae6-a859-8febe46c3045-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.302199 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.302183 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf46951e-b6b7-4ae6-a859-8febe46c3045-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.308920 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.308895 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwwr5\" (UniqueName: \"kubernetes.io/projected/cf46951e-b6b7-4ae6-a859-8febe46c3045-kube-api-access-lwwr5\") pod \"openshift-state-metrics-84bd68b896-vgx5q\" (UID: \"cf46951e-b6b7-4ae6-a859-8febe46c3045\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.400858 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.400799 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.400858 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.400829 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96141f5f-ddf0-431d-9d3a-5306269c84ba-metrics-client-ca\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.400858 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.400848 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56196967-dc3f-4366-bdd1-811b510e946f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.401127 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.400866 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96141f5f-ddf0-431d-9d3a-5306269c84ba-root\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401127 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.400920 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96141f5f-ddf0-431d-9d3a-5306269c84ba-root\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401127 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.400984 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401127 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401024 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-tls\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401127 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401069 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-textfile\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401363 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401253 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxt5j\" (UniqueName: \"kubernetes.io/projected/56196967-dc3f-4366-bdd1-811b510e946f-kube-api-access-fxt5j\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.401363 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401296 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.401363 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401326 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-wtmp\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401363 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401357 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.401551 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401372 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401551 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401392 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.401551 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401402 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-textfile\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401551 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401415 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96141f5f-ddf0-431d-9d3a-5306269c84ba-sys\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401551 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401429 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96141f5f-ddf0-431d-9d3a-5306269c84ba-metrics-client-ca\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401551 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401455 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdkt\" (UniqueName: \"kubernetes.io/projected/96141f5f-ddf0-431d-9d3a-5306269c84ba-kube-api-access-zmdkt\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401551 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401460 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96141f5f-ddf0-431d-9d3a-5306269c84ba-sys\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.401551 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401484 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56196967-dc3f-4366-bdd1-811b510e946f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.401551 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401505 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56196967-dc3f-4366-bdd1-811b510e946f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.401551 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:55.401537 2541 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 14 14:47:55.402002 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:47:55.401716 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-tls podName:56196967-dc3f-4366-bdd1-811b510e946f nodeName:}" failed. No retries permitted until 2026-07-14 14:47:55.901692348 +0000 UTC m=+72.457354432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-sxnd9" (UID: "56196967-dc3f-4366-bdd1-811b510e946f") : secret "kube-state-metrics-tls" not found Jul 14 14:47:55.402002 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.401820 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-wtmp\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.402222 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.402203 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56196967-dc3f-4366-bdd1-811b510e946f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.402326 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.402303 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.403487 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.403466 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.404076 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.404060 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96141f5f-ddf0-431d-9d3a-5306269c84ba-node-exporter-tls\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.404159 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.404145 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.414469 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.414441 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmdkt\" (UniqueName: \"kubernetes.io/projected/96141f5f-ddf0-431d-9d3a-5306269c84ba-kube-api-access-zmdkt\") pod \"node-exporter-prh66\" (UID: \"96141f5f-ddf0-431d-9d3a-5306269c84ba\") " pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.415417 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.415397 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxt5j\" (UniqueName: \"kubernetes.io/projected/56196967-dc3f-4366-bdd1-811b510e946f-kube-api-access-fxt5j\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.425253 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.425237 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" Jul 14 14:47:55.470814 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.470783 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-prh66" Jul 14 14:47:55.495650 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:47:55.494826 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96141f5f_ddf0_431d_9d3a_5306269c84ba.slice/crio-09cba67a7f8fde47e25784b46f7d8c0adae84284d1419996b3f622960ac97af0 WatchSource:0}: Error finding container 09cba67a7f8fde47e25784b46f7d8c0adae84284d1419996b3f622960ac97af0: Status 404 returned error can't find the container with id 09cba67a7f8fde47e25784b46f7d8c0adae84284d1419996b3f622960ac97af0 Jul 14 14:47:55.572998 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.572967 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q"] Jul 14 14:47:55.575476 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:47:55.575448 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf46951e_b6b7_4ae6_a859_8febe46c3045.slice/crio-7156ee3b4948f66f73956349a16a096a8f2d321f25bbde2c452376582c1ad467 WatchSource:0}: Error finding container 7156ee3b4948f66f73956349a16a096a8f2d321f25bbde2c452376582c1ad467: Status 404 returned error can't find the container with id 7156ee3b4948f66f73956349a16a096a8f2d321f25bbde2c452376582c1ad467 Jul 14 14:47:55.910095 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.910017 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:55.912389 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:55.912368 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56196967-dc3f-4366-bdd1-811b510e946f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sxnd9\" (UID: \"56196967-dc3f-4366-bdd1-811b510e946f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:56.063095 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.063067 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" Jul 14 14:47:56.201583 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.201495 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-sxnd9"] Jul 14 14:47:56.205474 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:47:56.205418 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56196967_dc3f_4366_bdd1_811b510e946f.slice/crio-2fe76f23c6035ccad44aee33cdd26dc361f5ce19302e2e0086741627150151a7 WatchSource:0}: Error finding container 2fe76f23c6035ccad44aee33cdd26dc361f5ce19302e2e0086741627150151a7: Status 404 returned error can't find the container with id 2fe76f23c6035ccad44aee33cdd26dc361f5ce19302e2e0086741627150151a7 Jul 14 14:47:56.210974 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.210947 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" event={"ID":"cf46951e-b6b7-4ae6-a859-8febe46c3045","Type":"ContainerStarted","Data":"3919097c9fa08bd84a14c1de51a98966cc5c8302170cc5e5bfe3682f50f6dbe1"} Jul 14 14:47:56.211082 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.211012 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" event={"ID":"cf46951e-b6b7-4ae6-a859-8febe46c3045","Type":"ContainerStarted","Data":"61ac293bbc990e51c05f0f6ae51a5024dc1e1ce0a3d0ac10197c8644a7f9e012"} Jul 14 14:47:56.211082 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.211043 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" event={"ID":"cf46951e-b6b7-4ae6-a859-8febe46c3045","Type":"ContainerStarted","Data":"7156ee3b4948f66f73956349a16a096a8f2d321f25bbde2c452376582c1ad467"} Jul 14 14:47:56.212185 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.212162 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prh66" event={"ID":"96141f5f-ddf0-431d-9d3a-5306269c84ba","Type":"ContainerStarted","Data":"09cba67a7f8fde47e25784b46f7d8c0adae84284d1419996b3f622960ac97af0"} Jul 14 14:47:56.263500 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.263476 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:47:56.268405 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.268380 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.272346 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.272319 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 14:47:56.272771 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.272755 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 14:47:56.273700 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.273681 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 14:47:56.274589 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.274567 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 14:47:56.274697 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.274668 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 14:47:56.274846 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.274831 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 14:47:56.274911 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.274902 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 14:47:56.275385 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.275358 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 14:47:56.275444 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.275385 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-m7zn6\"" Jul 14 14:47:56.275575 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.275556 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 14:47:56.288779 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.288760 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:47:56.414032 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414003 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-web-config\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414186 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414038 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-out\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414186 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414112 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414186 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414142 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414353 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414183 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414353 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414252 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414353 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414280 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-volume\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414353 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414294 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414536 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414391 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbj72\" (UniqueName: \"kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-kube-api-access-gbj72\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414536 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414441 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414536 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414484 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414709 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414541 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.414709 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.414567 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515467 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515386 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515467 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515438 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515467 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515461 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515759 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515498 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-volume\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515759 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515668 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515759 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515716 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbj72\" (UniqueName: \"kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-kube-api-access-gbj72\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515759 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515746 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515951 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515780 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515951 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515823 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515951 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515852 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515951 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515888 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-web-config\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.515951 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515925 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-out\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.516157 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.515969 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.516249 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.516224 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.517064 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.517033 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.517387 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.517358 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.519535 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.519492 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.519730 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.519704 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.519798 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.519765 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-web-config\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.519930 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.519909 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-volume\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.520066 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.520050 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.520136 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.520060 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.521064 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.521042 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.521288 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.521266 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.521864 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.521846 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-out\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.527553 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.527531 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbj72\" (UniqueName: \"kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-kube-api-access-gbj72\") pod \"alertmanager-main-0\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.580194 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.580172 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:47:56.724144 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:56.724019 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:47:56.772483 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:47:56.772417 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6467fc4f_d974_432f_b4a1_621b339d2f6b.slice/crio-fbc8300f646b77f9df4423eec2eafbe829be57a732cc98effe20f69f1db9c967 WatchSource:0}: Error finding container fbc8300f646b77f9df4423eec2eafbe829be57a732cc98effe20f69f1db9c967: Status 404 returned error can't find the container with id fbc8300f646b77f9df4423eec2eafbe829be57a732cc98effe20f69f1db9c967 Jul 14 14:47:57.168292 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:57.168250 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4n8nt" Jul 14 14:47:57.222191 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:57.222154 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" event={"ID":"cf46951e-b6b7-4ae6-a859-8febe46c3045","Type":"ContainerStarted","Data":"141783d2bc49708680cc1480089dafbe95d866ec53b4aca0b9156eef0ee8184e"} Jul 14 14:47:57.224235 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:57.224207 2541 generic.go:356] "Generic (PLEG): container finished" podID="96141f5f-ddf0-431d-9d3a-5306269c84ba" containerID="49dc7e38907eeeac5f41b4d081c13d9d8256b29defbd55d1e32ca0758767e5de" exitCode=0 Jul 14 14:47:57.224531 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:57.224505 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prh66" event={"ID":"96141f5f-ddf0-431d-9d3a-5306269c84ba","Type":"ContainerDied","Data":"49dc7e38907eeeac5f41b4d081c13d9d8256b29defbd55d1e32ca0758767e5de"} Jul 14 14:47:57.226332 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:57.226303 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerStarted","Data":"fbc8300f646b77f9df4423eec2eafbe829be57a732cc98effe20f69f1db9c967"} Jul 14 14:47:57.228655 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:57.228603 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" event={"ID":"56196967-dc3f-4366-bdd1-811b510e946f","Type":"ContainerStarted","Data":"2fe76f23c6035ccad44aee33cdd26dc361f5ce19302e2e0086741627150151a7"} Jul 14 14:47:57.243683 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:57.242807 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vgx5q" podStartSLOduration=0.892061591 podStartE2EDuration="2.242789575s" totalImagesPullingTime="1.350727984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:57.242517362 +0000 UTC m=+73.798179451" watchObservedRunningTime="2026-07-14 14:47:57.242789575 +0000 UTC m=+73.798451665" Jul 14 14:47:58.235112 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:58.235071 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prh66" event={"ID":"96141f5f-ddf0-431d-9d3a-5306269c84ba","Type":"ContainerStarted","Data":"c33155280f7fc9b143def6739f74996649f641ca885cc8d9a2cadfaa6ad20298"} Jul 14 14:47:58.235500 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:58.235157 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prh66" event={"ID":"96141f5f-ddf0-431d-9d3a-5306269c84ba","Type":"ContainerStarted","Data":"f548425b8acc73fa61b0e2553ccbf782c4975aee47beb8d1ab0f4aa3c6a99c1a"} Jul 14 14:47:58.236681 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:58.236656 2541 generic.go:356] "Generic (PLEG): container finished" podID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerID="aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556" exitCode=0 Jul 14 14:47:58.236790 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:58.236736 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerDied","Data":"aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556"} Jul 14 14:47:58.239275 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:58.239246 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" event={"ID":"56196967-dc3f-4366-bdd1-811b510e946f","Type":"ContainerStarted","Data":"47702e5675abfb340d9c024c49494c1a68799a7f4e1298def6e570c2a5815790"} Jul 14 14:47:58.243636 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:58.239569 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" event={"ID":"56196967-dc3f-4366-bdd1-811b510e946f","Type":"ContainerStarted","Data":"8f96f6f003c017cecdaab9c0cf102ed643bc110e83eea84740ff383cb968d0e2"} Jul 14 14:47:58.243636 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:58.239855 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" event={"ID":"56196967-dc3f-4366-bdd1-811b510e946f","Type":"ContainerStarted","Data":"0172d8ea2975c508ec8fe1a211ea4b6f801e1ed15a632b5fadb63d1d1e274e61"} Jul 14 14:47:58.266959 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:58.266919 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-prh66" podStartSLOduration=2.130731752 podStartE2EDuration="3.266905683s" totalImagesPullingTime="1.060379295s" totalInitContainerRuntime="75.794636ms" isStatefulPod=true podCreationTimestamp="2026-07-14 14:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:58.265428312 +0000 UTC m=+74.821090400" watchObservedRunningTime="2026-07-14 14:47:58.266905683 +0000 UTC m=+74.822567772" Jul 14 14:47:58.299492 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:47:58.299441 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-sxnd9" podStartSLOduration=1.566245759 podStartE2EDuration="3.299426811s" totalImagesPullingTime="1.733181052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:47:58.298004514 +0000 UTC m=+74.853666652" watchObservedRunningTime="2026-07-14 14:47:58.299426811 +0000 UTC m=+74.855088901" Jul 14 14:48:00.251146 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:00.251119 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerStarted","Data":"95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad"} Jul 14 14:48:00.251448 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:00.251179 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerStarted","Data":"674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55"} Jul 14 14:48:00.251448 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:00.251207 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerStarted","Data":"3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c"} Jul 14 14:48:00.251448 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:00.251230 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerStarted","Data":"50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b"} Jul 14 14:48:00.251448 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:00.251253 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerStarted","Data":"78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca"} Jul 14 14:48:01.258651 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.258563 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerStarted","Data":"af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b"} Jul 14 14:48:01.288985 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.288928 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.650060504 podStartE2EDuration="5.288911941s" totalImagesPullingTime="3.617794631s" totalInitContainerRuntime="21.056806ms" isStatefulPod=false podCreationTimestamp="2026-07-14 14:47:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:48:01.288169641 +0000 UTC m=+77.843831743" watchObservedRunningTime="2026-07-14 14:48:01.288911941 +0000 UTC m=+77.844574050" Jul 14 14:48:01.554266 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.554185 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:48:01.557978 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.557931 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.566249 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.566232 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 14:48:01.566596 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.566578 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9qujab2n8msj8\"" Jul 14 14:48:01.566691 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.566652 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 14:48:01.566691 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.566682 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 14:48:01.566914 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.566902 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 14:48:01.566984 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.566971 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 14:48:01.578573 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.578556 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 14:48:01.578690 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.578678 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 14:48:01.578754 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.578711 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 14:48:01.578815 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.578772 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 14:48:01.578815 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.578780 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 14:48:01.578815 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.578801 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 14:48:01.579155 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.579138 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 14:48:01.579250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.579230 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 14:48:01.579302 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.579232 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 14:48:01.579374 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.579360 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lcrgc\"" Jul 14 14:48:01.580749 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.580730 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 14:48:01.652013 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.651992 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:48:01.659227 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659204 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659321 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659235 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659321 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659257 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mb26\" (UniqueName: \"kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-kube-api-access-4mb26\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659321 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659277 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659321 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659346 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659363 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-web-config\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659396 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659435 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659652 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659506 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659652 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659552 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-config\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659652 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659574 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659652 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659598 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659652 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659636 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659796 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659654 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659796 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659669 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659796 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659719 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659796 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659741 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-config-out\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659796 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659770 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.659796 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.659788 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.760841 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.760814 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.760968 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.760843 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-config\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.760968 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.760860 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.760968 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.760874 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.760968 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.760895 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.760968 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.760914 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.760968 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.760939 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761246 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.760976 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761246 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761008 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-config-out\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761246 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761029 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761246 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761058 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761246 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761093 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761246 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761117 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761246 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761145 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mb26\" (UniqueName: \"kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-kube-api-access-4mb26\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761246 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761175 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761246 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761202 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761246 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761225 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761246 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761249 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-web-config\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761791 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761279 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761791 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761302 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761791 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761593 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.761791 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.761641 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.762066 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.762044 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.762250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.762226 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.762765 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.762438 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.763799 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.763772 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.764033 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.764007 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-config\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.764361 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.764332 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.764954 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.764925 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.765510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.765477 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.765924 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.765900 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.766102 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.766083 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-config-out\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.766269 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.766219 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.766559 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.766535 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.766673 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.766543 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-web-config\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.767088 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.767071 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.767310 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.767295 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.767816 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.767791 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.768076 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.768060 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.770428 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.770408 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mb26\" (UniqueName: \"kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-kube-api-access-4mb26\") pod \"prometheus-k8s-0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:01.867066 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:01.867016 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:02.002989 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:02.002953 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:48:02.006682 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:48:02.006660 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37daaae_7659_44b2_a8d8_c90657fdaca0.slice/crio-1b12b77ef1a7c8581ea6fac3cb2d6c99bb766b24d9dea3ce68505c7c4ac4c0f1 WatchSource:0}: Error finding container 1b12b77ef1a7c8581ea6fac3cb2d6c99bb766b24d9dea3ce68505c7c4ac4c0f1: Status 404 returned error can't find the container with id 1b12b77ef1a7c8581ea6fac3cb2d6c99bb766b24d9dea3ce68505c7c4ac4c0f1 Jul 14 14:48:02.141215 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:02.141169 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77cfc8956d-7286b" Jul 14 14:48:02.263741 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:02.263708 2541 generic.go:356] "Generic (PLEG): container finished" podID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerID="b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86" exitCode=0 Jul 14 14:48:02.264126 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:02.263809 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerDied","Data":"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86"} Jul 14 14:48:02.264126 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:02.263884 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerStarted","Data":"1b12b77ef1a7c8581ea6fac3cb2d6c99bb766b24d9dea3ce68505c7c4ac4c0f1"} Jul 14 14:48:06.284717 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:06.284677 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerStarted","Data":"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5"} Jul 14 14:48:06.285187 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:06.284769 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerStarted","Data":"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7"} Jul 14 14:48:08.297458 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:08.297430 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerStarted","Data":"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581"} Jul 14 14:48:08.297792 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:08.297525 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerStarted","Data":"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7"} Jul 14 14:48:08.297792 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:08.297572 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerStarted","Data":"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5"} Jul 14 14:48:09.305018 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:09.304981 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerStarted","Data":"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754"} Jul 14 14:48:09.344214 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:09.344151 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.613503857 podStartE2EDuration="8.34412992s" totalImagesPullingTime="5.71318436s" totalInitContainerRuntime="17.441703ms" isStatefulPod=false podCreationTimestamp="2026-07-14 14:48:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:48:09.341895393 +0000 UTC m=+85.897557482" watchObservedRunningTime="2026-07-14 14:48:09.34412992 +0000 UTC m=+85.899792012" Jul 14 14:48:11.868029 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:11.867998 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:48:26.215407 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:48:26.215378 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x4wsf" Jul 14 14:49:01.867555 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:01.867525 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:01.888828 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:01.888799 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:02.518523 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:02.518497 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:15.680374 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:15.680340 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:49:15.680778 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:15.680677 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="alertmanager" containerID="cri-o://78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca" gracePeriod=120 Jul 14 14:49:15.680778 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:15.680712 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy-metric" containerID="cri-o://95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad" gracePeriod=120 Jul 14 14:49:15.680778 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:15.680743 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="config-reloader" containerID="cri-o://50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b" gracePeriod=120 Jul 14 14:49:15.680991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:15.680750 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy" containerID="cri-o://674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55" gracePeriod=120 Jul 14 14:49:15.680991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:15.680721 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy-web" containerID="cri-o://3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c" gracePeriod=120 Jul 14 14:49:15.680991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:15.680775 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="prom-label-proxy" containerID="cri-o://af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b" gracePeriod=120 Jul 14 14:49:16.555088 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.555051 2541 generic.go:356] "Generic (PLEG): container finished" podID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerID="af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b" exitCode=0 Jul 14 14:49:16.555088 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.555078 2541 generic.go:356] "Generic (PLEG): container finished" podID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerID="674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55" exitCode=0 Jul 14 14:49:16.555088 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.555084 2541 generic.go:356] "Generic (PLEG): container finished" podID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerID="50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b" exitCode=0 Jul 14 14:49:16.555088 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.555090 2541 generic.go:356] "Generic (PLEG): container finished" podID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerID="78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca" exitCode=0 Jul 14 14:49:16.555359 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.555120 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerDied","Data":"af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b"} Jul 14 14:49:16.555359 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.555181 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerDied","Data":"674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55"} Jul 14 14:49:16.555359 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.555207 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerDied","Data":"50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b"} Jul 14 14:49:16.555359 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.555235 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerDied","Data":"78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca"} Jul 14 14:49:16.925965 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.925938 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:49:16.959459 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.959434 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:16.959595 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.959535 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-main-tls\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:16.959595 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.959560 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:16.960502 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.959596 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-tls-assets\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:16.960502 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.959646 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbj72\" (UniqueName: \"kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-kube-api-access-gbj72\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:16.960502 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.959670 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-trusted-ca-bundle\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:16.960502 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.960219 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:49:16.962171 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.962147 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:16.962437 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.962418 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:16.962581 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.962560 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:49:16.962670 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.962583 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-kube-api-access-gbj72" (OuterVolumeSpecName: "kube-api-access-gbj72") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "kube-api-access-gbj72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:49:16.962895 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:16.962868 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:17.060520 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.060494 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-web\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:17.060725 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.060531 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-cluster-tls-config\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:17.060725 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.060551 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-web-config\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:17.060725 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.060571 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-out\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:17.060725 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.060607 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-volume\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:17.060725 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.060664 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-main-db\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:17.060725 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.060711 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-metrics-client-ca\") pod \"6467fc4f-d974-432f-b4a1-621b339d2f6b\" (UID: \"6467fc4f-d974-432f-b4a1-621b339d2f6b\") " Jul 14 14:49:17.061038 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.060959 2541 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-main-tls\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.061038 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.060978 2541 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.061038 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.060991 2541 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-tls-assets\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.061038 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.061005 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbj72\" (UniqueName: \"kubernetes.io/projected/6467fc4f-d974-432f-b4a1-621b339d2f6b-kube-api-access-gbj72\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.061038 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.061001 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:49:17.061038 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.061020 2541 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.061038 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.061035 2541 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.061430 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.061315 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:49:17.063268 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.063232 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:17.063368 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.063258 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-volume" (OuterVolumeSpecName: "config-volume") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:17.063368 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.063268 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-out" (OuterVolumeSpecName: "config-out") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:49:17.066740 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.066717 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:17.072360 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.072344 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-web-config" (OuterVolumeSpecName: "web-config") pod "6467fc4f-d974-432f-b4a1-621b339d2f6b" (UID: "6467fc4f-d974-432f-b4a1-621b339d2f6b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:17.161772 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.161742 2541 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.161772 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.161767 2541 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-cluster-tls-config\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.161958 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.161797 2541 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-web-config\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.161958 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.161809 2541 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-out\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.161958 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.161818 2541 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6467fc4f-d974-432f-b4a1-621b339d2f6b-config-volume\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.161958 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.161826 2541 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6467fc4f-d974-432f-b4a1-621b339d2f6b-alertmanager-main-db\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.161958 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.161834 2541 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6467fc4f-d974-432f-b4a1-621b339d2f6b-metrics-client-ca\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:17.562100 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.562025 2541 generic.go:356] "Generic (PLEG): container finished" podID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerID="95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad" exitCode=0 Jul 14 14:49:17.562100 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.562047 2541 generic.go:356] "Generic (PLEG): container finished" podID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerID="3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c" exitCode=0 Jul 14 14:49:17.562256 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.562097 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerDied","Data":"95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad"} Jul 14 14:49:17.562256 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.562165 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerDied","Data":"3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c"} Jul 14 14:49:17.562256 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.562111 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:49:17.562256 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.562192 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6467fc4f-d974-432f-b4a1-621b339d2f6b","Type":"ContainerDied","Data":"fbc8300f646b77f9df4423eec2eafbe829be57a732cc98effe20f69f1db9c967"} Jul 14 14:49:17.562256 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.562223 2541 scope.go:117] "RemoveContainer" containerID="af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b" Jul 14 14:49:17.570173 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.570154 2541 scope.go:117] "RemoveContainer" containerID="95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad" Jul 14 14:49:17.576893 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.576879 2541 scope.go:117] "RemoveContainer" containerID="674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55" Jul 14 14:49:17.584044 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.584028 2541 scope.go:117] "RemoveContainer" containerID="3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c" Jul 14 14:49:17.587329 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.587309 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:49:17.591839 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.591821 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:49:17.591996 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.591980 2541 scope.go:117] "RemoveContainer" containerID="50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b" Jul 14 14:49:17.598774 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.598750 2541 scope.go:117] "RemoveContainer" containerID="78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca" Jul 14 14:49:17.605294 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.605279 2541 scope.go:117] "RemoveContainer" containerID="aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556" Jul 14 14:49:17.611837 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.611822 2541 scope.go:117] "RemoveContainer" containerID="af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b" Jul 14 14:49:17.612093 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:17.612075 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b\": container with ID starting with af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b not found: ID does not exist" containerID="af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b" Jul 14 14:49:17.612149 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.612100 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b"} err="failed to get container status \"af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b\": rpc error: code = NotFound desc = could not find container \"af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b\": container with ID starting with af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b not found: ID does not exist" Jul 14 14:49:17.612149 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.612131 2541 scope.go:117] "RemoveContainer" containerID="95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad" Jul 14 14:49:17.612417 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:17.612394 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad\": container with ID starting with 95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad not found: ID does not exist" containerID="95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad" Jul 14 14:49:17.612504 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.612427 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad"} err="failed to get container status \"95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad\": rpc error: code = NotFound desc = could not find container \"95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad\": container with ID starting with 95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad not found: ID does not exist" Jul 14 14:49:17.612504 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.612452 2541 scope.go:117] "RemoveContainer" containerID="674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55" Jul 14 14:49:17.612760 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:17.612714 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55\": container with ID starting with 674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55 not found: ID does not exist" containerID="674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55" Jul 14 14:49:17.612851 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.612757 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55"} err="failed to get container status \"674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55\": rpc error: code = NotFound desc = could not find container \"674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55\": container with ID starting with 674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55 not found: ID does not exist" Jul 14 14:49:17.612851 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.612779 2541 scope.go:117] "RemoveContainer" containerID="3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c" Jul 14 14:49:17.613062 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:17.613031 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c\": container with ID starting with 3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c not found: ID does not exist" containerID="3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c" Jul 14 14:49:17.613140 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.613055 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c"} err="failed to get container status \"3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c\": rpc error: code = NotFound desc = could not find container \"3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c\": container with ID starting with 3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c not found: ID does not exist" Jul 14 14:49:17.613140 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.613075 2541 scope.go:117] "RemoveContainer" containerID="50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b" Jul 14 14:49:17.613333 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:17.613317 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b\": container with ID starting with 50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b not found: ID does not exist" containerID="50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b" Jul 14 14:49:17.613377 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.613339 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b"} err="failed to get container status \"50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b\": rpc error: code = NotFound desc = could not find container \"50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b\": container with ID starting with 50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b not found: ID does not exist" Jul 14 14:49:17.613377 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.613355 2541 scope.go:117] "RemoveContainer" containerID="78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca" Jul 14 14:49:17.613536 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:17.613519 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca\": container with ID starting with 78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca not found: ID does not exist" containerID="78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca" Jul 14 14:49:17.613599 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.613543 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca"} err="failed to get container status \"78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca\": rpc error: code = NotFound desc = could not find container \"78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca\": container with ID starting with 78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca not found: ID does not exist" Jul 14 14:49:17.613599 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.613563 2541 scope.go:117] "RemoveContainer" containerID="aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556" Jul 14 14:49:17.613828 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:17.613814 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556\": container with ID starting with aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556 not found: ID does not exist" containerID="aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556" Jul 14 14:49:17.613870 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.613833 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556"} err="failed to get container status \"aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556\": rpc error: code = NotFound desc = could not find container \"aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556\": container with ID starting with aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556 not found: ID does not exist" Jul 14 14:49:17.613870 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.613846 2541 scope.go:117] "RemoveContainer" containerID="af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b" Jul 14 14:49:17.614076 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.614058 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b"} err="failed to get container status \"af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b\": rpc error: code = NotFound desc = could not find container \"af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b\": container with ID starting with af84a59a6ddff72ab5f385fbf493741e196ec2bf09edff8b34955c23e4f24c3b not found: ID does not exist" Jul 14 14:49:17.614138 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.614078 2541 scope.go:117] "RemoveContainer" containerID="95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad" Jul 14 14:49:17.614280 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.614263 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad"} err="failed to get container status \"95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad\": rpc error: code = NotFound desc = could not find container \"95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad\": container with ID starting with 95d0bc83bba34dc6352eb249865b451fbd5e2e9bb0b6fb578a6ecac1db2126ad not found: ID does not exist" Jul 14 14:49:17.614321 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.614280 2541 scope.go:117] "RemoveContainer" containerID="674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55" Jul 14 14:49:17.614526 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.614507 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55"} err="failed to get container status \"674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55\": rpc error: code = NotFound desc = could not find container \"674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55\": container with ID starting with 674eb6a2f612cb67a2618a413ee3ae47f198855d8fde67504844088cd6c4bf55 not found: ID does not exist" Jul 14 14:49:17.614605 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.614527 2541 scope.go:117] "RemoveContainer" containerID="3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c" Jul 14 14:49:17.614775 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.614755 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c"} err="failed to get container status \"3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c\": rpc error: code = NotFound desc = could not find container \"3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c\": container with ID starting with 3a8945fceab33eac9c5296dc3841fc0f414f8cafb9e414115f448588d90b5e4c not found: ID does not exist" Jul 14 14:49:17.614829 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.614776 2541 scope.go:117] "RemoveContainer" containerID="50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b" Jul 14 14:49:17.614977 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.614961 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b"} err="failed to get container status \"50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b\": rpc error: code = NotFound desc = could not find container \"50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b\": container with ID starting with 50db5433ee6c08559e1e6aa4e24c113d35f5e9aa87b2e3a893f2bfe419424b6b not found: ID does not exist" Jul 14 14:49:17.615021 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.614977 2541 scope.go:117] "RemoveContainer" containerID="78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca" Jul 14 14:49:17.615198 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.615179 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca"} err="failed to get container status \"78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca\": rpc error: code = NotFound desc = could not find container \"78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca\": container with ID starting with 78e683d13bffb38f96743d564ef4f1d3af3368fcdbe787a8ae99447a1d56cdca not found: ID does not exist" Jul 14 14:49:17.615267 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.615201 2541 scope.go:117] "RemoveContainer" containerID="aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556" Jul 14 14:49:17.615415 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.615399 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556"} err="failed to get container status \"aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556\": rpc error: code = NotFound desc = could not find container \"aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556\": container with ID starting with aeecf062056fc00b9ebb63e0eebf6c40dcf60dbf577b5f2f815580a0ec240556 not found: ID does not exist" Jul 14 14:49:17.849933 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:17.849865 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" path="/var/lib/kubelet/pods/6467fc4f-d974-432f-b4a1-621b339d2f6b/volumes" Jul 14 14:49:19.987936 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:19.987907 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:49:19.988344 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:19.988178 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="prometheus" containerID="cri-o://3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7" gracePeriod=600 Jul 14 14:49:19.988344 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:19.988205 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy" containerID="cri-o://96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581" gracePeriod=600 Jul 14 14:49:19.988344 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:19.988216 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="thanos-sidecar" containerID="cri-o://27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5" gracePeriod=600 Jul 14 14:49:19.988344 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:19.988237 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy-web" containerID="cri-o://4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7" gracePeriod=600 Jul 14 14:49:19.988344 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:19.988263 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="config-reloader" containerID="cri-o://38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5" gracePeriod=600 Jul 14 14:49:19.988344 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:19.988277 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754" gracePeriod=600 Jul 14 14:49:20.229891 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.229868 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.281795 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.281724 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-kube-rbac-proxy\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.281919 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.281806 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-1\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.281968 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.281914 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-metrics-client-certs\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.281968 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.281953 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282044 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.281979 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-tls\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282044 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282003 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-metrics-client-ca\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282044 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282029 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-serving-certs-ca-bundle\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282189 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282073 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mb26\" (UniqueName: \"kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-kube-api-access-4mb26\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282189 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282074 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:49:20.282189 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282099 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-config\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282189 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282124 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-config-out\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282189 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282152 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-db\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282189 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282177 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282484 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282202 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-0\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282484 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282241 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-2\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282484 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282270 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-thanos-prometheus-http-client-file\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282484 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282305 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-tls-assets\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282484 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282329 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-kubelet-serving-ca-bundle\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282484 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282365 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-trusted-ca-bundle\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282484 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282388 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-grpc-tls\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.282484 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282393 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:49:20.282951 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282593 2541 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.282951 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282609 2541 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-metrics-client-ca\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.283550 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.282942 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:49:20.283550 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.283043 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:49:20.283742 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.283544 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:49:20.283742 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.283687 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:49:20.285170 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.285142 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:49:20.285415 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.285389 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:49:20.286203 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.286169 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:20.286302 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.286198 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:20.286302 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.286226 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:20.286521 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.286482 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-config-out" (OuterVolumeSpecName: "config-out") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:49:20.286594 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.286568 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:20.286767 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.286745 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-config" (OuterVolumeSpecName: "config") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:20.286832 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.286775 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:49:20.286965 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.286942 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:20.287542 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.287524 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-kube-api-access-4mb26" (OuterVolumeSpecName: "kube-api-access-4mb26") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "kube-api-access-4mb26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:49:20.287911 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.287881 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:20.287911 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.287902 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:20.384444 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384422 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-web-config\") pod \"e37daaae-7659-44b2-a8d8-c90657fdaca0\" (UID: \"e37daaae-7659-44b2-a8d8-c90657fdaca0\") " Jul 14 14:49:20.384548 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384537 2541 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-kube-rbac-proxy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384586 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384550 2541 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-metrics-client-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384586 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384560 2541 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384586 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384568 2541 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384586 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384577 2541 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384586 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384586 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mb26\" (UniqueName: \"kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-kube-api-access-4mb26\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384594 2541 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-config\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384602 2541 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-config-out\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384612 2541 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-db\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384647 2541 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384659 2541 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384667 2541 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384675 2541 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384683 2541 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e37daaae-7659-44b2-a8d8-c90657fdaca0-tls-assets\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384691 2541 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384699 2541 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37daaae-7659-44b2-a8d8-c90657fdaca0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.384769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.384707 2541 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-secret-grpc-tls\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.395002 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.394985 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-web-config" (OuterVolumeSpecName: "web-config") pod "e37daaae-7659-44b2-a8d8-c90657fdaca0" (UID: "e37daaae-7659-44b2-a8d8-c90657fdaca0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:49:20.485413 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.485394 2541 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e37daaae-7659-44b2-a8d8-c90657fdaca0-web-config\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:49:20.576219 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576152 2541 generic.go:356] "Generic (PLEG): container finished" podID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerID="c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754" exitCode=0 Jul 14 14:49:20.576219 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576174 2541 generic.go:356] "Generic (PLEG): container finished" podID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerID="96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581" exitCode=0 Jul 14 14:49:20.576219 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576180 2541 generic.go:356] "Generic (PLEG): container finished" podID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerID="4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7" exitCode=0 Jul 14 14:49:20.576219 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576192 2541 generic.go:356] "Generic (PLEG): container finished" podID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerID="27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5" exitCode=0 Jul 14 14:49:20.576219 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576198 2541 generic.go:356] "Generic (PLEG): container finished" podID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerID="38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5" exitCode=0 Jul 14 14:49:20.576219 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576203 2541 generic.go:356] "Generic (PLEG): container finished" podID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerID="3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7" exitCode=0 Jul 14 14:49:20.576429 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576222 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerDied","Data":"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754"} Jul 14 14:49:20.576429 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576255 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.576429 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576301 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerDied","Data":"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581"} Jul 14 14:49:20.576429 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576327 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerDied","Data":"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7"} Jul 14 14:49:20.576429 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576352 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerDied","Data":"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5"} Jul 14 14:49:20.576429 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576375 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerDied","Data":"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5"} Jul 14 14:49:20.576429 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576387 2541 scope.go:117] "RemoveContainer" containerID="c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754" Jul 14 14:49:20.576429 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576398 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerDied","Data":"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7"} Jul 14 14:49:20.576429 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.576420 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e37daaae-7659-44b2-a8d8-c90657fdaca0","Type":"ContainerDied","Data":"1b12b77ef1a7c8581ea6fac3cb2d6c99bb766b24d9dea3ce68505c7c4ac4c0f1"} Jul 14 14:49:20.583831 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.583816 2541 scope.go:117] "RemoveContainer" containerID="96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581" Jul 14 14:49:20.590339 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.590325 2541 scope.go:117] "RemoveContainer" containerID="4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7" Jul 14 14:49:20.596685 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.596670 2541 scope.go:117] "RemoveContainer" containerID="27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5" Jul 14 14:49:20.600167 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.600148 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:49:20.604323 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.604308 2541 scope.go:117] "RemoveContainer" containerID="38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5" Jul 14 14:49:20.606576 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.606558 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:49:20.611053 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.611039 2541 scope.go:117] "RemoveContainer" containerID="3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7" Jul 14 14:49:20.619697 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.619675 2541 scope.go:117] "RemoveContainer" containerID="b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86" Jul 14 14:49:20.628475 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.628456 2541 scope.go:117] "RemoveContainer" containerID="c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754" Jul 14 14:49:20.628740 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:20.628722 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": container with ID starting with c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754 not found: ID does not exist" containerID="c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754" Jul 14 14:49:20.628799 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.628748 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754"} err="failed to get container status \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": rpc error: code = NotFound desc = could not find container \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": container with ID starting with c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754 not found: ID does not exist" Jul 14 14:49:20.628799 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.628767 2541 scope.go:117] "RemoveContainer" containerID="96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581" Jul 14 14:49:20.628967 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:20.628943 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": container with ID starting with 96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581 not found: ID does not exist" containerID="96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581" Jul 14 14:49:20.629018 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.628965 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581"} err="failed to get container status \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": rpc error: code = NotFound desc = could not find container \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": container with ID starting with 96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581 not found: ID does not exist" Jul 14 14:49:20.629018 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.628979 2541 scope.go:117] "RemoveContainer" containerID="4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7" Jul 14 14:49:20.629160 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:20.629146 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": container with ID starting with 4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7 not found: ID does not exist" containerID="4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7" Jul 14 14:49:20.629197 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.629162 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7"} err="failed to get container status \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": rpc error: code = NotFound desc = could not find container \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": container with ID starting with 4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7 not found: ID does not exist" Jul 14 14:49:20.629197 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.629174 2541 scope.go:117] "RemoveContainer" containerID="27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5" Jul 14 14:49:20.629350 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:20.629336 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": container with ID starting with 27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5 not found: ID does not exist" containerID="27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5" Jul 14 14:49:20.629399 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.629351 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5"} err="failed to get container status \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": rpc error: code = NotFound desc = could not find container \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": container with ID starting with 27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5 not found: ID does not exist" Jul 14 14:49:20.629399 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.629363 2541 scope.go:117] "RemoveContainer" containerID="38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5" Jul 14 14:49:20.629586 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:20.629570 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": container with ID starting with 38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5 not found: ID does not exist" containerID="38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5" Jul 14 14:49:20.629674 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.629596 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5"} err="failed to get container status \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": rpc error: code = NotFound desc = could not find container \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": container with ID starting with 38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5 not found: ID does not exist" Jul 14 14:49:20.629674 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.629641 2541 scope.go:117] "RemoveContainer" containerID="3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7" Jul 14 14:49:20.629863 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:20.629848 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": container with ID starting with 3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7 not found: ID does not exist" containerID="3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7" Jul 14 14:49:20.629906 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.629865 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7"} err="failed to get container status \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": rpc error: code = NotFound desc = could not find container \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": container with ID starting with 3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7 not found: ID does not exist" Jul 14 14:49:20.629906 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.629878 2541 scope.go:117] "RemoveContainer" containerID="b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86" Jul 14 14:49:20.630072 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:49:20.630059 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": container with ID starting with b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86 not found: ID does not exist" containerID="b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86" Jul 14 14:49:20.630115 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.630072 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86"} err="failed to get container status \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": rpc error: code = NotFound desc = could not find container \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": container with ID starting with b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86 not found: ID does not exist" Jul 14 14:49:20.630115 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.630082 2541 scope.go:117] "RemoveContainer" containerID="c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754" Jul 14 14:49:20.630254 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.630239 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754"} err="failed to get container status \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": rpc error: code = NotFound desc = could not find container \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": container with ID starting with c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754 not found: ID does not exist" Jul 14 14:49:20.630254 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.630253 2541 scope.go:117] "RemoveContainer" containerID="96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581" Jul 14 14:49:20.630424 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.630403 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581"} err="failed to get container status \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": rpc error: code = NotFound desc = could not find container \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": container with ID starting with 96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581 not found: ID does not exist" Jul 14 14:49:20.630499 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.630426 2541 scope.go:117] "RemoveContainer" containerID="4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7" Jul 14 14:49:20.630789 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.630708 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7"} err="failed to get container status \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": rpc error: code = NotFound desc = could not find container \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": container with ID starting with 4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7 not found: ID does not exist" Jul 14 14:49:20.630789 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.630733 2541 scope.go:117] "RemoveContainer" containerID="27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5" Jul 14 14:49:20.631149 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.631123 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5"} err="failed to get container status \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": rpc error: code = NotFound desc = could not find container \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": container with ID starting with 27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5 not found: ID does not exist" Jul 14 14:49:20.631274 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.631150 2541 scope.go:117] "RemoveContainer" containerID="38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5" Jul 14 14:49:20.631472 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.631445 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5"} err="failed to get container status \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": rpc error: code = NotFound desc = could not find container \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": container with ID starting with 38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5 not found: ID does not exist" Jul 14 14:49:20.631472 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.631472 2541 scope.go:117] "RemoveContainer" containerID="3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7" Jul 14 14:49:20.631744 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.631726 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7"} err="failed to get container status \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": rpc error: code = NotFound desc = could not find container \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": container with ID starting with 3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7 not found: ID does not exist" Jul 14 14:49:20.631827 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.631746 2541 scope.go:117] "RemoveContainer" containerID="b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86" Jul 14 14:49:20.631959 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.631938 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86"} err="failed to get container status \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": rpc error: code = NotFound desc = could not find container \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": container with ID starting with b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86 not found: ID does not exist" Jul 14 14:49:20.631959 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.631957 2541 scope.go:117] "RemoveContainer" containerID="c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754" Jul 14 14:49:20.632182 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.632166 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754"} err="failed to get container status \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": rpc error: code = NotFound desc = could not find container \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": container with ID starting with c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754 not found: ID does not exist" Jul 14 14:49:20.632237 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.632183 2541 scope.go:117] "RemoveContainer" containerID="96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581" Jul 14 14:49:20.632479 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.632457 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581"} err="failed to get container status \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": rpc error: code = NotFound desc = could not find container \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": container with ID starting with 96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581 not found: ID does not exist" Jul 14 14:49:20.632546 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.632482 2541 scope.go:117] "RemoveContainer" containerID="4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7" Jul 14 14:49:20.632734 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.632713 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7"} err="failed to get container status \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": rpc error: code = NotFound desc = could not find container \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": container with ID starting with 4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7 not found: ID does not exist" Jul 14 14:49:20.632807 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.632734 2541 scope.go:117] "RemoveContainer" containerID="27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5" Jul 14 14:49:20.632807 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.632792 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:49:20.632937 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.632916 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5"} err="failed to get container status \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": rpc error: code = NotFound desc = could not find container \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": container with ID starting with 27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5 not found: ID does not exist" Jul 14 14:49:20.632986 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.632937 2541 scope.go:117] "RemoveContainer" containerID="38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5" Jul 14 14:49:20.633146 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633130 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="config-reloader" Jul 14 14:49:20.633210 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633151 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="config-reloader" Jul 14 14:49:20.633210 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633149 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5"} err="failed to get container status \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": rpc error: code = NotFound desc = could not find container \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": container with ID starting with 38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5 not found: ID does not exist" Jul 14 14:49:20.633210 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633164 2541 scope.go:117] "RemoveContainer" containerID="3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7" Jul 14 14:49:20.633210 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633165 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="prom-label-proxy" Jul 14 14:49:20.633210 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633174 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="prom-label-proxy" Jul 14 14:49:20.633210 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633188 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="config-reloader" Jul 14 14:49:20.633210 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633196 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="config-reloader" Jul 14 14:49:20.633210 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633207 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633216 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633230 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy-metric" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633239 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy-metric" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633256 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="init-config-reloader" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633264 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="init-config-reloader" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633274 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="thanos-sidecar" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633282 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="thanos-sidecar" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633291 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy-thanos" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633300 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy-thanos" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633310 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="prometheus" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633318 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="prometheus" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633327 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633335 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633347 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="alertmanager" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633357 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="alertmanager" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633374 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy-web" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633383 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy-web" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633397 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="init-config-reloader" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633405 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="init-config-reloader" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633354 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7"} err="failed to get container status \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": rpc error: code = NotFound desc = could not find container \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": container with ID starting with 3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7 not found: ID does not exist" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633416 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy-web" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633426 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy-web" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633426 2541 scope.go:117] "RemoveContainer" containerID="b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633491 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="config-reloader" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633504 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy-web" Jul 14 14:49:20.633510 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633513 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633522 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy-thanos" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633532 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633542 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="kube-rbac-proxy-metric" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633551 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="prom-label-proxy" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633560 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="config-reloader" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633568 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="6467fc4f-d974-432f-b4a1-621b339d2f6b" containerName="alertmanager" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633576 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="prometheus" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633584 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="thanos-sidecar" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633592 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" containerName="kube-rbac-proxy-web" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633665 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86"} err="failed to get container status \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": rpc error: code = NotFound desc = could not find container \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": container with ID starting with b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86 not found: ID does not exist" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633684 2541 scope.go:117] "RemoveContainer" containerID="c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633875 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754"} err="failed to get container status \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": rpc error: code = NotFound desc = could not find container \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": container with ID starting with c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754 not found: ID does not exist" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.633887 2541 scope.go:117] "RemoveContainer" containerID="96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.634085 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581"} err="failed to get container status \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": rpc error: code = NotFound desc = could not find container \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": container with ID starting with 96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581 not found: ID does not exist" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.634099 2541 scope.go:117] "RemoveContainer" containerID="4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.634340 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7"} err="failed to get container status \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": rpc error: code = NotFound desc = could not find container \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": container with ID starting with 4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7 not found: ID does not exist" Jul 14 14:49:20.634443 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.634361 2541 scope.go:117] "RemoveContainer" containerID="27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5" Jul 14 14:49:20.635059 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.634561 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5"} err="failed to get container status \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": rpc error: code = NotFound desc = could not find container \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": container with ID starting with 27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5 not found: ID does not exist" Jul 14 14:49:20.635059 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.634576 2541 scope.go:117] "RemoveContainer" containerID="38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5" Jul 14 14:49:20.635059 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.634806 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5"} err="failed to get container status \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": rpc error: code = NotFound desc = could not find container \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": container with ID starting with 38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5 not found: ID does not exist" Jul 14 14:49:20.635059 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.634820 2541 scope.go:117] "RemoveContainer" containerID="3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7" Jul 14 14:49:20.635059 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.635017 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7"} err="failed to get container status \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": rpc error: code = NotFound desc = could not find container \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": container with ID starting with 3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7 not found: ID does not exist" Jul 14 14:49:20.635059 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.635033 2541 scope.go:117] "RemoveContainer" containerID="b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86" Jul 14 14:49:20.635297 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.635218 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86"} err="failed to get container status \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": rpc error: code = NotFound desc = could not find container \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": container with ID starting with b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86 not found: ID does not exist" Jul 14 14:49:20.635297 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.635238 2541 scope.go:117] "RemoveContainer" containerID="c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754" Jul 14 14:49:20.635434 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.635417 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754"} err="failed to get container status \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": rpc error: code = NotFound desc = could not find container \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": container with ID starting with c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754 not found: ID does not exist" Jul 14 14:49:20.635474 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.635434 2541 scope.go:117] "RemoveContainer" containerID="96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581" Jul 14 14:49:20.635714 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.635694 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581"} err="failed to get container status \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": rpc error: code = NotFound desc = could not find container \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": container with ID starting with 96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581 not found: ID does not exist" Jul 14 14:49:20.635761 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.635717 2541 scope.go:117] "RemoveContainer" containerID="4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7" Jul 14 14:49:20.635930 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.635913 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7"} err="failed to get container status \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": rpc error: code = NotFound desc = could not find container \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": container with ID starting with 4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7 not found: ID does not exist" Jul 14 14:49:20.635966 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.635930 2541 scope.go:117] "RemoveContainer" containerID="27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5" Jul 14 14:49:20.636216 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.636195 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5"} err="failed to get container status \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": rpc error: code = NotFound desc = could not find container \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": container with ID starting with 27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5 not found: ID does not exist" Jul 14 14:49:20.636277 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.636218 2541 scope.go:117] "RemoveContainer" containerID="38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5" Jul 14 14:49:20.636464 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.636443 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5"} err="failed to get container status \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": rpc error: code = NotFound desc = could not find container \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": container with ID starting with 38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5 not found: ID does not exist" Jul 14 14:49:20.636519 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.636467 2541 scope.go:117] "RemoveContainer" containerID="3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7" Jul 14 14:49:20.636757 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.636734 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7"} err="failed to get container status \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": rpc error: code = NotFound desc = could not find container \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": container with ID starting with 3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7 not found: ID does not exist" Jul 14 14:49:20.636757 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.636756 2541 scope.go:117] "RemoveContainer" containerID="b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86" Jul 14 14:49:20.637021 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.636997 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86"} err="failed to get container status \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": rpc error: code = NotFound desc = could not find container \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": container with ID starting with b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86 not found: ID does not exist" Jul 14 14:49:20.637074 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.637027 2541 scope.go:117] "RemoveContainer" containerID="c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754" Jul 14 14:49:20.637293 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.637271 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754"} err="failed to get container status \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": rpc error: code = NotFound desc = could not find container \"c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754\": container with ID starting with c70f82e4e79006831344f32ca07865ed7d8a0c538bb587e9419cd0e71f508754 not found: ID does not exist" Jul 14 14:49:20.637340 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.637298 2541 scope.go:117] "RemoveContainer" containerID="96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581" Jul 14 14:49:20.637529 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.637508 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581"} err="failed to get container status \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": rpc error: code = NotFound desc = could not find container \"96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581\": container with ID starting with 96045d859a4cc3508c0c36da7a04419a5bf5bdcd090287349e60fefcd8bda581 not found: ID does not exist" Jul 14 14:49:20.637599 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.637531 2541 scope.go:117] "RemoveContainer" containerID="4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7" Jul 14 14:49:20.637790 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.637766 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7"} err="failed to get container status \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": rpc error: code = NotFound desc = could not find container \"4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7\": container with ID starting with 4f3ce0d253c3d9d9789f99c5def1f249246cf770c3b564e4f538663407be57f7 not found: ID does not exist" Jul 14 14:49:20.637829 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.637794 2541 scope.go:117] "RemoveContainer" containerID="27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5" Jul 14 14:49:20.638017 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.637998 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5"} err="failed to get container status \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": rpc error: code = NotFound desc = could not find container \"27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5\": container with ID starting with 27a5d1c6763528295b174cf54729806e54f5431618764b7fbeede5cdd9bd93c5 not found: ID does not exist" Jul 14 14:49:20.638072 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.638018 2541 scope.go:117] "RemoveContainer" containerID="38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5" Jul 14 14:49:20.638206 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.638190 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5"} err="failed to get container status \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": rpc error: code = NotFound desc = could not find container \"38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5\": container with ID starting with 38eb5a085d5cbe8ade96d30670e780a102b1574b842a1e4eba0ef1eb14c90ed5 not found: ID does not exist" Jul 14 14:49:20.638253 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.638208 2541 scope.go:117] "RemoveContainer" containerID="3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7" Jul 14 14:49:20.638393 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.638375 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7"} err="failed to get container status \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": rpc error: code = NotFound desc = could not find container \"3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7\": container with ID starting with 3a4f4bb6ffca8c0a0eabea7f780e5ddd2f1a6c42967d105abfcf2b5334d4e4d7 not found: ID does not exist" Jul 14 14:49:20.638463 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.638395 2541 scope.go:117] "RemoveContainer" containerID="b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86" Jul 14 14:49:20.638608 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.638586 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86"} err="failed to get container status \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": rpc error: code = NotFound desc = could not find container \"b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86\": container with ID starting with b81d71b4cba15d8fd95a41c21c851977036825b844bfca7b5e00723495afdd86 not found: ID does not exist" Jul 14 14:49:20.639301 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.639285 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.642241 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.642208 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 14:49:20.642584 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.642259 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 14:49:20.642584 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.642208 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 14:49:20.642584 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.642336 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 14:49:20.642584 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.642339 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 14:49:20.642584 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.642264 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 14:49:20.642584 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.642260 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 14:49:20.642584 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.642208 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 14:49:20.642947 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.642813 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 14:49:20.642947 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.642838 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 14:49:20.642947 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.642867 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9qujab2n8msj8\"" Jul 14 14:49:20.643087 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.643054 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 14:49:20.643143 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.643087 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lcrgc\"" Jul 14 14:49:20.643143 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.643125 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 14:49:20.643361 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.643344 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 14:49:20.646647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.646609 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 14:49:20.650779 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.650763 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 14:49:20.654735 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.654715 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:49:20.687036 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687008 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687121 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687048 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687121 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687072 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp9tf\" (UniqueName: \"kubernetes.io/projected/727af093-b130-47d4-a9d5-4835189f5cab-kube-api-access-bp9tf\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687121 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687098 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687244 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687159 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687244 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687200 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687244 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687217 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687356 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687259 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687356 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687286 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-config\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687356 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687307 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-web-config\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687356 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687335 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687517 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687352 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687517 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687401 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687517 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687461 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/727af093-b130-47d4-a9d5-4835189f5cab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687517 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687495 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/727af093-b130-47d4-a9d5-4835189f5cab-config-out\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687748 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687523 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687748 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687560 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687748 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687606 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687748 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687667 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.687748 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.687692 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.788778 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.788756 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.788873 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.788784 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.788873 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.788800 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.788873 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.788820 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.788873 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.788845 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-config\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.788873 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.788870 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-web-config\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789109 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.788919 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789109 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.788959 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789109 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789001 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789109 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789034 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/727af093-b130-47d4-a9d5-4835189f5cab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789109 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789059 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/727af093-b130-47d4-a9d5-4835189f5cab-config-out\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789109 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789083 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789392 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789117 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789392 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789162 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789392 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789167 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789392 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789211 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789392 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789239 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789392 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789265 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789392 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789292 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789392 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789321 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp9tf\" (UniqueName: \"kubernetes.io/projected/727af093-b130-47d4-a9d5-4835189f5cab-kube-api-access-bp9tf\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.789392 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789385 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.790006 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.789405 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.790069 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.790003 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.790124 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.790109 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.790546 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.790515 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.791154 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.790993 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.792705 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.792647 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.792964 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.792944 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/727af093-b130-47d4-a9d5-4835189f5cab-config-out\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.793096 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.792979 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.793467 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.793436 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.793541 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.793490 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.794004 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.793979 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-web-config\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.794160 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.794143 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-config\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.794220 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.794198 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.794466 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.794443 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.794534 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.794520 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/727af093-b130-47d4-a9d5-4835189f5cab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.794737 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.794714 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/727af093-b130-47d4-a9d5-4835189f5cab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.794881 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.794864 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.795492 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.795473 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/727af093-b130-47d4-a9d5-4835189f5cab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.798513 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.798497 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp9tf\" (UniqueName: \"kubernetes.io/projected/727af093-b130-47d4-a9d5-4835189f5cab-kube-api-access-bp9tf\") pod \"prometheus-k8s-0\" (UID: \"727af093-b130-47d4-a9d5-4835189f5cab\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:20.948341 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:20.948314 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:49:21.083405 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:21.083302 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:49:21.087955 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:49:21.087928 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727af093_b130_47d4_a9d5_4835189f5cab.slice/crio-10e8991ab7d6068b803c29c728b983aee87b802e25e576c8e3796c2b0c56eaa6 WatchSource:0}: Error finding container 10e8991ab7d6068b803c29c728b983aee87b802e25e576c8e3796c2b0c56eaa6: Status 404 returned error can't find the container with id 10e8991ab7d6068b803c29c728b983aee87b802e25e576c8e3796c2b0c56eaa6 Jul 14 14:49:21.581089 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:21.581059 2541 generic.go:356] "Generic (PLEG): container finished" podID="727af093-b130-47d4-a9d5-4835189f5cab" containerID="1fad0667105d79ebcfee1e8ef5c9380894b8bc91ada7bc3040de2d9a0fdc0918" exitCode=0 Jul 14 14:49:21.581264 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:21.581142 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"727af093-b130-47d4-a9d5-4835189f5cab","Type":"ContainerDied","Data":"1fad0667105d79ebcfee1e8ef5c9380894b8bc91ada7bc3040de2d9a0fdc0918"} Jul 14 14:49:21.581264 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:21.581211 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"727af093-b130-47d4-a9d5-4835189f5cab","Type":"ContainerStarted","Data":"10e8991ab7d6068b803c29c728b983aee87b802e25e576c8e3796c2b0c56eaa6"} Jul 14 14:49:21.850892 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:21.850835 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e37daaae-7659-44b2-a8d8-c90657fdaca0" path="/var/lib/kubelet/pods/e37daaae-7659-44b2-a8d8-c90657fdaca0/volumes" Jul 14 14:49:22.593862 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:22.593829 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"727af093-b130-47d4-a9d5-4835189f5cab","Type":"ContainerStarted","Data":"555dac70cecae36ea27e52ee209e053f1ef99ac9ba747d3aa76aa6793551d6a0"} Jul 14 14:49:22.594308 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:22.593903 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"727af093-b130-47d4-a9d5-4835189f5cab","Type":"ContainerStarted","Data":"426134b084d50987a3e21e080d958e42eec200febd3ed3330f1537f271c0429d"} Jul 14 14:49:22.594308 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:22.593941 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"727af093-b130-47d4-a9d5-4835189f5cab","Type":"ContainerStarted","Data":"051a63275fe16e0e09e6fdfbb07aad78bfe833e76abc0096c0b2c7af3df48d41"} Jul 14 14:49:22.594308 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:22.593990 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"727af093-b130-47d4-a9d5-4835189f5cab","Type":"ContainerStarted","Data":"fb6d695c5c7ef4e1951a15ef50781be840e198a5c7e7c33b37f4be6a6473a5a7"} Jul 14 14:49:22.594308 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:22.594030 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"727af093-b130-47d4-a9d5-4835189f5cab","Type":"ContainerStarted","Data":"d1bf1fffaffe9c06750358eaf94152797db02d72a228b6c85696b83dc8637a98"} Jul 14 14:49:22.594308 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:22.594068 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"727af093-b130-47d4-a9d5-4835189f5cab","Type":"ContainerStarted","Data":"bdc96d443cda9fb25c2e272d99a5e680bc4a6a815075d9b8d678150849e7edc6"} Jul 14 14:49:22.672335 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:22.672289 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.655331746 podStartE2EDuration="2.672273977s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.942231ms" isStatefulPod=false podCreationTimestamp="2026-07-14 14:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:49:22.667482293 +0000 UTC m=+159.223144381" watchObservedRunningTime="2026-07-14 14:49:22.672273977 +0000 UTC m=+159.227936068" Jul 14 14:49:25.949084 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:49:25.949052 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:50:20.948503 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:50:20.948468 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:50:20.964288 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:50:20.964266 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:50:21.816173 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:50:21.816147 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:51:12.464125 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.464045 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7n4fc"] Jul 14 14:51:12.467329 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.467310 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7n4fc" Jul 14 14:51:12.470629 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.470602 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 14:51:12.470710 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.470641 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-446f5\"" Jul 14 14:51:12.471541 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.471522 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 14:51:12.487345 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.487326 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7n4fc"] Jul 14 14:51:12.601334 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.601307 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29ebc021-d1e7-4543-8e0e-8e061f0ee73e-bound-sa-token\") pod \"cert-manager-55b4d954d5-7n4fc\" (UID: \"29ebc021-d1e7-4543-8e0e-8e061f0ee73e\") " pod="cert-manager/cert-manager-55b4d954d5-7n4fc" Jul 14 14:51:12.601478 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.601421 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m98hl\" (UniqueName: \"kubernetes.io/projected/29ebc021-d1e7-4543-8e0e-8e061f0ee73e-kube-api-access-m98hl\") pod \"cert-manager-55b4d954d5-7n4fc\" (UID: \"29ebc021-d1e7-4543-8e0e-8e061f0ee73e\") " pod="cert-manager/cert-manager-55b4d954d5-7n4fc" Jul 14 14:51:12.702229 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.702202 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m98hl\" (UniqueName: \"kubernetes.io/projected/29ebc021-d1e7-4543-8e0e-8e061f0ee73e-kube-api-access-m98hl\") pod \"cert-manager-55b4d954d5-7n4fc\" (UID: \"29ebc021-d1e7-4543-8e0e-8e061f0ee73e\") " pod="cert-manager/cert-manager-55b4d954d5-7n4fc" Jul 14 14:51:12.702394 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.702265 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29ebc021-d1e7-4543-8e0e-8e061f0ee73e-bound-sa-token\") pod \"cert-manager-55b4d954d5-7n4fc\" (UID: \"29ebc021-d1e7-4543-8e0e-8e061f0ee73e\") " pod="cert-manager/cert-manager-55b4d954d5-7n4fc" Jul 14 14:51:12.719069 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.718997 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29ebc021-d1e7-4543-8e0e-8e061f0ee73e-bound-sa-token\") pod \"cert-manager-55b4d954d5-7n4fc\" (UID: \"29ebc021-d1e7-4543-8e0e-8e061f0ee73e\") " pod="cert-manager/cert-manager-55b4d954d5-7n4fc" Jul 14 14:51:12.719370 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.719351 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m98hl\" (UniqueName: \"kubernetes.io/projected/29ebc021-d1e7-4543-8e0e-8e061f0ee73e-kube-api-access-m98hl\") pod \"cert-manager-55b4d954d5-7n4fc\" (UID: \"29ebc021-d1e7-4543-8e0e-8e061f0ee73e\") " pod="cert-manager/cert-manager-55b4d954d5-7n4fc" Jul 14 14:51:12.783930 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.783908 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7n4fc" Jul 14 14:51:12.911661 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.911609 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7n4fc"] Jul 14 14:51:12.915389 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:51:12.915363 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29ebc021_d1e7_4543_8e0e_8e061f0ee73e.slice/crio-79666de2469fdd15782df3060916047d253447616f113593cfd7d7e83cdb9aa0 WatchSource:0}: Error finding container 79666de2469fdd15782df3060916047d253447616f113593cfd7d7e83cdb9aa0: Status 404 returned error can't find the container with id 79666de2469fdd15782df3060916047d253447616f113593cfd7d7e83cdb9aa0 Jul 14 14:51:12.973743 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:12.973685 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7n4fc" event={"ID":"29ebc021-d1e7-4543-8e0e-8e061f0ee73e","Type":"ContainerStarted","Data":"79666de2469fdd15782df3060916047d253447616f113593cfd7d7e83cdb9aa0"} Jul 14 14:51:15.987809 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:15.987735 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7n4fc" event={"ID":"29ebc021-d1e7-4543-8e0e-8e061f0ee73e","Type":"ContainerStarted","Data":"19f7150425193a0686b0c6593be686fcf2fedfc9d3c51a503927b4643c540470"} Jul 14 14:51:16.007589 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:16.007545 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-7n4fc" podStartSLOduration=1.191774049 podStartE2EDuration="4.007531649s" totalImagesPullingTime="2.8157576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:51:16.0053643 +0000 UTC m=+272.561026400" watchObservedRunningTime="2026-07-14 14:51:16.007531649 +0000 UTC m=+272.563193737" Jul 14 14:51:33.711910 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.711872 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh"] Jul 14 14:51:33.718791 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.718765 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.724886 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.724867 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 14:51:33.725343 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.725049 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 14:51:33.725724 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.725705 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 14:51:33.725829 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.725703 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rpddx\"" Jul 14 14:51:33.725829 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.725711 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 14:51:33.739434 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.739412 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh"] Jul 14 14:51:33.857393 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.857370 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/158bac80-bb24-4567-8095-f979f06cde2b-webhook-cert\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.857526 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.857400 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdrg5\" (UniqueName: \"kubernetes.io/projected/158bac80-bb24-4567-8095-f979f06cde2b-kube-api-access-fdrg5\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.857526 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.857435 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/158bac80-bb24-4567-8095-f979f06cde2b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.857526 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.857485 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/158bac80-bb24-4567-8095-f979f06cde2b-manifests\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.857526 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.857518 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/158bac80-bb24-4567-8095-f979f06cde2b-tmp\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.957999 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.957956 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/158bac80-bb24-4567-8095-f979f06cde2b-webhook-cert\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.958131 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.958004 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdrg5\" (UniqueName: \"kubernetes.io/projected/158bac80-bb24-4567-8095-f979f06cde2b-kube-api-access-fdrg5\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.958131 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.958035 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/158bac80-bb24-4567-8095-f979f06cde2b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.958131 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.958054 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/158bac80-bb24-4567-8095-f979f06cde2b-manifests\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.958131 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.958074 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/158bac80-bb24-4567-8095-f979f06cde2b-tmp\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.958479 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.958455 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/158bac80-bb24-4567-8095-f979f06cde2b-manifests\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.960418 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.960391 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/158bac80-bb24-4567-8095-f979f06cde2b-tmp\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.960502 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.960436 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/158bac80-bb24-4567-8095-f979f06cde2b-webhook-cert\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.960644 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.960604 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/158bac80-bb24-4567-8095-f979f06cde2b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:33.972731 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:33.972678 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdrg5\" (UniqueName: \"kubernetes.io/projected/158bac80-bb24-4567-8095-f979f06cde2b-kube-api-access-fdrg5\") pod \"opendatahub-operator-controller-manager-8ddb9f9b5-62dfh\" (UID: \"158bac80-bb24-4567-8095-f979f06cde2b\") " pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:34.028532 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:34.028504 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:34.184209 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:34.184177 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh"] Jul 14 14:51:34.188394 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:51:34.188365 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158bac80_bb24_4567_8095_f979f06cde2b.slice/crio-746aa49482e03b862241d1ccea9f92925c55a8da31dc404aef63ad684c61d3b0 WatchSource:0}: Error finding container 746aa49482e03b862241d1ccea9f92925c55a8da31dc404aef63ad684c61d3b0: Status 404 returned error can't find the container with id 746aa49482e03b862241d1ccea9f92925c55a8da31dc404aef63ad684c61d3b0 Jul 14 14:51:35.056907 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:35.056867 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" event={"ID":"158bac80-bb24-4567-8095-f979f06cde2b","Type":"ContainerStarted","Data":"746aa49482e03b862241d1ccea9f92925c55a8da31dc404aef63ad684c61d3b0"} Jul 14 14:51:38.069537 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:38.069499 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" event={"ID":"158bac80-bb24-4567-8095-f979f06cde2b","Type":"ContainerStarted","Data":"10fd8c4c6ef202eed3ef2f9cd1552ce7a63afb1c8e4119215cade5b81b4e17f3"} Jul 14 14:51:39.074131 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:39.074097 2541 generic.go:356] "Generic (PLEG): container finished" podID="158bac80-bb24-4567-8095-f979f06cde2b" containerID="10fd8c4c6ef202eed3ef2f9cd1552ce7a63afb1c8e4119215cade5b81b4e17f3" exitCode=0 Jul 14 14:51:39.074508 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:39.074153 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" event={"ID":"158bac80-bb24-4567-8095-f979f06cde2b","Type":"ContainerDied","Data":"10fd8c4c6ef202eed3ef2f9cd1552ce7a63afb1c8e4119215cade5b81b4e17f3"} Jul 14 14:51:40.084376 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:40.084336 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" event={"ID":"158bac80-bb24-4567-8095-f979f06cde2b","Type":"ContainerStarted","Data":"fe53ea10422271ca622bda82677b205470945a560d1eabc58195eb5ea7e98d4c"} Jul 14 14:51:40.084966 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:40.084946 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:43.755611 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:43.755581 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 14:51:43.759152 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:43.759122 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 14:51:43.763488 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:43.763472 2541 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 14:51:52.093640 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:52.093589 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" Jul 14 14:51:52.122935 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:52.122885 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8ddb9f9b5-62dfh" podStartSLOduration=14.697923523 podStartE2EDuration="19.122870085s" totalImagesPullingTime="3.422137281s" totalInitContainerRuntime="1.002809281s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:51:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:51:40.147512039 +0000 UTC m=+296.703174130" watchObservedRunningTime="2026-07-14 14:51:52.122870085 +0000 UTC m=+308.678532174" Jul 14 14:51:54.617744 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.617715 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld"] Jul 14 14:51:54.621244 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.621224 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" Jul 14 14:51:54.629935 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.629911 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 14:51:54.630057 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.629941 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rs85j\"" Jul 14 14:51:54.630057 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.629983 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 14:51:54.630352 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.630337 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 14:51:54.630749 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.630730 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 14:51:54.641941 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.641917 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld"] Jul 14 14:51:54.808334 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.808303 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a6334cc-9689-4762-9990-02ba442a86df-tls-certs\") pod \"kube-auth-proxy-7cb8f87c7d-7fvld\" (UID: \"4a6334cc-9689-4762-9990-02ba442a86df\") " pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" Jul 14 14:51:54.808493 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.808412 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a6334cc-9689-4762-9990-02ba442a86df-tmp\") pod \"kube-auth-proxy-7cb8f87c7d-7fvld\" (UID: \"4a6334cc-9689-4762-9990-02ba442a86df\") " pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" Jul 14 14:51:54.808493 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.808447 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmj98\" (UniqueName: \"kubernetes.io/projected/4a6334cc-9689-4762-9990-02ba442a86df-kube-api-access-fmj98\") pod \"kube-auth-proxy-7cb8f87c7d-7fvld\" (UID: \"4a6334cc-9689-4762-9990-02ba442a86df\") " pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" Jul 14 14:51:54.909589 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.909558 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a6334cc-9689-4762-9990-02ba442a86df-tls-certs\") pod \"kube-auth-proxy-7cb8f87c7d-7fvld\" (UID: \"4a6334cc-9689-4762-9990-02ba442a86df\") " pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" Jul 14 14:51:54.909787 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.909606 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a6334cc-9689-4762-9990-02ba442a86df-tmp\") pod \"kube-auth-proxy-7cb8f87c7d-7fvld\" (UID: \"4a6334cc-9689-4762-9990-02ba442a86df\") " pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" Jul 14 14:51:54.909787 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.909653 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmj98\" (UniqueName: \"kubernetes.io/projected/4a6334cc-9689-4762-9990-02ba442a86df-kube-api-access-fmj98\") pod \"kube-auth-proxy-7cb8f87c7d-7fvld\" (UID: \"4a6334cc-9689-4762-9990-02ba442a86df\") " pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" Jul 14 14:51:54.911943 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.911915 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a6334cc-9689-4762-9990-02ba442a86df-tmp\") pod \"kube-auth-proxy-7cb8f87c7d-7fvld\" (UID: \"4a6334cc-9689-4762-9990-02ba442a86df\") " pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" Jul 14 14:51:54.912051 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.912034 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a6334cc-9689-4762-9990-02ba442a86df-tls-certs\") pod \"kube-auth-proxy-7cb8f87c7d-7fvld\" (UID: \"4a6334cc-9689-4762-9990-02ba442a86df\") " pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" Jul 14 14:51:54.920329 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.920304 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmj98\" (UniqueName: \"kubernetes.io/projected/4a6334cc-9689-4762-9990-02ba442a86df-kube-api-access-fmj98\") pod \"kube-auth-proxy-7cb8f87c7d-7fvld\" (UID: \"4a6334cc-9689-4762-9990-02ba442a86df\") " pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" Jul 14 14:51:54.932994 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:54.932970 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" Jul 14 14:51:55.079596 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:55.079574 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld"] Jul 14 14:51:55.081453 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:51:55.081425 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6334cc_9689_4762_9990_02ba442a86df.slice/crio-7e6f9197e28f62549e6f01d8bf301190e3a1372794bd7f40982f18b4e7ce7a7d WatchSource:0}: Error finding container 7e6f9197e28f62549e6f01d8bf301190e3a1372794bd7f40982f18b4e7ce7a7d: Status 404 returned error can't find the container with id 7e6f9197e28f62549e6f01d8bf301190e3a1372794bd7f40982f18b4e7ce7a7d Jul 14 14:51:55.083122 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:55.083107 2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 14:51:55.139247 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:55.139218 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" event={"ID":"4a6334cc-9689-4762-9990-02ba442a86df","Type":"ContainerStarted","Data":"7e6f9197e28f62549e6f01d8bf301190e3a1372794bd7f40982f18b4e7ce7a7d"} Jul 14 14:51:56.255592 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.255555 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v5msv"] Jul 14 14:51:56.260561 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.260539 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.263232 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.263197 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-d6znc\"" Jul 14 14:51:56.263386 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.263365 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 14:51:56.263598 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.263581 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 14:51:56.263861 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.263842 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 14:51:56.264229 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.264214 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 14:51:56.281939 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.281905 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v5msv"] Jul 14 14:51:56.319865 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.319841 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52317ab4-0d19-464a-952a-be00ab80acd5-local-certs\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.319976 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.319879 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.319976 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.319899 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-istio-token\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.319976 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.319928 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.320099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.319981 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.320099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.320047 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-cacerts\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.320099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.320067 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg869\" (UniqueName: \"kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-kube-api-access-pg869\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.421196 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.421158 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-cacerts\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.421389 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.421201 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg869\" (UniqueName: \"kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-kube-api-access-pg869\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.421389 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.421257 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52317ab4-0d19-464a-952a-be00ab80acd5-local-certs\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.421389 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.421296 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.421389 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.421327 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-istio-token\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.421389 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.421360 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.421389 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.421383 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.422459 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.422428 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.423883 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.423858 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52317ab4-0d19-464a-952a-be00ab80acd5-local-certs\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.424048 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.424026 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.424193 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.424172 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-cacerts\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.424908 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.424889 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.430089 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.430067 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-istio-token\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.431057 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.431031 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg869\" (UniqueName: \"kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-kube-api-access-pg869\") pod \"istiod-openshift-gateway-7574459656-v5msv\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.571210 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.571133 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:51:56.730846 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:56.730803 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v5msv"] Jul 14 14:51:56.734817 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:51:56.734785 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52317ab4_0d19_464a_952a_be00ab80acd5.slice/crio-cce7da01ebbc1d8e57bb829e71cd6f0c67f357c48a2643dea77ae12601ee013c WatchSource:0}: Error finding container cce7da01ebbc1d8e57bb829e71cd6f0c67f357c48a2643dea77ae12601ee013c: Status 404 returned error can't find the container with id cce7da01ebbc1d8e57bb829e71cd6f0c67f357c48a2643dea77ae12601ee013c Jul 14 14:51:57.149594 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:57.149556 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" event={"ID":"52317ab4-0d19-464a-952a-be00ab80acd5","Type":"ContainerStarted","Data":"cce7da01ebbc1d8e57bb829e71cd6f0c67f357c48a2643dea77ae12601ee013c"} Jul 14 14:51:59.937253 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:59.937215 2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 14 14:51:59.937652 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:51:59.937296 2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 14 14:52:00.167438 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:00.167397 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" event={"ID":"4a6334cc-9689-4762-9990-02ba442a86df","Type":"ContainerStarted","Data":"0493fc946d738416dc96fa0f7515568faacc50f43a201786ed6a109f9c503eff"} Jul 14 14:52:00.169111 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:00.169085 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" event={"ID":"52317ab4-0d19-464a-952a-be00ab80acd5","Type":"ContainerStarted","Data":"d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb"} Jul 14 14:52:00.169261 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:00.169244 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:52:00.188892 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:00.188797 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cb8f87c7d-7fvld" podStartSLOduration=1.3369191630000001 podStartE2EDuration="6.188777086s" totalImagesPullingTime="4.851857923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:52:00.187496882 +0000 UTC m=+316.743158972" watchObservedRunningTime="2026-07-14 14:52:00.188777086 +0000 UTC m=+316.744439176" Jul 14 14:52:00.213307 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:00.213262 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" podStartSLOduration=1.013558637 podStartE2EDuration="4.213246757s" totalImagesPullingTime="3.19968812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:52:00.211855735 +0000 UTC m=+316.767517854" watchObservedRunningTime="2026-07-14 14:52:00.213246757 +0000 UTC m=+316.768908845" Jul 14 14:52:01.175895 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:01.175855 2541 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-v5msv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 14:52:01.176267 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:01.175907 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" podUID="52317ab4-0d19-464a-952a-be00ab80acd5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 14:52:04.175019 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.174990 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:52:04.642673 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.642577 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq"] Jul 14 14:52:04.645540 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.645522 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.667426 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.667404 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq"] Jul 14 14:52:04.691441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.691416 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.691632 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.691466 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c3a7c254-3e7a-44b1-bdde-4b707d158132-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.691632 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.691509 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.691632 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.691529 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.691632 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.691589 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.691802 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.691652 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3a7c254-3e7a-44b1-bdde-4b707d158132-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.691802 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.691667 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv8bz\" (UniqueName: \"kubernetes.io/projected/c3a7c254-3e7a-44b1-bdde-4b707d158132-kube-api-access-fv8bz\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.792864 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.792842 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.792991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.792874 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.792991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.792907 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3a7c254-3e7a-44b1-bdde-4b707d158132-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.792991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.792931 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv8bz\" (UniqueName: \"kubernetes.io/projected/c3a7c254-3e7a-44b1-bdde-4b707d158132-kube-api-access-fv8bz\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.792991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.792989 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.793184 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.793019 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c3a7c254-3e7a-44b1-bdde-4b707d158132-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.793184 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.793061 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.794035 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.794008 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.795334 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.795312 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c3a7c254-3e7a-44b1-bdde-4b707d158132-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.795446 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.795386 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.795446 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.795425 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3a7c254-3e7a-44b1-bdde-4b707d158132-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.795557 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.795485 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.805274 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.805256 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3a7c254-3e7a-44b1-bdde-4b707d158132-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.806029 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.805995 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv8bz\" (UniqueName: \"kubernetes.io/projected/c3a7c254-3e7a-44b1-bdde-4b707d158132-kube-api-access-fv8bz\") pod \"istiod-openshift-gateway-94bb8fbfd-lt9tq\" (UID: \"c3a7c254-3e7a-44b1-bdde-4b707d158132\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:04.954501 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:04.954476 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:05.154760 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:05.152479 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq"] Jul 14 14:52:05.158563 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:52:05.158539 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a7c254_3e7a_44b1_bdde_4b707d158132.slice/crio-d8555c39979bd27ab2717685ce6ff9bc809e42a935167a9e88bd8cb63ab69755 WatchSource:0}: Error finding container d8555c39979bd27ab2717685ce6ff9bc809e42a935167a9e88bd8cb63ab69755: Status 404 returned error can't find the container with id d8555c39979bd27ab2717685ce6ff9bc809e42a935167a9e88bd8cb63ab69755 Jul 14 14:52:05.161366 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:05.161336 2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 14 14:52:05.161430 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:05.161408 2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 14 14:52:05.191764 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:05.191727 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" event={"ID":"c3a7c254-3e7a-44b1-bdde-4b707d158132","Type":"ContainerStarted","Data":"d8555c39979bd27ab2717685ce6ff9bc809e42a935167a9e88bd8cb63ab69755"} Jul 14 14:52:06.197128 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.197091 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" event={"ID":"c3a7c254-3e7a-44b1-bdde-4b707d158132","Type":"ContainerStarted","Data":"e73c3a80b354af219cb36d6eaf24b8b7ab4dc2e7c0dde3a362fa188168b21bad"} Jul 14 14:52:06.197579 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.197286 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:06.198839 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.198821 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" Jul 14 14:52:06.226684 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.226636 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lt9tq" podStartSLOduration=2.226597523 podStartE2EDuration="2.226597523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:52:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:52:06.224860369 +0000 UTC m=+322.780522459" watchObservedRunningTime="2026-07-14 14:52:06.226597523 +0000 UTC m=+322.782259612" Jul 14 14:52:06.321823 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.321791 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v5msv"] Jul 14 14:52:06.321965 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.321950 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" podUID="52317ab4-0d19-464a-952a-be00ab80acd5" containerName="discovery" containerID="cri-o://d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb" gracePeriod=30 Jul 14 14:52:06.577248 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.577228 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:52:06.607998 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.607975 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg869\" (UniqueName: \"kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-kube-api-access-pg869\") pod \"52317ab4-0d19-464a-952a-be00ab80acd5\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " Jul 14 14:52:06.608097 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.608007 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-dns-cert\") pod \"52317ab4-0d19-464a-952a-be00ab80acd5\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " Jul 14 14:52:06.608097 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.608038 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-istio-token\") pod \"52317ab4-0d19-464a-952a-be00ab80acd5\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " Jul 14 14:52:06.608231 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.608160 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-ca-configmap\") pod \"52317ab4-0d19-464a-952a-be00ab80acd5\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " Jul 14 14:52:06.608231 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.608213 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-kubeconfig\") pod \"52317ab4-0d19-464a-952a-be00ab80acd5\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " Jul 14 14:52:06.608308 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.608273 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52317ab4-0d19-464a-952a-be00ab80acd5-local-certs\") pod \"52317ab4-0d19-464a-952a-be00ab80acd5\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " Jul 14 14:52:06.608308 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.608299 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-cacerts\") pod \"52317ab4-0d19-464a-952a-be00ab80acd5\" (UID: \"52317ab4-0d19-464a-952a-be00ab80acd5\") " Jul 14 14:52:06.608774 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.608516 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "52317ab4-0d19-464a-952a-be00ab80acd5" (UID: "52317ab4-0d19-464a-952a-be00ab80acd5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:52:06.610544 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.610520 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "52317ab4-0d19-464a-952a-be00ab80acd5" (UID: "52317ab4-0d19-464a-952a-be00ab80acd5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:52:06.610544 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.610533 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "52317ab4-0d19-464a-952a-be00ab80acd5" (UID: "52317ab4-0d19-464a-952a-be00ab80acd5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:52:06.610762 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.610743 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-istio-token" (OuterVolumeSpecName: "istio-token") pod "52317ab4-0d19-464a-952a-be00ab80acd5" (UID: "52317ab4-0d19-464a-952a-be00ab80acd5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:52:06.610823 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.610801 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52317ab4-0d19-464a-952a-be00ab80acd5-local-certs" (OuterVolumeSpecName: "local-certs") pod "52317ab4-0d19-464a-952a-be00ab80acd5" (UID: "52317ab4-0d19-464a-952a-be00ab80acd5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:52:06.610860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.610845 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-kube-api-access-pg869" (OuterVolumeSpecName: "kube-api-access-pg869") pod "52317ab4-0d19-464a-952a-be00ab80acd5" (UID: "52317ab4-0d19-464a-952a-be00ab80acd5"). InnerVolumeSpecName "kube-api-access-pg869". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:52:06.610944 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.610926 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-cacerts" (OuterVolumeSpecName: "cacerts") pod "52317ab4-0d19-464a-952a-be00ab80acd5" (UID: "52317ab4-0d19-464a-952a-be00ab80acd5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:52:06.709501 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.709475 2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:52:06.709501 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.709501 2541 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-ca-configmap\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:52:06.709683 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.709510 2541 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-kubeconfig\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:52:06.709683 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.709518 2541 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52317ab4-0d19-464a-952a-be00ab80acd5-local-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:52:06.709683 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.709526 2541 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-cacerts\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:52:06.709683 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.709533 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg869\" (UniqueName: \"kubernetes.io/projected/52317ab4-0d19-464a-952a-be00ab80acd5-kube-api-access-pg869\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:52:06.709683 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:06.709540 2541 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52317ab4-0d19-464a-952a-be00ab80acd5-istio-csr-dns-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:52:07.202638 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.202588 2541 generic.go:356] "Generic (PLEG): container finished" podID="52317ab4-0d19-464a-952a-be00ab80acd5" containerID="d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb" exitCode=0 Jul 14 14:52:07.203102 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.202664 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" Jul 14 14:52:07.203102 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.202662 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" event={"ID":"52317ab4-0d19-464a-952a-be00ab80acd5","Type":"ContainerDied","Data":"d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb"} Jul 14 14:52:07.203102 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.202782 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v5msv" event={"ID":"52317ab4-0d19-464a-952a-be00ab80acd5","Type":"ContainerDied","Data":"cce7da01ebbc1d8e57bb829e71cd6f0c67f357c48a2643dea77ae12601ee013c"} Jul 14 14:52:07.203102 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.202806 2541 scope.go:117] "RemoveContainer" containerID="d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb" Jul 14 14:52:07.212121 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.212103 2541 scope.go:117] "RemoveContainer" containerID="d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb" Jul 14 14:52:07.212410 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:52:07.212388 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb\": container with ID starting with d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb not found: ID does not exist" containerID="d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb" Jul 14 14:52:07.212483 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.212417 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb"} err="failed to get container status \"d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb\": rpc error: code = NotFound desc = could not find container \"d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb\": container with ID starting with d0f6161cfeae2a0f3fa24d296ec21b1cdf073ebfccccc83761ce29c740b074cb not found: ID does not exist" Jul 14 14:52:07.232803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.232783 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v5msv"] Jul 14 14:52:07.237431 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.237410 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v5msv"] Jul 14 14:52:07.849805 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.849774 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52317ab4-0d19-464a-952a-be00ab80acd5" path="/var/lib/kubelet/pods/52317ab4-0d19-464a-952a-be00ab80acd5/volumes" Jul 14 14:52:07.883965 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.883935 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp"] Jul 14 14:52:07.884299 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.884283 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52317ab4-0d19-464a-952a-be00ab80acd5" containerName="discovery" Jul 14 14:52:07.884361 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.884301 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="52317ab4-0d19-464a-952a-be00ab80acd5" containerName="discovery" Jul 14 14:52:07.884361 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.884349 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="52317ab4-0d19-464a-952a-be00ab80acd5" containerName="discovery" Jul 14 14:52:07.888243 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.888227 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" Jul 14 14:52:07.891491 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.891471 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jp7gl\"" Jul 14 14:52:07.891960 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.891945 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 14 14:52:07.913937 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.913912 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp"] Jul 14 14:52:07.920094 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.920072 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szrmp\" (UniqueName: \"kubernetes.io/projected/264ac1c0-907b-4394-82ca-75019e84eebb-kube-api-access-szrmp\") pod \"kserve-controller-manager-d6f4b65b8-sg4sp\" (UID: \"264ac1c0-907b-4394-82ca-75019e84eebb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" Jul 14 14:52:07.920229 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:07.920165 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/264ac1c0-907b-4394-82ca-75019e84eebb-cert\") pod \"kserve-controller-manager-d6f4b65b8-sg4sp\" (UID: \"264ac1c0-907b-4394-82ca-75019e84eebb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" Jul 14 14:52:08.021021 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:08.020999 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szrmp\" (UniqueName: \"kubernetes.io/projected/264ac1c0-907b-4394-82ca-75019e84eebb-kube-api-access-szrmp\") pod \"kserve-controller-manager-d6f4b65b8-sg4sp\" (UID: \"264ac1c0-907b-4394-82ca-75019e84eebb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" Jul 14 14:52:08.021140 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:08.021047 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/264ac1c0-907b-4394-82ca-75019e84eebb-cert\") pod \"kserve-controller-manager-d6f4b65b8-sg4sp\" (UID: \"264ac1c0-907b-4394-82ca-75019e84eebb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" Jul 14 14:52:08.021182 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:52:08.021142 2541 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 14 14:52:08.021212 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:52:08.021193 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264ac1c0-907b-4394-82ca-75019e84eebb-cert podName:264ac1c0-907b-4394-82ca-75019e84eebb nodeName:}" failed. No retries permitted until 2026-07-14 14:52:08.521178887 +0000 UTC m=+325.076840954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/264ac1c0-907b-4394-82ca-75019e84eebb-cert") pod "kserve-controller-manager-d6f4b65b8-sg4sp" (UID: "264ac1c0-907b-4394-82ca-75019e84eebb") : secret "kserve-webhook-server-cert" not found Jul 14 14:52:08.045302 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:08.045276 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szrmp\" (UniqueName: \"kubernetes.io/projected/264ac1c0-907b-4394-82ca-75019e84eebb-kube-api-access-szrmp\") pod \"kserve-controller-manager-d6f4b65b8-sg4sp\" (UID: \"264ac1c0-907b-4394-82ca-75019e84eebb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" Jul 14 14:52:08.525778 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:08.525748 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/264ac1c0-907b-4394-82ca-75019e84eebb-cert\") pod \"kserve-controller-manager-d6f4b65b8-sg4sp\" (UID: \"264ac1c0-907b-4394-82ca-75019e84eebb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" Jul 14 14:52:08.528135 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:08.528116 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/264ac1c0-907b-4394-82ca-75019e84eebb-cert\") pod \"kserve-controller-manager-d6f4b65b8-sg4sp\" (UID: \"264ac1c0-907b-4394-82ca-75019e84eebb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" Jul 14 14:52:08.797674 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:08.797582 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" Jul 14 14:52:08.938456 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:08.938427 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp"] Jul 14 14:52:08.942150 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:52:08.942128 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264ac1c0_907b_4394_82ca_75019e84eebb.slice/crio-e9f76a79a8989dd08ded954e4fce86a9311cd41e91e324eb5140aa5e2ef0e397 WatchSource:0}: Error finding container e9f76a79a8989dd08ded954e4fce86a9311cd41e91e324eb5140aa5e2ef0e397: Status 404 returned error can't find the container with id e9f76a79a8989dd08ded954e4fce86a9311cd41e91e324eb5140aa5e2ef0e397 Jul 14 14:52:09.212969 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:09.212935 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" event={"ID":"264ac1c0-907b-4394-82ca-75019e84eebb","Type":"ContainerStarted","Data":"e9f76a79a8989dd08ded954e4fce86a9311cd41e91e324eb5140aa5e2ef0e397"} Jul 14 14:52:12.227678 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:12.227644 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" event={"ID":"264ac1c0-907b-4394-82ca-75019e84eebb","Type":"ContainerStarted","Data":"0713da69c198d876fb9adc0c081af71c32a63d8df60124f4cb24b5a597168eb0"} Jul 14 14:52:12.228019 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:12.227813 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" Jul 14 14:52:12.247588 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:12.247547 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" podStartSLOduration=2.3919738600000002 podStartE2EDuration="5.247534585s" totalImagesPullingTime="2.855560725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:52:12.245446485 +0000 UTC m=+328.801108592" watchObservedRunningTime="2026-07-14 14:52:12.247534585 +0000 UTC m=+328.803196674" Jul 14 14:52:43.236680 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:43.236653 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sg4sp" Jul 14 14:52:55.517320 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.517284 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qttkv"] Jul 14 14:52:55.523859 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.523839 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qttkv" Jul 14 14:52:55.527149 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.527131 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-z5l2h\"" Jul 14 14:52:55.527506 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.527487 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 14:52:55.528459 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.528441 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 14:52:55.572573 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.572541 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qttkv"] Jul 14 14:52:55.688004 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.687970 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvfs8\" (UniqueName: \"kubernetes.io/projected/ee39623d-0b7e-4479-9bed-09645d59a768-kube-api-access-fvfs8\") pod \"kuadrant-operator-catalog-qttkv\" (UID: \"ee39623d-0b7e-4479-9bed-09645d59a768\") " pod="kuadrant-system/kuadrant-operator-catalog-qttkv" Jul 14 14:52:55.788750 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.788666 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvfs8\" (UniqueName: \"kubernetes.io/projected/ee39623d-0b7e-4479-9bed-09645d59a768-kube-api-access-fvfs8\") pod \"kuadrant-operator-catalog-qttkv\" (UID: \"ee39623d-0b7e-4479-9bed-09645d59a768\") " pod="kuadrant-system/kuadrant-operator-catalog-qttkv" Jul 14 14:52:55.802584 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.802558 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvfs8\" (UniqueName: \"kubernetes.io/projected/ee39623d-0b7e-4479-9bed-09645d59a768-kube-api-access-fvfs8\") pod \"kuadrant-operator-catalog-qttkv\" (UID: \"ee39623d-0b7e-4479-9bed-09645d59a768\") " pod="kuadrant-system/kuadrant-operator-catalog-qttkv" Jul 14 14:52:55.832745 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.832719 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qttkv" Jul 14 14:52:55.875976 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.875949 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qttkv"] Jul 14 14:52:55.965967 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:55.965936 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qttkv"] Jul 14 14:52:55.969693 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:52:55.969663 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee39623d_0b7e_4479_9bed_09645d59a768.slice/crio-91748d46d70ac83167c463ae7072104393716196ae4f700e3d3c0451a0f87a52 WatchSource:0}: Error finding container 91748d46d70ac83167c463ae7072104393716196ae4f700e3d3c0451a0f87a52: Status 404 returned error can't find the container with id 91748d46d70ac83167c463ae7072104393716196ae4f700e3d3c0451a0f87a52 Jul 14 14:52:56.080263 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:56.080193 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dvt7q"] Jul 14 14:52:56.085362 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:56.085346 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" Jul 14 14:52:56.096828 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:56.096799 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dvt7q"] Jul 14 14:52:56.192387 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:56.192359 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkrph\" (UniqueName: \"kubernetes.io/projected/4680550d-918d-4ebd-9950-cd692be9d5f1-kube-api-access-zkrph\") pod \"kuadrant-operator-catalog-dvt7q\" (UID: \"4680550d-918d-4ebd-9950-cd692be9d5f1\") " pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" Jul 14 14:52:56.293274 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:56.293249 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkrph\" (UniqueName: \"kubernetes.io/projected/4680550d-918d-4ebd-9950-cd692be9d5f1-kube-api-access-zkrph\") pod \"kuadrant-operator-catalog-dvt7q\" (UID: \"4680550d-918d-4ebd-9950-cd692be9d5f1\") " pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" Jul 14 14:52:56.306410 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:56.306382 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkrph\" (UniqueName: \"kubernetes.io/projected/4680550d-918d-4ebd-9950-cd692be9d5f1-kube-api-access-zkrph\") pod \"kuadrant-operator-catalog-dvt7q\" (UID: \"4680550d-918d-4ebd-9950-cd692be9d5f1\") " pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" Jul 14 14:52:56.394396 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:56.394314 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" Jul 14 14:52:56.402768 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:56.402743 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qttkv" event={"ID":"ee39623d-0b7e-4479-9bed-09645d59a768","Type":"ContainerStarted","Data":"91748d46d70ac83167c463ae7072104393716196ae4f700e3d3c0451a0f87a52"} Jul 14 14:52:56.535478 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:56.535450 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dvt7q"] Jul 14 14:52:56.538469 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:52:56.538444 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4680550d_918d_4ebd_9950_cd692be9d5f1.slice/crio-daf83b011b058629dba97be66009978c7d68f8739d129e2787e6802838a1cc4d WatchSource:0}: Error finding container daf83b011b058629dba97be66009978c7d68f8739d129e2787e6802838a1cc4d: Status 404 returned error can't find the container with id daf83b011b058629dba97be66009978c7d68f8739d129e2787e6802838a1cc4d Jul 14 14:52:57.409317 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:57.409289 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" event={"ID":"4680550d-918d-4ebd-9950-cd692be9d5f1","Type":"ContainerStarted","Data":"daf83b011b058629dba97be66009978c7d68f8739d129e2787e6802838a1cc4d"} Jul 14 14:52:58.415435 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:58.415402 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qttkv" event={"ID":"ee39623d-0b7e-4479-9bed-09645d59a768","Type":"ContainerStarted","Data":"4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96"} Jul 14 14:52:58.415895 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:58.415473 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qttkv" podUID="ee39623d-0b7e-4479-9bed-09645d59a768" containerName="registry-server" containerID="cri-o://4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96" gracePeriod=2 Jul 14 14:52:58.416904 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:58.416883 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" event={"ID":"4680550d-918d-4ebd-9950-cd692be9d5f1","Type":"ContainerStarted","Data":"a08a132bc88f3cdc7a7b951f5d36171e8fe2700dbba4556ed299544d79d70664"} Jul 14 14:52:58.433201 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:58.433127 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qttkv" podStartSLOduration=1.369266115 podStartE2EDuration="3.433109242s" totalImagesPullingTime="2.063843127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:52:58.432533203 +0000 UTC m=+374.988195293" watchObservedRunningTime="2026-07-14 14:52:58.433109242 +0000 UTC m=+374.988771332" Jul 14 14:52:58.452566 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:58.452529 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" podStartSLOduration=0.956737321 podStartE2EDuration="2.452516286s" totalImagesPullingTime="1.495778965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:52:58.451460351 +0000 UTC m=+375.007122440" watchObservedRunningTime="2026-07-14 14:52:58.452516286 +0000 UTC m=+375.008178374" Jul 14 14:52:58.652555 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:58.652534 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qttkv" Jul 14 14:52:58.812363 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:58.812284 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvfs8\" (UniqueName: \"kubernetes.io/projected/ee39623d-0b7e-4479-9bed-09645d59a768-kube-api-access-fvfs8\") pod \"ee39623d-0b7e-4479-9bed-09645d59a768\" (UID: \"ee39623d-0b7e-4479-9bed-09645d59a768\") " Jul 14 14:52:58.814486 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:58.814453 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee39623d-0b7e-4479-9bed-09645d59a768-kube-api-access-fvfs8" (OuterVolumeSpecName: "kube-api-access-fvfs8") pod "ee39623d-0b7e-4479-9bed-09645d59a768" (UID: "ee39623d-0b7e-4479-9bed-09645d59a768"). InnerVolumeSpecName "kube-api-access-fvfs8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:52:58.913727 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:58.913705 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvfs8\" (UniqueName: \"kubernetes.io/projected/ee39623d-0b7e-4479-9bed-09645d59a768-kube-api-access-fvfs8\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:52:59.421904 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:59.421866 2541 generic.go:356] "Generic (PLEG): container finished" podID="ee39623d-0b7e-4479-9bed-09645d59a768" containerID="4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96" exitCode=0 Jul 14 14:52:59.422317 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:59.421929 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qttkv" Jul 14 14:52:59.422317 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:59.421951 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qttkv" event={"ID":"ee39623d-0b7e-4479-9bed-09645d59a768","Type":"ContainerDied","Data":"4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96"} Jul 14 14:52:59.422317 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:59.421997 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qttkv" event={"ID":"ee39623d-0b7e-4479-9bed-09645d59a768","Type":"ContainerDied","Data":"91748d46d70ac83167c463ae7072104393716196ae4f700e3d3c0451a0f87a52"} Jul 14 14:52:59.422317 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:59.422016 2541 scope.go:117] "RemoveContainer" containerID="4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96" Jul 14 14:52:59.431234 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:59.431215 2541 scope.go:117] "RemoveContainer" containerID="4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96" Jul 14 14:52:59.431485 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:52:59.431466 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96\": container with ID starting with 4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96 not found: ID does not exist" containerID="4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96" Jul 14 14:52:59.431527 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:59.431493 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96"} err="failed to get container status \"4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96\": rpc error: code = NotFound desc = could not find container \"4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96\": container with ID starting with 4ad00a4516891c90f61e021f44ea925031b9f62e632eb94749cb59d4ed625e96 not found: ID does not exist" Jul 14 14:52:59.443919 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:59.443898 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qttkv"] Jul 14 14:52:59.445941 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:59.445922 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qttkv"] Jul 14 14:52:59.850002 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:52:59.849917 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee39623d-0b7e-4479-9bed-09645d59a768" path="/var/lib/kubelet/pods/ee39623d-0b7e-4479-9bed-09645d59a768/volumes" Jul 14 14:53:06.395011 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:06.394978 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" Jul 14 14:53:06.395441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:06.395027 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" Jul 14 14:53:06.417688 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:06.417661 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" Jul 14 14:53:06.472663 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:06.472637 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dvt7q" Jul 14 14:53:24.307256 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.307224 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247"] Jul 14 14:53:24.307670 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.307542 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee39623d-0b7e-4479-9bed-09645d59a768" containerName="registry-server" Jul 14 14:53:24.307670 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.307552 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee39623d-0b7e-4479-9bed-09645d59a768" containerName="registry-server" Jul 14 14:53:24.307670 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.307612 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee39623d-0b7e-4479-9bed-09645d59a768" containerName="registry-server" Jul 14 14:53:24.310503 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.310487 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" Jul 14 14:53:24.313519 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.313501 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-t4rkt\"" Jul 14 14:53:24.325462 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.325442 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247"] Jul 14 14:53:24.412301 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.412272 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkbkx\" (UniqueName: \"kubernetes.io/projected/3918ada2-de25-495c-b816-d4396d75ccfd-kube-api-access-lkbkx\") pod \"limitador-operator-controller-manager-859d7b78bd-kt247\" (UID: \"3918ada2-de25-495c-b816-d4396d75ccfd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" Jul 14 14:53:24.513148 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.513115 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkbkx\" (UniqueName: \"kubernetes.io/projected/3918ada2-de25-495c-b816-d4396d75ccfd-kube-api-access-lkbkx\") pod \"limitador-operator-controller-manager-859d7b78bd-kt247\" (UID: \"3918ada2-de25-495c-b816-d4396d75ccfd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" Jul 14 14:53:24.552913 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.552885 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkbkx\" (UniqueName: \"kubernetes.io/projected/3918ada2-de25-495c-b816-d4396d75ccfd-kube-api-access-lkbkx\") pod \"limitador-operator-controller-manager-859d7b78bd-kt247\" (UID: \"3918ada2-de25-495c-b816-d4396d75ccfd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" Jul 14 14:53:24.620993 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.620929 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" Jul 14 14:53:24.750675 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:24.750653 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247"] Jul 14 14:53:24.752998 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:53:24.752976 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3918ada2_de25_495c_b816_d4396d75ccfd.slice/crio-e66019d8928039d5391a30e216f3ed76c93f1b9269bf22c3b5e9bea208fab5bf WatchSource:0}: Error finding container e66019d8928039d5391a30e216f3ed76c93f1b9269bf22c3b5e9bea208fab5bf: Status 404 returned error can't find the container with id e66019d8928039d5391a30e216f3ed76c93f1b9269bf22c3b5e9bea208fab5bf Jul 14 14:53:25.529414 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:25.529381 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" event={"ID":"3918ada2-de25-495c-b816-d4396d75ccfd","Type":"ContainerStarted","Data":"e66019d8928039d5391a30e216f3ed76c93f1b9269bf22c3b5e9bea208fab5bf"} Jul 14 14:53:27.539848 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:27.539810 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" event={"ID":"3918ada2-de25-495c-b816-d4396d75ccfd","Type":"ContainerStarted","Data":"380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466"} Jul 14 14:53:27.540316 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:27.539918 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" Jul 14 14:53:27.562212 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:27.562161 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" podStartSLOduration=1.524880985 podStartE2EDuration="3.562142348s" totalImagesPullingTime="2.037261363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:53:27.561383648 +0000 UTC m=+404.117045737" watchObservedRunningTime="2026-07-14 14:53:27.562142348 +0000 UTC m=+404.117804439" Jul 14 14:53:29.598161 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:29.598130 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8"] Jul 14 14:53:29.601495 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:29.601473 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:29.604929 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:29.604905 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cmtr2\"" Jul 14 14:53:29.618664 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:29.618634 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8"] Jul 14 14:53:29.656772 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:29.656740 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed5f6f41-f5e0-4d17-b062-8e465657d954-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mswk8\" (UID: \"ed5f6f41-f5e0-4d17-b062-8e465657d954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:29.656905 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:29.656787 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4ttx\" (UniqueName: \"kubernetes.io/projected/ed5f6f41-f5e0-4d17-b062-8e465657d954-kube-api-access-k4ttx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mswk8\" (UID: \"ed5f6f41-f5e0-4d17-b062-8e465657d954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:29.758109 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:29.758074 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed5f6f41-f5e0-4d17-b062-8e465657d954-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mswk8\" (UID: \"ed5f6f41-f5e0-4d17-b062-8e465657d954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:29.758282 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:29.758131 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4ttx\" (UniqueName: \"kubernetes.io/projected/ed5f6f41-f5e0-4d17-b062-8e465657d954-kube-api-access-k4ttx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mswk8\" (UID: \"ed5f6f41-f5e0-4d17-b062-8e465657d954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:29.758470 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:29.758450 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed5f6f41-f5e0-4d17-b062-8e465657d954-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mswk8\" (UID: \"ed5f6f41-f5e0-4d17-b062-8e465657d954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:29.769230 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:29.769198 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4ttx\" (UniqueName: \"kubernetes.io/projected/ed5f6f41-f5e0-4d17-b062-8e465657d954-kube-api-access-k4ttx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mswk8\" (UID: \"ed5f6f41-f5e0-4d17-b062-8e465657d954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:29.911157 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:29.911115 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:30.051046 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:30.051021 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8"] Jul 14 14:53:30.053188 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:53:30.053152 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5f6f41_f5e0_4d17_b062_8e465657d954.slice/crio-d3cc7913f3a33d937a51be2a24ebb22e21810a965d70ac1823788bba164981c6 WatchSource:0}: Error finding container d3cc7913f3a33d937a51be2a24ebb22e21810a965d70ac1823788bba164981c6: Status 404 returned error can't find the container with id d3cc7913f3a33d937a51be2a24ebb22e21810a965d70ac1823788bba164981c6 Jul 14 14:53:30.553351 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:30.553313 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" event={"ID":"ed5f6f41-f5e0-4d17-b062-8e465657d954","Type":"ContainerStarted","Data":"d3cc7913f3a33d937a51be2a24ebb22e21810a965d70ac1823788bba164981c6"} Jul 14 14:53:32.405390 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:32.405355 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57"] Jul 14 14:53:32.409101 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:32.409082 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57" Jul 14 14:53:32.412873 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:32.412852 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qmbnt\"" Jul 14 14:53:32.413389 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:32.413372 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 14:53:32.436496 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:32.436470 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57"] Jul 14 14:53:32.484257 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:32.484212 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmq9g\" (UniqueName: \"kubernetes.io/projected/632be6f3-f24e-489e-8955-7d09b2aea091-kube-api-access-hmq9g\") pod \"dns-operator-controller-manager-864dd78c4c-cpr57\" (UID: \"632be6f3-f24e-489e-8955-7d09b2aea091\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57" Jul 14 14:53:32.585499 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:32.585468 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmq9g\" (UniqueName: \"kubernetes.io/projected/632be6f3-f24e-489e-8955-7d09b2aea091-kube-api-access-hmq9g\") pod \"dns-operator-controller-manager-864dd78c4c-cpr57\" (UID: \"632be6f3-f24e-489e-8955-7d09b2aea091\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57" Jul 14 14:53:32.621524 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:32.621495 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmq9g\" (UniqueName: \"kubernetes.io/projected/632be6f3-f24e-489e-8955-7d09b2aea091-kube-api-access-hmq9g\") pod \"dns-operator-controller-manager-864dd78c4c-cpr57\" (UID: \"632be6f3-f24e-489e-8955-7d09b2aea091\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57" Jul 14 14:53:32.719899 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:32.719824 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57" Jul 14 14:53:32.890656 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:32.890610 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57"] Jul 14 14:53:32.891776 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:53:32.891754 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632be6f3_f24e_489e_8955_7d09b2aea091.slice/crio-656a84f98861457565f6f970f7104d0a5d95e150d76b2481208fb0bd1f7ab1b8 WatchSource:0}: Error finding container 656a84f98861457565f6f970f7104d0a5d95e150d76b2481208fb0bd1f7ab1b8: Status 404 returned error can't find the container with id 656a84f98861457565f6f970f7104d0a5d95e150d76b2481208fb0bd1f7ab1b8 Jul 14 14:53:33.568799 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:33.568763 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57" event={"ID":"632be6f3-f24e-489e-8955-7d09b2aea091","Type":"ContainerStarted","Data":"656a84f98861457565f6f970f7104d0a5d95e150d76b2481208fb0bd1f7ab1b8"} Jul 14 14:53:36.585413 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:36.585314 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" event={"ID":"ed5f6f41-f5e0-4d17-b062-8e465657d954","Type":"ContainerStarted","Data":"43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03"} Jul 14 14:53:36.585413 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:36.585381 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:36.586909 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:36.586879 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57" event={"ID":"632be6f3-f24e-489e-8955-7d09b2aea091","Type":"ContainerStarted","Data":"03f1bf9785afa27194d842abb30361172ea040baf9110bc8fb68f34ad8640ca4"} Jul 14 14:53:36.587225 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:36.587009 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57" Jul 14 14:53:36.608827 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:36.608786 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" podStartSLOduration=1.296634219 podStartE2EDuration="7.608772347s" totalImagesPullingTime="6.312138128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:53:36.606989382 +0000 UTC m=+413.162651498" watchObservedRunningTime="2026-07-14 14:53:36.608772347 +0000 UTC m=+413.164434435" Jul 14 14:53:36.630099 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:36.630030 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57" podStartSLOduration=2.394564869 podStartE2EDuration="4.630016731s" totalImagesPullingTime="2.235451862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:53:36.628693569 +0000 UTC m=+413.184355658" watchObservedRunningTime="2026-07-14 14:53:36.630016731 +0000 UTC m=+413.185678819" Jul 14 14:53:38.546255 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:38.546228 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" Jul 14 14:53:47.593090 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:47.593063 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:47.593563 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:47.593291 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cpr57" Jul 14 14:53:49.749498 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.749466 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8"] Jul 14 14:53:49.749925 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.749648 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" podUID="ed5f6f41-f5e0-4d17-b062-8e465657d954" containerName="manager" containerID="cri-o://43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03" gracePeriod=2 Jul 14 14:53:49.769338 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.769307 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8"] Jul 14 14:53:49.809826 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.809794 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247"] Jul 14 14:53:49.810038 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.810014 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" podUID="3918ada2-de25-495c-b816-d4396d75ccfd" containerName="manager" containerID="cri-o://380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466" gracePeriod=2 Jul 14 14:53:49.812982 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:53:49.812931 2541 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mswk8\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="ed5f6f41-f5e0-4d17-b062-8e465657d954" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:49.817250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.817226 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247"] Jul 14 14:53:49.865321 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.865287 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx"] Jul 14 14:53:49.865685 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.865668 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5f6f41-f5e0-4d17-b062-8e465657d954" containerName="manager" Jul 14 14:53:49.865685 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.865683 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5f6f41-f5e0-4d17-b062-8e465657d954" containerName="manager" Jul 14 14:53:49.865844 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.865695 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3918ada2-de25-495c-b816-d4396d75ccfd" containerName="manager" Jul 14 14:53:49.865844 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.865701 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="3918ada2-de25-495c-b816-d4396d75ccfd" containerName="manager" Jul 14 14:53:49.865844 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.865746 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="3918ada2-de25-495c-b816-d4396d75ccfd" containerName="manager" Jul 14 14:53:49.865844 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.865753 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed5f6f41-f5e0-4d17-b062-8e465657d954" containerName="manager" Jul 14 14:53:49.868829 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.868807 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn"] Jul 14 14:53:49.868954 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.868939 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:53:49.871945 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.871926 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn" Jul 14 14:53:49.895987 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.895963 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn"] Jul 14 14:53:49.905499 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:49.905476 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx"] Jul 14 14:53:50.041779 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.041757 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdnzt\" (UniqueName: \"kubernetes.io/projected/ab302400-bc83-4d46-8356-47d3822a2b44-kube-api-access-pdnzt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n7tqx\" (UID: \"ab302400-bc83-4d46-8356-47d3822a2b44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:53:50.041898 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.041816 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdxkr\" (UniqueName: \"kubernetes.io/projected/2c854e7d-43ae-4543-9ac2-df5cddf38efc-kube-api-access-fdxkr\") pod \"limitador-operator-controller-manager-859d7b78bd-jbdfn\" (UID: \"2c854e7d-43ae-4543-9ac2-df5cddf38efc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn" Jul 14 14:53:50.041937 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.041900 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab302400-bc83-4d46-8356-47d3822a2b44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n7tqx\" (UID: \"ab302400-bc83-4d46-8356-47d3822a2b44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:53:50.051482 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.051459 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:50.060637 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.060605 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" Jul 14 14:53:50.143150 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.143129 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed5f6f41-f5e0-4d17-b062-8e465657d954-extensions-socket-volume\") pod \"ed5f6f41-f5e0-4d17-b062-8e465657d954\" (UID: \"ed5f6f41-f5e0-4d17-b062-8e465657d954\") " Jul 14 14:53:50.143262 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.143217 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkbkx\" (UniqueName: \"kubernetes.io/projected/3918ada2-de25-495c-b816-d4396d75ccfd-kube-api-access-lkbkx\") pod \"3918ada2-de25-495c-b816-d4396d75ccfd\" (UID: \"3918ada2-de25-495c-b816-d4396d75ccfd\") " Jul 14 14:53:50.143262 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.143236 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4ttx\" (UniqueName: \"kubernetes.io/projected/ed5f6f41-f5e0-4d17-b062-8e465657d954-kube-api-access-k4ttx\") pod \"ed5f6f41-f5e0-4d17-b062-8e465657d954\" (UID: \"ed5f6f41-f5e0-4d17-b062-8e465657d954\") " Jul 14 14:53:50.143374 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.143322 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab302400-bc83-4d46-8356-47d3822a2b44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n7tqx\" (UID: \"ab302400-bc83-4d46-8356-47d3822a2b44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:53:50.143458 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.143437 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5f6f41-f5e0-4d17-b062-8e465657d954-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ed5f6f41-f5e0-4d17-b062-8e465657d954" (UID: "ed5f6f41-f5e0-4d17-b062-8e465657d954"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:53:50.143516 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.143477 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdnzt\" (UniqueName: \"kubernetes.io/projected/ab302400-bc83-4d46-8356-47d3822a2b44-kube-api-access-pdnzt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n7tqx\" (UID: \"ab302400-bc83-4d46-8356-47d3822a2b44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:53:50.143584 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.143554 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdxkr\" (UniqueName: \"kubernetes.io/projected/2c854e7d-43ae-4543-9ac2-df5cddf38efc-kube-api-access-fdxkr\") pod \"limitador-operator-controller-manager-859d7b78bd-jbdfn\" (UID: \"2c854e7d-43ae-4543-9ac2-df5cddf38efc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn" Jul 14 14:53:50.143674 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.143610 2541 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed5f6f41-f5e0-4d17-b062-8e465657d954-extensions-socket-volume\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:53:50.143749 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.143732 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab302400-bc83-4d46-8356-47d3822a2b44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n7tqx\" (UID: \"ab302400-bc83-4d46-8356-47d3822a2b44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:53:50.145411 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.145387 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed5f6f41-f5e0-4d17-b062-8e465657d954-kube-api-access-k4ttx" (OuterVolumeSpecName: "kube-api-access-k4ttx") pod "ed5f6f41-f5e0-4d17-b062-8e465657d954" (UID: "ed5f6f41-f5e0-4d17-b062-8e465657d954"). InnerVolumeSpecName "kube-api-access-k4ttx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:53:50.145496 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.145455 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3918ada2-de25-495c-b816-d4396d75ccfd-kube-api-access-lkbkx" (OuterVolumeSpecName: "kube-api-access-lkbkx") pod "3918ada2-de25-495c-b816-d4396d75ccfd" (UID: "3918ada2-de25-495c-b816-d4396d75ccfd"). InnerVolumeSpecName "kube-api-access-lkbkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:53:50.155860 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.155839 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdnzt\" (UniqueName: \"kubernetes.io/projected/ab302400-bc83-4d46-8356-47d3822a2b44-kube-api-access-pdnzt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n7tqx\" (UID: \"ab302400-bc83-4d46-8356-47d3822a2b44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:53:50.156408 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.156390 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdxkr\" (UniqueName: \"kubernetes.io/projected/2c854e7d-43ae-4543-9ac2-df5cddf38efc-kube-api-access-fdxkr\") pod \"limitador-operator-controller-manager-859d7b78bd-jbdfn\" (UID: \"2c854e7d-43ae-4543-9ac2-df5cddf38efc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn" Jul 14 14:53:50.198263 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.198242 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:53:50.205290 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.205273 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn" Jul 14 14:53:50.244449 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.244421 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkbkx\" (UniqueName: \"kubernetes.io/projected/3918ada2-de25-495c-b816-d4396d75ccfd-kube-api-access-lkbkx\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:53:50.244449 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.244448 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4ttx\" (UniqueName: \"kubernetes.io/projected/ed5f6f41-f5e0-4d17-b062-8e465657d954-kube-api-access-k4ttx\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:53:50.359803 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.359774 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx"] Jul 14 14:53:50.363522 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:53:50.363498 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab302400_bc83_4d46_8356_47d3822a2b44.slice/crio-b7ae5556b61e6b6a1bb37144a8a08d25aa95b414864cb98aa1976669ce0c3f81 WatchSource:0}: Error finding container b7ae5556b61e6b6a1bb37144a8a08d25aa95b414864cb98aa1976669ce0c3f81: Status 404 returned error can't find the container with id b7ae5556b61e6b6a1bb37144a8a08d25aa95b414864cb98aa1976669ce0c3f81 Jul 14 14:53:50.384250 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.384226 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn"] Jul 14 14:53:50.387236 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:53:50.387213 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c854e7d_43ae_4543_9ac2_df5cddf38efc.slice/crio-46324bd9299b41afc675cad06ed99ffbb3af2bb4619ad26364785590c99854b9 WatchSource:0}: Error finding container 46324bd9299b41afc675cad06ed99ffbb3af2bb4619ad26364785590c99854b9: Status 404 returned error can't find the container with id 46324bd9299b41afc675cad06ed99ffbb3af2bb4619ad26364785590c99854b9 Jul 14 14:53:50.649877 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.649793 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" event={"ID":"ab302400-bc83-4d46-8356-47d3822a2b44","Type":"ContainerStarted","Data":"5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0"} Jul 14 14:53:50.649877 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.649851 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" event={"ID":"ab302400-bc83-4d46-8356-47d3822a2b44","Type":"ContainerStarted","Data":"b7ae5556b61e6b6a1bb37144a8a08d25aa95b414864cb98aa1976669ce0c3f81"} Jul 14 14:53:50.650058 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.649907 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:53:50.651204 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.651183 2541 generic.go:356] "Generic (PLEG): container finished" podID="3918ada2-de25-495c-b816-d4396d75ccfd" containerID="380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466" exitCode=0 Jul 14 14:53:50.651333 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.651234 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kt247" Jul 14 14:53:50.651333 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.651271 2541 scope.go:117] "RemoveContainer" containerID="380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466" Jul 14 14:53:50.652711 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.652693 2541 generic.go:356] "Generic (PLEG): container finished" podID="ed5f6f41-f5e0-4d17-b062-8e465657d954" containerID="43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03" exitCode=0 Jul 14 14:53:50.652817 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.652727 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mswk8" Jul 14 14:53:50.655413 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.655394 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn" event={"ID":"2c854e7d-43ae-4543-9ac2-df5cddf38efc","Type":"ContainerStarted","Data":"af03a048b0c687002cd65710a45d5d339051a085ed121d868a9db4fa7e496bfb"} Jul 14 14:53:50.655528 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.655428 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn" event={"ID":"2c854e7d-43ae-4543-9ac2-df5cddf38efc","Type":"ContainerStarted","Data":"46324bd9299b41afc675cad06ed99ffbb3af2bb4619ad26364785590c99854b9"} Jul 14 14:53:50.655657 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.655606 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn" Jul 14 14:53:50.660354 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.660332 2541 scope.go:117] "RemoveContainer" containerID="380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466" Jul 14 14:53:50.660769 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:53:50.660746 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466\": container with ID starting with 380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466 not found: ID does not exist" containerID="380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466" Jul 14 14:53:50.660845 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.660777 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466"} err="failed to get container status \"380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466\": rpc error: code = NotFound desc = could not find container \"380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466\": container with ID starting with 380ea6bcda1d61783cfa572d68416aa0cc91fab078f6e10561ba47d1f9d15466 not found: ID does not exist" Jul 14 14:53:50.660845 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.660793 2541 scope.go:117] "RemoveContainer" containerID="43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03" Jul 14 14:53:50.668108 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.668093 2541 scope.go:117] "RemoveContainer" containerID="43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03" Jul 14 14:53:50.668334 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:53:50.668310 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03\": container with ID starting with 43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03 not found: ID does not exist" containerID="43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03" Jul 14 14:53:50.668386 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.668340 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03"} err="failed to get container status \"43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03\": rpc error: code = NotFound desc = could not find container \"43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03\": container with ID starting with 43c24864c9e96f086fef847f4f3c53d99cb37be487b491dd0de56b99c7eb9e03 not found: ID does not exist" Jul 14 14:53:50.680436 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.680398 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" podStartSLOduration=1.680385684 podStartE2EDuration="1.680385684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:53:50.678733794 +0000 UTC m=+427.234395882" watchObservedRunningTime="2026-07-14 14:53:50.680385684 +0000 UTC m=+427.236047792" Jul 14 14:53:50.708199 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:50.708165 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn" podStartSLOduration=1.7081545980000001 podStartE2EDuration="1.708154598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:53:50.705665337 +0000 UTC m=+427.261327423" watchObservedRunningTime="2026-07-14 14:53:50.708154598 +0000 UTC m=+427.263816687" Jul 14 14:53:51.096184 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.096151 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck"] Jul 14 14:53:51.099424 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.099409 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 14:53:51.119204 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.119182 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck"] Jul 14 14:53:51.250378 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.250347 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1c5143-6e00-436b-9d0c-710e20a7321c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9vdck\" (UID: \"fa1c5143-6e00-436b-9d0c-710e20a7321c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 14:53:51.250534 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.250407 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfsc6\" (UniqueName: \"kubernetes.io/projected/fa1c5143-6e00-436b-9d0c-710e20a7321c-kube-api-access-vfsc6\") pod \"kuadrant-operator-controller-manager-86878c769f-9vdck\" (UID: \"fa1c5143-6e00-436b-9d0c-710e20a7321c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 14:53:51.351559 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.351470 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfsc6\" (UniqueName: \"kubernetes.io/projected/fa1c5143-6e00-436b-9d0c-710e20a7321c-kube-api-access-vfsc6\") pod \"kuadrant-operator-controller-manager-86878c769f-9vdck\" (UID: \"fa1c5143-6e00-436b-9d0c-710e20a7321c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 14:53:51.351559 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.351532 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1c5143-6e00-436b-9d0c-710e20a7321c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9vdck\" (UID: \"fa1c5143-6e00-436b-9d0c-710e20a7321c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 14:53:51.351861 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.351843 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1c5143-6e00-436b-9d0c-710e20a7321c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9vdck\" (UID: \"fa1c5143-6e00-436b-9d0c-710e20a7321c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 14:53:51.362640 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.362587 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfsc6\" (UniqueName: \"kubernetes.io/projected/fa1c5143-6e00-436b-9d0c-710e20a7321c-kube-api-access-vfsc6\") pod \"kuadrant-operator-controller-manager-86878c769f-9vdck\" (UID: \"fa1c5143-6e00-436b-9d0c-710e20a7321c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 14:53:51.409609 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.409565 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 14:53:51.553995 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.553917 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck"] Jul 14 14:53:51.556268 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:53:51.556238 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1c5143_6e00_436b_9d0c_710e20a7321c.slice/crio-71b3c1ce1a95432e55c9f38c65ce1b26fa42010be919de674eb2bd33ed4cef2c WatchSource:0}: Error finding container 71b3c1ce1a95432e55c9f38c65ce1b26fa42010be919de674eb2bd33ed4cef2c: Status 404 returned error can't find the container with id 71b3c1ce1a95432e55c9f38c65ce1b26fa42010be919de674eb2bd33ed4cef2c Jul 14 14:53:51.663023 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.662993 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" event={"ID":"fa1c5143-6e00-436b-9d0c-710e20a7321c","Type":"ContainerStarted","Data":"ca574562ee26079d2aa602f8d1e9966951c3a69c4f0fd35e36e2bb7cc0a4d240"} Jul 14 14:53:51.663182 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.663046 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" event={"ID":"fa1c5143-6e00-436b-9d0c-710e20a7321c","Type":"ContainerStarted","Data":"71b3c1ce1a95432e55c9f38c65ce1b26fa42010be919de674eb2bd33ed4cef2c"} Jul 14 14:53:51.687681 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.687638 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" podStartSLOduration=0.687608437 podStartE2EDuration="687.608437ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:53:51.68628384 +0000 UTC m=+428.241945952" watchObservedRunningTime="2026-07-14 14:53:51.687608437 +0000 UTC m=+428.243270590" Jul 14 14:53:51.850257 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.850221 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3918ada2-de25-495c-b816-d4396d75ccfd" path="/var/lib/kubelet/pods/3918ada2-de25-495c-b816-d4396d75ccfd/volumes" Jul 14 14:53:51.850557 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:51.850544 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed5f6f41-f5e0-4d17-b062-8e465657d954" path="/var/lib/kubelet/pods/ed5f6f41-f5e0-4d17-b062-8e465657d954/volumes" Jul 14 14:53:52.667364 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:53:52.667329 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 14:54:01.665380 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:01.665348 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:54:01.665983 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:01.665431 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbdfn" Jul 14 14:54:03.674018 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:03.673992 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 14:54:03.739681 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:03.739652 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx"] Jul 14 14:54:03.739858 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:03.739811 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" podUID="ab302400-bc83-4d46-8356-47d3822a2b44" containerName="manager" containerID="cri-o://5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0" gracePeriod=10 Jul 14 14:54:03.987574 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:03.987552 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:54:04.051405 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.051382 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdnzt\" (UniqueName: \"kubernetes.io/projected/ab302400-bc83-4d46-8356-47d3822a2b44-kube-api-access-pdnzt\") pod \"ab302400-bc83-4d46-8356-47d3822a2b44\" (UID: \"ab302400-bc83-4d46-8356-47d3822a2b44\") " Jul 14 14:54:04.051535 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.051433 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab302400-bc83-4d46-8356-47d3822a2b44-extensions-socket-volume\") pod \"ab302400-bc83-4d46-8356-47d3822a2b44\" (UID: \"ab302400-bc83-4d46-8356-47d3822a2b44\") " Jul 14 14:54:04.051832 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.051814 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab302400-bc83-4d46-8356-47d3822a2b44-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ab302400-bc83-4d46-8356-47d3822a2b44" (UID: "ab302400-bc83-4d46-8356-47d3822a2b44"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:54:04.053484 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.053451 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab302400-bc83-4d46-8356-47d3822a2b44-kube-api-access-pdnzt" (OuterVolumeSpecName: "kube-api-access-pdnzt") pod "ab302400-bc83-4d46-8356-47d3822a2b44" (UID: "ab302400-bc83-4d46-8356-47d3822a2b44"). InnerVolumeSpecName "kube-api-access-pdnzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:54:04.152203 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.152179 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdnzt\" (UniqueName: \"kubernetes.io/projected/ab302400-bc83-4d46-8356-47d3822a2b44-kube-api-access-pdnzt\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:54:04.152203 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.152203 2541 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab302400-bc83-4d46-8356-47d3822a2b44-extensions-socket-volume\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:54:04.724583 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.724546 2541 generic.go:356] "Generic (PLEG): container finished" podID="ab302400-bc83-4d46-8356-47d3822a2b44" containerID="5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0" exitCode=0 Jul 14 14:54:04.725062 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.724611 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" Jul 14 14:54:04.725062 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.724660 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" event={"ID":"ab302400-bc83-4d46-8356-47d3822a2b44","Type":"ContainerDied","Data":"5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0"} Jul 14 14:54:04.725062 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.724757 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx" event={"ID":"ab302400-bc83-4d46-8356-47d3822a2b44","Type":"ContainerDied","Data":"b7ae5556b61e6b6a1bb37144a8a08d25aa95b414864cb98aa1976669ce0c3f81"} Jul 14 14:54:04.725062 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.724790 2541 scope.go:117] "RemoveContainer" containerID="5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0" Jul 14 14:54:04.733564 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.733548 2541 scope.go:117] "RemoveContainer" containerID="5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0" Jul 14 14:54:04.733822 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:54:04.733803 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0\": container with ID starting with 5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0 not found: ID does not exist" containerID="5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0" Jul 14 14:54:04.733891 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.733834 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0"} err="failed to get container status \"5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0\": rpc error: code = NotFound desc = could not find container \"5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0\": container with ID starting with 5555e7470835b0b478b2648106dfdda08cb7938984b966460059802c2c3fd6c0 not found: ID does not exist" Jul 14 14:54:04.759715 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.759691 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx"] Jul 14 14:54:04.769334 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:04.769311 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n7tqx"] Jul 14 14:54:05.850320 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:05.850285 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab302400-bc83-4d46-8356-47d3822a2b44" path="/var/lib/kubelet/pods/ab302400-bc83-4d46-8356-47d3822a2b44/volumes" Jul 14 14:54:22.193783 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.193753 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2pw5"] Jul 14 14:54:22.194244 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.194232 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab302400-bc83-4d46-8356-47d3822a2b44" containerName="manager" Jul 14 14:54:22.194313 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.194250 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab302400-bc83-4d46-8356-47d3822a2b44" containerName="manager" Jul 14 14:54:22.194383 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.194366 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab302400-bc83-4d46-8356-47d3822a2b44" containerName="manager" Jul 14 14:54:22.198486 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.198465 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:22.202769 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.202743 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 14:54:22.202994 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.202977 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hjqhb\"" Jul 14 14:54:22.209128 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.209107 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2pw5"] Jul 14 14:54:22.290432 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.290397 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-config-file\") pod \"limitador-limitador-64c94fd64f-m2pw5\" (UID: \"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:22.290583 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.290506 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzndb\" (UniqueName: \"kubernetes.io/projected/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-kube-api-access-pzndb\") pod \"limitador-limitador-64c94fd64f-m2pw5\" (UID: \"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:22.296487 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.296458 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2pw5"] Jul 14 14:54:22.391034 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.390997 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-config-file\") pod \"limitador-limitador-64c94fd64f-m2pw5\" (UID: \"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:22.391201 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.391101 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzndb\" (UniqueName: \"kubernetes.io/projected/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-kube-api-access-pzndb\") pod \"limitador-limitador-64c94fd64f-m2pw5\" (UID: \"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:22.391644 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.391597 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-config-file\") pod \"limitador-limitador-64c94fd64f-m2pw5\" (UID: \"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:22.405313 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.405284 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzndb\" (UniqueName: \"kubernetes.io/projected/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-kube-api-access-pzndb\") pod \"limitador-limitador-64c94fd64f-m2pw5\" (UID: \"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:22.509487 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.509407 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:22.649745 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.649715 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2pw5"] Jul 14 14:54:22.654189 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:54:22.654165 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b1a6e9_7c8f_4bcd_b8be_f6c469650cd6.slice/crio-9f99ed00c6b29392982bc5c4b05c73fcadbc3e421f851a97aaa6b12cc7093a85 WatchSource:0}: Error finding container 9f99ed00c6b29392982bc5c4b05c73fcadbc3e421f851a97aaa6b12cc7093a85: Status 404 returned error can't find the container with id 9f99ed00c6b29392982bc5c4b05c73fcadbc3e421f851a97aaa6b12cc7093a85 Jul 14 14:54:22.815595 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:22.815526 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" event={"ID":"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6","Type":"ContainerStarted","Data":"9f99ed00c6b29392982bc5c4b05c73fcadbc3e421f851a97aaa6b12cc7093a85"} Jul 14 14:54:25.831497 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:25.831463 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" event={"ID":"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6","Type":"ContainerStarted","Data":"c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b"} Jul 14 14:54:25.831868 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:25.831546 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:25.851841 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:25.851798 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" podStartSLOduration=1.178588689 podStartE2EDuration="3.851785186s" totalImagesPullingTime="2.673196497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:54:25.849895922 +0000 UTC m=+462.405558028" watchObservedRunningTime="2026-07-14 14:54:25.851785186 +0000 UTC m=+462.407447274" Jul 14 14:54:36.838837 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:36.838810 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:37.066741 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.066706 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2pw5"] Jul 14 14:54:37.066902 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.066875 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" podUID="99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6" containerName="limitador" containerID="cri-o://c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b" gracePeriod=30 Jul 14 14:54:37.610659 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.610633 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:37.713874 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.713848 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-config-file\") pod \"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6\" (UID: \"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6\") " Jul 14 14:54:37.714006 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.713931 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzndb\" (UniqueName: \"kubernetes.io/projected/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-kube-api-access-pzndb\") pod \"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6\" (UID: \"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6\") " Jul 14 14:54:37.714168 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.714147 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-config-file" (OuterVolumeSpecName: "config-file") pod "99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6" (UID: "99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:54:37.716009 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.715987 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-kube-api-access-pzndb" (OuterVolumeSpecName: "kube-api-access-pzndb") pod "99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6" (UID: "99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6"). InnerVolumeSpecName "kube-api-access-pzndb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:54:37.814731 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.814707 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzndb\" (UniqueName: \"kubernetes.io/projected/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-kube-api-access-pzndb\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:54:37.814731 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.814727 2541 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6-config-file\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:54:37.885538 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.885509 2541 generic.go:356] "Generic (PLEG): container finished" podID="99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6" containerID="c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b" exitCode=0 Jul 14 14:54:37.885884 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.885546 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" event={"ID":"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6","Type":"ContainerDied","Data":"c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b"} Jul 14 14:54:37.885884 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.885549 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" Jul 14 14:54:37.885884 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.885580 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2pw5" event={"ID":"99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6","Type":"ContainerDied","Data":"9f99ed00c6b29392982bc5c4b05c73fcadbc3e421f851a97aaa6b12cc7093a85"} Jul 14 14:54:37.885884 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.885601 2541 scope.go:117] "RemoveContainer" containerID="c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b" Jul 14 14:54:37.893610 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.893579 2541 scope.go:117] "RemoveContainer" containerID="c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b" Jul 14 14:54:37.893878 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:54:37.893860 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b\": container with ID starting with c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b not found: ID does not exist" containerID="c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b" Jul 14 14:54:37.893942 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.893884 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b"} err="failed to get container status \"c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b\": rpc error: code = NotFound desc = could not find container \"c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b\": container with ID starting with c574754614f45175f495c1189dc60009936c6afb7bb3606c03fb3a6e69840d9b not found: ID does not exist" Jul 14 14:54:37.905325 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.905300 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2pw5"] Jul 14 14:54:37.907360 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:37.907342 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2pw5"] Jul 14 14:54:38.845679 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.845649 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p48jt"] Jul 14 14:54:38.845974 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.845962 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6" containerName="limitador" Jul 14 14:54:38.846021 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.845975 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6" containerName="limitador" Jul 14 14:54:38.846056 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.846035 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6" containerName="limitador" Jul 14 14:54:38.850149 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.850130 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" Jul 14 14:54:38.853016 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.852996 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 14:54:38.853091 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.853044 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-v5f68\"" Jul 14 14:54:38.853847 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.853834 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 14:54:38.853898 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.853848 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 14:54:38.861989 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.861966 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p48jt"] Jul 14 14:54:38.922738 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.922712 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1f3b538d-84f1-41c9-89e7-0d41c8cfe16d-data\") pod \"postgres-69fb4594cf-p48jt\" (UID: \"1f3b538d-84f1-41c9-89e7-0d41c8cfe16d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" Jul 14 14:54:38.923089 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:38.922776 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pk8m\" (UniqueName: \"kubernetes.io/projected/1f3b538d-84f1-41c9-89e7-0d41c8cfe16d-kube-api-access-7pk8m\") pod \"postgres-69fb4594cf-p48jt\" (UID: \"1f3b538d-84f1-41c9-89e7-0d41c8cfe16d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" Jul 14 14:54:39.023579 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:39.023553 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pk8m\" (UniqueName: \"kubernetes.io/projected/1f3b538d-84f1-41c9-89e7-0d41c8cfe16d-kube-api-access-7pk8m\") pod \"postgres-69fb4594cf-p48jt\" (UID: \"1f3b538d-84f1-41c9-89e7-0d41c8cfe16d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" Jul 14 14:54:39.023728 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:39.023603 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1f3b538d-84f1-41c9-89e7-0d41c8cfe16d-data\") pod \"postgres-69fb4594cf-p48jt\" (UID: \"1f3b538d-84f1-41c9-89e7-0d41c8cfe16d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" Jul 14 14:54:39.023994 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:39.023978 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1f3b538d-84f1-41c9-89e7-0d41c8cfe16d-data\") pod \"postgres-69fb4594cf-p48jt\" (UID: \"1f3b538d-84f1-41c9-89e7-0d41c8cfe16d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" Jul 14 14:54:39.034439 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:39.034419 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pk8m\" (UniqueName: \"kubernetes.io/projected/1f3b538d-84f1-41c9-89e7-0d41c8cfe16d-kube-api-access-7pk8m\") pod \"postgres-69fb4594cf-p48jt\" (UID: \"1f3b538d-84f1-41c9-89e7-0d41c8cfe16d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" Jul 14 14:54:39.160556 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:39.160528 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" Jul 14 14:54:39.299838 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:39.299814 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p48jt"] Jul 14 14:54:39.302103 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:54:39.302070 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3b538d_84f1_41c9_89e7_0d41c8cfe16d.slice/crio-fde8cdd7fc8ed2278bf8aefdbbf264afeb2189b127af3dfd60e6fdc3e84f464f WatchSource:0}: Error finding container fde8cdd7fc8ed2278bf8aefdbbf264afeb2189b127af3dfd60e6fdc3e84f464f: Status 404 returned error can't find the container with id fde8cdd7fc8ed2278bf8aefdbbf264afeb2189b127af3dfd60e6fdc3e84f464f Jul 14 14:54:39.852082 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:39.852053 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6" path="/var/lib/kubelet/pods/99b1a6e9-7c8f-4bcd-b8be-f6c469650cd6/volumes" Jul 14 14:54:39.901857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:39.901817 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" event={"ID":"1f3b538d-84f1-41c9-89e7-0d41c8cfe16d","Type":"ContainerStarted","Data":"fde8cdd7fc8ed2278bf8aefdbbf264afeb2189b127af3dfd60e6fdc3e84f464f"} Jul 14 14:54:43.892892 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:43.892870 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 14:54:44.928261 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:44.928226 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" event={"ID":"1f3b538d-84f1-41c9-89e7-0d41c8cfe16d","Type":"ContainerStarted","Data":"d9ba113b53f6f816c413e75ceac5cb359c1e6c8cd57ad844dc4a35ecab6ae0b5"} Jul 14 14:54:44.928675 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:44.928342 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" Jul 14 14:54:44.949339 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:44.949293 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" podStartSLOduration=2.36319621 podStartE2EDuration="6.949278146s" totalImagesPullingTime="4.586081936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:54:44.94697936 +0000 UTC m=+481.502641441" watchObservedRunningTime="2026-07-14 14:54:44.949278146 +0000 UTC m=+481.504940235" Jul 14 14:54:50.966906 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:50.966882 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p48jt" Jul 14 14:54:58.354380 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.354338 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-848d9f7c54-mjlpk"] Jul 14 14:54:58.537954 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.537917 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-848d9f7c54-mjlpk"] Jul 14 14:54:58.538110 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.538032 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:54:58.541804 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.541783 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 14:54:58.541965 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.541787 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 14:54:58.541965 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.541787 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j24c8\"" Jul 14 14:54:58.553244 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.553221 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6948f666b4-sbwgl"] Jul 14 14:54:58.578969 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.578948 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6948f666b4-sbwgl"] Jul 14 14:54:58.579092 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.579033 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:54:58.588378 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.588338 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-webhook-cert\") pod \"maas-controller-6948f666b4-sbwgl\" (UID: \"c21bf4c1-a717-4bed-96db-331b7b7b5bc2\") " pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:54:58.588503 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.588416 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8tjx\" (UniqueName: \"kubernetes.io/projected/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-kube-api-access-x8tjx\") pod \"maas-controller-6948f666b4-sbwgl\" (UID: \"c21bf4c1-a717-4bed-96db-331b7b7b5bc2\") " pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:54:58.689692 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.689657 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4dd74c51-a517-4714-bc30-69f902e548fb-webhook-cert\") pod \"maas-controller-848d9f7c54-mjlpk\" (UID: \"4dd74c51-a517-4714-bc30-69f902e548fb\") " pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:54:58.689884 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.689712 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-webhook-cert\") pod \"maas-controller-6948f666b4-sbwgl\" (UID: \"c21bf4c1-a717-4bed-96db-331b7b7b5bc2\") " pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:54:58.689884 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.689802 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8tjx\" (UniqueName: \"kubernetes.io/projected/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-kube-api-access-x8tjx\") pod \"maas-controller-6948f666b4-sbwgl\" (UID: \"c21bf4c1-a717-4bed-96db-331b7b7b5bc2\") " pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:54:58.689884 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.689865 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm57d\" (UniqueName: \"kubernetes.io/projected/4dd74c51-a517-4714-bc30-69f902e548fb-kube-api-access-pm57d\") pod \"maas-controller-848d9f7c54-mjlpk\" (UID: \"4dd74c51-a517-4714-bc30-69f902e548fb\") " pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:54:58.692346 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.692318 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-webhook-cert\") pod \"maas-controller-6948f666b4-sbwgl\" (UID: \"c21bf4c1-a717-4bed-96db-331b7b7b5bc2\") " pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:54:58.700313 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.700293 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8tjx\" (UniqueName: \"kubernetes.io/projected/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-kube-api-access-x8tjx\") pod \"maas-controller-6948f666b4-sbwgl\" (UID: \"c21bf4c1-a717-4bed-96db-331b7b7b5bc2\") " pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:54:58.791108 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.791067 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm57d\" (UniqueName: \"kubernetes.io/projected/4dd74c51-a517-4714-bc30-69f902e548fb-kube-api-access-pm57d\") pod \"maas-controller-848d9f7c54-mjlpk\" (UID: \"4dd74c51-a517-4714-bc30-69f902e548fb\") " pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:54:58.791247 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.791126 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4dd74c51-a517-4714-bc30-69f902e548fb-webhook-cert\") pod \"maas-controller-848d9f7c54-mjlpk\" (UID: \"4dd74c51-a517-4714-bc30-69f902e548fb\") " pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:54:58.793858 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.793828 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4dd74c51-a517-4714-bc30-69f902e548fb-webhook-cert\") pod \"maas-controller-848d9f7c54-mjlpk\" (UID: \"4dd74c51-a517-4714-bc30-69f902e548fb\") " pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:54:58.800599 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.800576 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm57d\" (UniqueName: \"kubernetes.io/projected/4dd74c51-a517-4714-bc30-69f902e548fb-kube-api-access-pm57d\") pod \"maas-controller-848d9f7c54-mjlpk\" (UID: \"4dd74c51-a517-4714-bc30-69f902e548fb\") " pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:54:58.849015 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.848987 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:54:58.894318 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:58.894291 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:54:59.026792 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:59.026764 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-848d9f7c54-mjlpk"] Jul 14 14:54:59.028737 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:54:59.028705 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd74c51_a517_4714_bc30_69f902e548fb.slice/crio-96f950c9872f8bc41e08c63c0adf4ee3dd2d2d042526223afb43258a1a86ebdc WatchSource:0}: Error finding container 96f950c9872f8bc41e08c63c0adf4ee3dd2d2d042526223afb43258a1a86ebdc: Status 404 returned error can't find the container with id 96f950c9872f8bc41e08c63c0adf4ee3dd2d2d042526223afb43258a1a86ebdc Jul 14 14:54:59.074440 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:54:59.074408 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6948f666b4-sbwgl"] Jul 14 14:54:59.077171 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:54:59.077145 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21bf4c1_a717_4bed_96db_331b7b7b5bc2.slice/crio-4a3100cd06a4a609144e7aa9a79f87abf450006ae6962fcd5232c90da4aad9dc WatchSource:0}: Error finding container 4a3100cd06a4a609144e7aa9a79f87abf450006ae6962fcd5232c90da4aad9dc: Status 404 returned error can't find the container with id 4a3100cd06a4a609144e7aa9a79f87abf450006ae6962fcd5232c90da4aad9dc Jul 14 14:55:00.005308 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:00.005219 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6948f666b4-sbwgl" event={"ID":"c21bf4c1-a717-4bed-96db-331b7b7b5bc2","Type":"ContainerStarted","Data":"4a3100cd06a4a609144e7aa9a79f87abf450006ae6962fcd5232c90da4aad9dc"} Jul 14 14:55:00.008110 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:00.008080 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" event={"ID":"4dd74c51-a517-4714-bc30-69f902e548fb","Type":"ContainerStarted","Data":"96f950c9872f8bc41e08c63c0adf4ee3dd2d2d042526223afb43258a1a86ebdc"} Jul 14 14:55:02.018952 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:02.018919 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6948f666b4-sbwgl" event={"ID":"c21bf4c1-a717-4bed-96db-331b7b7b5bc2","Type":"ContainerStarted","Data":"3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09"} Jul 14 14:55:02.019361 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:02.019058 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:55:02.020458 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:02.020435 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" event={"ID":"4dd74c51-a517-4714-bc30-69f902e548fb","Type":"ContainerStarted","Data":"7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54"} Jul 14 14:55:02.020591 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:02.020545 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:55:02.072028 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:02.071985 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" podStartSLOduration=2.006146225 podStartE2EDuration="4.07196986s" totalImagesPullingTime="2.065823635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:55:02.071418696 +0000 UTC m=+498.627080817" watchObservedRunningTime="2026-07-14 14:55:02.07196986 +0000 UTC m=+498.627631949" Jul 14 14:55:02.073124 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:02.073094 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6948f666b4-sbwgl" podStartSLOduration=2.048604407 podStartE2EDuration="4.073082386s" totalImagesPullingTime="2.024477979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:55:02.048532563 +0000 UTC m=+498.604194651" watchObservedRunningTime="2026-07-14 14:55:02.073082386 +0000 UTC m=+498.628744475" Jul 14 14:55:13.028489 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:13.028451 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:55:13.028996 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:13.028519 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:55:13.103795 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:13.103741 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-848d9f7c54-mjlpk"] Jul 14 14:55:13.104029 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:13.104000 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" podUID="4dd74c51-a517-4714-bc30-69f902e548fb" containerName="manager" containerID="cri-o://7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54" gracePeriod=30 Jul 14 14:55:13.354454 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:13.354430 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:55:13.415480 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:13.415449 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4dd74c51-a517-4714-bc30-69f902e548fb-webhook-cert\") pod \"4dd74c51-a517-4714-bc30-69f902e548fb\" (UID: \"4dd74c51-a517-4714-bc30-69f902e548fb\") " Jul 14 14:55:13.415664 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:13.415510 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm57d\" (UniqueName: \"kubernetes.io/projected/4dd74c51-a517-4714-bc30-69f902e548fb-kube-api-access-pm57d\") pod \"4dd74c51-a517-4714-bc30-69f902e548fb\" (UID: \"4dd74c51-a517-4714-bc30-69f902e548fb\") " Jul 14 14:55:13.417739 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:13.417714 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dd74c51-a517-4714-bc30-69f902e548fb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4dd74c51-a517-4714-bc30-69f902e548fb" (UID: "4dd74c51-a517-4714-bc30-69f902e548fb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:55:13.417739 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:13.417723 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd74c51-a517-4714-bc30-69f902e548fb-kube-api-access-pm57d" (OuterVolumeSpecName: "kube-api-access-pm57d") pod "4dd74c51-a517-4714-bc30-69f902e548fb" (UID: "4dd74c51-a517-4714-bc30-69f902e548fb"). InnerVolumeSpecName "kube-api-access-pm57d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:55:13.517001 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:13.516969 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm57d\" (UniqueName: \"kubernetes.io/projected/4dd74c51-a517-4714-bc30-69f902e548fb-kube-api-access-pm57d\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:55:13.517001 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:13.516993 2541 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4dd74c51-a517-4714-bc30-69f902e548fb-webhook-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:55:14.075416 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:14.075374 2541 generic.go:356] "Generic (PLEG): container finished" podID="4dd74c51-a517-4714-bc30-69f902e548fb" containerID="7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54" exitCode=0 Jul 14 14:55:14.075416 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:14.075416 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" Jul 14 14:55:14.075881 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:14.075454 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" event={"ID":"4dd74c51-a517-4714-bc30-69f902e548fb","Type":"ContainerDied","Data":"7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54"} Jul 14 14:55:14.075881 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:14.075510 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-848d9f7c54-mjlpk" event={"ID":"4dd74c51-a517-4714-bc30-69f902e548fb","Type":"ContainerDied","Data":"96f950c9872f8bc41e08c63c0adf4ee3dd2d2d042526223afb43258a1a86ebdc"} Jul 14 14:55:14.075881 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:14.075533 2541 scope.go:117] "RemoveContainer" containerID="7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54" Jul 14 14:55:14.083610 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:14.083595 2541 scope.go:117] "RemoveContainer" containerID="7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54" Jul 14 14:55:14.083984 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:55:14.083966 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54\": container with ID starting with 7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54 not found: ID does not exist" containerID="7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54" Jul 14 14:55:14.084033 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:14.083992 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54"} err="failed to get container status \"7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54\": rpc error: code = NotFound desc = could not find container \"7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54\": container with ID starting with 7d7552a03ddfff0c95efb580d8799394e24b356a3109a2f26fdb9d37ae78de54 not found: ID does not exist" Jul 14 14:55:14.094598 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:14.094578 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-848d9f7c54-mjlpk"] Jul 14 14:55:14.103244 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:14.100113 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-848d9f7c54-mjlpk"] Jul 14 14:55:15.850540 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:15.850507 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dd74c51-a517-4714-bc30-69f902e548fb" path="/var/lib/kubelet/pods/4dd74c51-a517-4714-bc30-69f902e548fb/volumes" Jul 14 14:55:33.355763 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.355727 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg"] Jul 14 14:55:33.356142 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.356093 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dd74c51-a517-4714-bc30-69f902e548fb" containerName="manager" Jul 14 14:55:33.356142 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.356105 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dd74c51-a517-4714-bc30-69f902e548fb" containerName="manager" Jul 14 14:55:33.356221 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.356176 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dd74c51-a517-4714-bc30-69f902e548fb" containerName="manager" Jul 14 14:55:33.360585 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.360570 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:33.366337 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.366319 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 14 14:55:33.370126 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.370108 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jktgt\"" Jul 14 14:55:33.401162 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.401139 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg"] Jul 14 14:55:33.503334 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.503305 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe-maas-api-tls\") pod \"maas-api-74bc5d7f86-9kbxg\" (UID: \"7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe\") " pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:33.503500 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.503366 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f29bd\" (UniqueName: \"kubernetes.io/projected/7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe-kube-api-access-f29bd\") pod \"maas-api-74bc5d7f86-9kbxg\" (UID: \"7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe\") " pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:33.503500 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.503433 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe-openshift-service-ca\") pod \"maas-api-74bc5d7f86-9kbxg\" (UID: \"7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe\") " pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:33.604308 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.604270 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29bd\" (UniqueName: \"kubernetes.io/projected/7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe-kube-api-access-f29bd\") pod \"maas-api-74bc5d7f86-9kbxg\" (UID: \"7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe\") " pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:33.604469 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.604324 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe-openshift-service-ca\") pod \"maas-api-74bc5d7f86-9kbxg\" (UID: \"7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe\") " pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:33.604469 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.604371 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe-maas-api-tls\") pod \"maas-api-74bc5d7f86-9kbxg\" (UID: \"7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe\") " pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:33.605030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.605004 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe-openshift-service-ca\") pod \"maas-api-74bc5d7f86-9kbxg\" (UID: \"7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe\") " pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:33.607014 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.606966 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe-maas-api-tls\") pod \"maas-api-74bc5d7f86-9kbxg\" (UID: \"7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe\") " pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:33.613535 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.613511 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f29bd\" (UniqueName: \"kubernetes.io/projected/7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe-kube-api-access-f29bd\") pod \"maas-api-74bc5d7f86-9kbxg\" (UID: \"7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe\") " pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:33.670321 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.670296 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:33.813022 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:33.812860 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg"] Jul 14 14:55:33.815636 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:55:33.815590 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a21f7f5_e9c6_491e_86cd_0b7b1c5f96fe.slice/crio-48b7512b8e5207fbb32c081f1957ddc07720726c450fc7c23545685b2895f724 WatchSource:0}: Error finding container 48b7512b8e5207fbb32c081f1957ddc07720726c450fc7c23545685b2895f724: Status 404 returned error can't find the container with id 48b7512b8e5207fbb32c081f1957ddc07720726c450fc7c23545685b2895f724 Jul 14 14:55:34.162217 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.162171 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" event={"ID":"7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe","Type":"ContainerStarted","Data":"48b7512b8e5207fbb32c081f1957ddc07720726c450fc7c23545685b2895f724"} Jul 14 14:55:34.261785 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.261746 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc"] Jul 14 14:55:34.266206 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.266186 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" Jul 14 14:55:34.269117 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.269098 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zhzxq\"" Jul 14 14:55:34.269549 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.269532 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 14:55:34.280438 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.280410 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc"] Jul 14 14:55:34.291389 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.291365 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-j8lbb"] Jul 14 14:55:34.294710 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.294650 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" Jul 14 14:55:34.311329 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.311292 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-j8lbb"] Jul 14 14:55:34.411000 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.410922 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f547b73f-a83c-4ce2-a856-cd6cc97570cc-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-d9gsc\" (UID: \"f547b73f-a83c-4ce2-a856-cd6cc97570cc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" Jul 14 14:55:34.411000 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.410967 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee39061a-8411-41de-b6da-a5f2613824eb-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-j8lbb\" (UID: \"ee39061a-8411-41de-b6da-a5f2613824eb\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" Jul 14 14:55:34.411395 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.411005 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbjq4\" (UniqueName: \"kubernetes.io/projected/f547b73f-a83c-4ce2-a856-cd6cc97570cc-kube-api-access-cbjq4\") pod \"payload-pre-processing-74584bb9f8-d9gsc\" (UID: \"f547b73f-a83c-4ce2-a856-cd6cc97570cc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" Jul 14 14:55:34.411395 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.411059 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86fs\" (UniqueName: \"kubernetes.io/projected/ee39061a-8411-41de-b6da-a5f2613824eb-kube-api-access-c86fs\") pod \"payload-processing-f9b8d9b9b-j8lbb\" (UID: \"ee39061a-8411-41de-b6da-a5f2613824eb\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" Jul 14 14:55:34.512215 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.512119 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f547b73f-a83c-4ce2-a856-cd6cc97570cc-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-d9gsc\" (UID: \"f547b73f-a83c-4ce2-a856-cd6cc97570cc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" Jul 14 14:55:34.512215 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.512190 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee39061a-8411-41de-b6da-a5f2613824eb-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-j8lbb\" (UID: \"ee39061a-8411-41de-b6da-a5f2613824eb\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" Jul 14 14:55:34.512441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.512235 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjq4\" (UniqueName: \"kubernetes.io/projected/f547b73f-a83c-4ce2-a856-cd6cc97570cc-kube-api-access-cbjq4\") pod \"payload-pre-processing-74584bb9f8-d9gsc\" (UID: \"f547b73f-a83c-4ce2-a856-cd6cc97570cc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" Jul 14 14:55:34.512441 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.512293 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86fs\" (UniqueName: \"kubernetes.io/projected/ee39061a-8411-41de-b6da-a5f2613824eb-kube-api-access-c86fs\") pod \"payload-processing-f9b8d9b9b-j8lbb\" (UID: \"ee39061a-8411-41de-b6da-a5f2613824eb\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" Jul 14 14:55:34.512890 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.512870 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f547b73f-a83c-4ce2-a856-cd6cc97570cc-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-d9gsc\" (UID: \"f547b73f-a83c-4ce2-a856-cd6cc97570cc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" Jul 14 14:55:34.512987 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.512954 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee39061a-8411-41de-b6da-a5f2613824eb-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-j8lbb\" (UID: \"ee39061a-8411-41de-b6da-a5f2613824eb\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" Jul 14 14:55:34.533438 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.533408 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbjq4\" (UniqueName: \"kubernetes.io/projected/f547b73f-a83c-4ce2-a856-cd6cc97570cc-kube-api-access-cbjq4\") pod \"payload-pre-processing-74584bb9f8-d9gsc\" (UID: \"f547b73f-a83c-4ce2-a856-cd6cc97570cc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" Jul 14 14:55:34.533573 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.533551 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86fs\" (UniqueName: \"kubernetes.io/projected/ee39061a-8411-41de-b6da-a5f2613824eb-kube-api-access-c86fs\") pod \"payload-processing-f9b8d9b9b-j8lbb\" (UID: \"ee39061a-8411-41de-b6da-a5f2613824eb\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" Jul 14 14:55:34.576299 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.576267 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" Jul 14 14:55:34.604450 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.604424 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" Jul 14 14:55:34.734596 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.734565 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc"] Jul 14 14:55:34.735243 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:55:34.735212 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf547b73f_a83c_4ce2_a856_cd6cc97570cc.slice/crio-eb0c3095b61c0d2c1aa1a4a6487a34bc432a7d3ce30eb826e7d7eaae75ba9ad1 WatchSource:0}: Error finding container eb0c3095b61c0d2c1aa1a4a6487a34bc432a7d3ce30eb826e7d7eaae75ba9ad1: Status 404 returned error can't find the container with id eb0c3095b61c0d2c1aa1a4a6487a34bc432a7d3ce30eb826e7d7eaae75ba9ad1 Jul 14 14:55:34.758587 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:34.758532 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-j8lbb"] Jul 14 14:55:34.761018 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:55:34.760992 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee39061a_8411_41de_b6da_a5f2613824eb.slice/crio-05836f9a0cd0e36e8466aa60a079011d6aa9681cf238d3b10e9187382f501866 WatchSource:0}: Error finding container 05836f9a0cd0e36e8466aa60a079011d6aa9681cf238d3b10e9187382f501866: Status 404 returned error can't find the container with id 05836f9a0cd0e36e8466aa60a079011d6aa9681cf238d3b10e9187382f501866 Jul 14 14:55:35.170371 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:35.170324 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" event={"ID":"ee39061a-8411-41de-b6da-a5f2613824eb","Type":"ContainerStarted","Data":"05836f9a0cd0e36e8466aa60a079011d6aa9681cf238d3b10e9187382f501866"} Jul 14 14:55:35.171731 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:35.171698 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" event={"ID":"f547b73f-a83c-4ce2-a856-cd6cc97570cc","Type":"ContainerStarted","Data":"eb0c3095b61c0d2c1aa1a4a6487a34bc432a7d3ce30eb826e7d7eaae75ba9ad1"} Jul 14 14:55:36.178453 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:36.178422 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" event={"ID":"7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe","Type":"ContainerStarted","Data":"12525ee95d890661e046874c5578437cd74e927bca5511d266d9c3c5900132c6"} Jul 14 14:55:36.178906 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:36.178586 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:36.198199 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:36.198148 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" podStartSLOduration=1.253621633 podStartE2EDuration="3.198128266s" totalImagesPullingTime="1.944506633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:55:36.195494443 +0000 UTC m=+532.751156534" watchObservedRunningTime="2026-07-14 14:55:36.198128266 +0000 UTC m=+532.753790357" Jul 14 14:55:37.185823 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:37.185786 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" event={"ID":"ee39061a-8411-41de-b6da-a5f2613824eb","Type":"ContainerStarted","Data":"cbdaac2f1f1818de6e9428ee7bca5c437e73fa5c2457df59171737b67ec5b5ff"} Jul 14 14:55:37.186251 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:37.185904 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" Jul 14 14:55:37.187330 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:37.187304 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" event={"ID":"f547b73f-a83c-4ce2-a856-cd6cc97570cc","Type":"ContainerStarted","Data":"9a9fd07ae718c8799b76c063d9b718ce8eec8611b34ca072495ea61639a7cde6"} Jul 14 14:55:37.187439 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:37.187353 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" Jul 14 14:55:37.205207 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:37.205170 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" podStartSLOduration=1.786613527 podStartE2EDuration="3.205155299s" totalImagesPullingTime="1.418541772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:55:37.203157131 +0000 UTC m=+533.758819220" watchObservedRunningTime="2026-07-14 14:55:37.205155299 +0000 UTC m=+533.760817411" Jul 14 14:55:37.221602 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:37.221557 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" podStartSLOduration=1.7747447250000001 podStartE2EDuration="3.221542173s" totalImagesPullingTime="1.446797448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:55:37.220645999 +0000 UTC m=+533.776308104" watchObservedRunningTime="2026-07-14 14:55:37.221542173 +0000 UTC m=+533.777204261" Jul 14 14:55:42.192849 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:42.192821 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-74bc5d7f86-9kbxg" Jul 14 14:55:48.193775 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:48.193744 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d9gsc" Jul 14 14:55:48.194182 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:55:48.193928 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-j8lbb" Jul 14 14:56:14.817650 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.817598 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8"] Jul 14 14:56:14.822028 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.822012 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:14.824944 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.824921 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 14:56:14.825924 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.825901 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 14:56:14.825924 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.825911 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 14 14:56:14.826079 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.825957 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dkbzc\"" Jul 14 14:56:14.831568 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.831550 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8"] Jul 14 14:56:14.948749 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.948717 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:14.948991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.948764 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:14.948991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.948864 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:14.948991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.948921 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:14.948991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.948947 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:14.948991 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:14.948976 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkrjx\" (UniqueName: \"kubernetes.io/projected/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-kube-api-access-lkrjx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.049806 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.049776 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.049967 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.049814 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.049967 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.049834 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.049967 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.049855 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.049967 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.049878 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.049967 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.049910 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkrjx\" (UniqueName: \"kubernetes.io/projected/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-kube-api-access-lkrjx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.050345 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.050319 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.050457 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.050356 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.050457 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.050373 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.052327 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.052311 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.052419 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.052401 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.062589 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.062562 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkrjx\" (UniqueName: \"kubernetes.io/projected/3e8c3e64-22e5-4073-b1d2-557f3839ca0c-kube-api-access-lkrjx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8\" (UID: \"3e8c3e64-22e5-4073-b1d2-557f3839ca0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.132766 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.132702 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:15.282566 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.282518 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8"] Jul 14 14:56:15.284794 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:56:15.284767 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8c3e64_22e5_4073_b1d2_557f3839ca0c.slice/crio-06d005bd59a5e4518c5c1edda291af743db5adcf2df29f170dd8bf5b7653e8f2 WatchSource:0}: Error finding container 06d005bd59a5e4518c5c1edda291af743db5adcf2df29f170dd8bf5b7653e8f2: Status 404 returned error can't find the container with id 06d005bd59a5e4518c5c1edda291af743db5adcf2df29f170dd8bf5b7653e8f2 Jul 14 14:56:15.355494 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:15.355467 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" event={"ID":"3e8c3e64-22e5-4073-b1d2-557f3839ca0c","Type":"ContainerStarted","Data":"06d005bd59a5e4518c5c1edda291af743db5adcf2df29f170dd8bf5b7653e8f2"} Jul 14 14:56:17.365918 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:17.365874 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" event={"ID":"3e8c3e64-22e5-4073-b1d2-557f3839ca0c","Type":"ContainerStarted","Data":"9bffd4553c690c4c2be1ace0cd4cd8b0d631e4d86bf963f35f0715cb4b21e39e"} Jul 14 14:56:17.389913 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:17.389867 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" podStartSLOduration=2.339399549 podStartE2EDuration="3.38985004s" totalImagesPullingTime="1.050450491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:56:17.386510644 +0000 UTC m=+573.942172736" watchObservedRunningTime="2026-07-14 14:56:17.38985004 +0000 UTC m=+573.945512129" Jul 14 14:56:25.133105 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:25.133066 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:25.133514 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:25.133133 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:25.145533 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:25.145500 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:25.412720 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:25.412695 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8" Jul 14 14:56:36.201348 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.201313 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg"] Jul 14 14:56:36.204833 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.204819 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.208508 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.208486 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 14 14:56:36.219899 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.219874 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg"] Jul 14 14:56:36.231869 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.231841 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.231966 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.231876 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.231966 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.231915 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4595a1d-29af-41fc-aff9-ab9dc8303d32-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.232048 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.231995 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.232090 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.232072 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ktzx\" (UniqueName: \"kubernetes.io/projected/c4595a1d-29af-41fc-aff9-ab9dc8303d32-kube-api-access-9ktzx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.232153 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.232138 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.332679 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.332657 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.332789 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.332703 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ktzx\" (UniqueName: \"kubernetes.io/projected/c4595a1d-29af-41fc-aff9-ab9dc8303d32-kube-api-access-9ktzx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.332789 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.332738 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.332789 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.332767 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.332940 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.332796 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.332940 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.332885 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4595a1d-29af-41fc-aff9-ab9dc8303d32-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.333161 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.333140 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.333252 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.333159 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.333252 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.333204 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.335089 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.335060 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4595a1d-29af-41fc-aff9-ab9dc8303d32-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.335478 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.335452 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4595a1d-29af-41fc-aff9-ab9dc8303d32-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.350020 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.350001 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ktzx\" (UniqueName: \"kubernetes.io/projected/c4595a1d-29af-41fc-aff9-ab9dc8303d32-kube-api-access-9ktzx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhbmg\" (UID: \"c4595a1d-29af-41fc-aff9-ab9dc8303d32\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.515037 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.514965 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:36.648774 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:36.648752 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg"] Jul 14 14:56:36.650525 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:56:36.650494 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4595a1d_29af_41fc_aff9_ab9dc8303d32.slice/crio-979073713c6d6595e9dfad1601b37d0440375ab95e411d0eaafa7b01bb57615b WatchSource:0}: Error finding container 979073713c6d6595e9dfad1601b37d0440375ab95e411d0eaafa7b01bb57615b: Status 404 returned error can't find the container with id 979073713c6d6595e9dfad1601b37d0440375ab95e411d0eaafa7b01bb57615b Jul 14 14:56:37.457713 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:37.457676 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" event={"ID":"c4595a1d-29af-41fc-aff9-ab9dc8303d32","Type":"ContainerStarted","Data":"406653d2de04558addf2edbe962ccbc6076feea95f326d3cadb6ba80cbf1dc89"} Jul 14 14:56:37.458077 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:37.457723 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" event={"ID":"c4595a1d-29af-41fc-aff9-ab9dc8303d32","Type":"ContainerStarted","Data":"979073713c6d6595e9dfad1601b37d0440375ab95e411d0eaafa7b01bb57615b"} Jul 14 14:56:37.477844 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:37.477727 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" podStartSLOduration=1.2899978810000001 podStartE2EDuration="1.477710008s" totalImagesPullingTime="187.712127ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:56:37.477599506 +0000 UTC m=+594.033261641" watchObservedRunningTime="2026-07-14 14:56:37.477710008 +0000 UTC m=+594.033372098" Jul 14 14:56:43.784704 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:43.784675 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 14:56:43.792045 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:43.792012 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 14:56:46.515881 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:46.515849 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:46.516373 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:46.516132 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:46.528387 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:46.528364 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:47.512475 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:47.512440 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhbmg" Jul 14 14:56:50.997513 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:50.997481 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9"] Jul 14 14:56:51.004053 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.004038 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.006970 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.006949 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 14 14:56:51.012270 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.012250 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9"] Jul 14 14:56:51.059198 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.059167 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.059361 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.059207 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.059361 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.059225 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06f5988d-85c1-4526-ad96-792ef81b5ce4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.059361 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.059302 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.059361 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.059341 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkmht\" (UniqueName: \"kubernetes.io/projected/06f5988d-85c1-4526-ad96-792ef81b5ce4-kube-api-access-qkmht\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.059492 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.059376 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.160030 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.159994 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.160219 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.160092 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.160219 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.160129 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.160219 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.160152 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06f5988d-85c1-4526-ad96-792ef81b5ce4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.160219 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.160207 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.160426 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.160229 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkmht\" (UniqueName: \"kubernetes.io/projected/06f5988d-85c1-4526-ad96-792ef81b5ce4-kube-api-access-qkmht\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.160476 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.160429 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.160476 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.160451 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.160672 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.160648 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.162536 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.162516 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06f5988d-85c1-4526-ad96-792ef81b5ce4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.162810 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.162795 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06f5988d-85c1-4526-ad96-792ef81b5ce4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.169436 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.169415 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkmht\" (UniqueName: \"kubernetes.io/projected/06f5988d-85c1-4526-ad96-792ef81b5ce4-kube-api-access-qkmht\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-brfb9\" (UID: \"06f5988d-85c1-4526-ad96-792ef81b5ce4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.315839 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.315752 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:56:51.450125 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.450014 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9"] Jul 14 14:56:51.452257 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:56:51.452224 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f5988d_85c1_4526_ad96_792ef81b5ce4.slice/crio-84712c91b9582001c7a92489bab729db36f4af7340a6a90621aef1dab0122c94 WatchSource:0}: Error finding container 84712c91b9582001c7a92489bab729db36f4af7340a6a90621aef1dab0122c94: Status 404 returned error can't find the container with id 84712c91b9582001c7a92489bab729db36f4af7340a6a90621aef1dab0122c94 Jul 14 14:56:51.520883 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:51.520850 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" event={"ID":"06f5988d-85c1-4526-ad96-792ef81b5ce4","Type":"ContainerStarted","Data":"84712c91b9582001c7a92489bab729db36f4af7340a6a90621aef1dab0122c94"} Jul 14 14:56:52.527366 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:52.527323 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" event={"ID":"06f5988d-85c1-4526-ad96-792ef81b5ce4","Type":"ContainerStarted","Data":"3b0287eb2c2c4f63619eb277f5415b9db3ea495b58e100f34c1a48a70c0fa4e4"} Jul 14 14:56:52.547746 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:56:52.547678 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" podStartSLOduration=2.110714748 podStartE2EDuration="2.547655383s" totalImagesPullingTime="436.940635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:56:52.545797379 +0000 UTC m=+609.101459464" watchObservedRunningTime="2026-07-14 14:56:52.547655383 +0000 UTC m=+609.103317480" Jul 14 14:57:01.316560 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:57:01.316523 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:57:01.317064 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:57:01.316594 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:57:01.329001 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:57:01.328979 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:57:01.579893 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:57:01.579821 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-brfb9" Jul 14 14:59:29.503907 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:29.503879 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6948f666b4-sbwgl"] Jul 14 14:59:29.504388 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:29.504058 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6948f666b4-sbwgl" podUID="c21bf4c1-a717-4bed-96db-331b7b7b5bc2" containerName="manager" containerID="cri-o://3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09" gracePeriod=30 Jul 14 14:59:29.753846 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:29.753819 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:59:29.906647 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:29.906602 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-webhook-cert\") pod \"c21bf4c1-a717-4bed-96db-331b7b7b5bc2\" (UID: \"c21bf4c1-a717-4bed-96db-331b7b7b5bc2\") " Jul 14 14:59:29.906775 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:29.906690 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8tjx\" (UniqueName: \"kubernetes.io/projected/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-kube-api-access-x8tjx\") pod \"c21bf4c1-a717-4bed-96db-331b7b7b5bc2\" (UID: \"c21bf4c1-a717-4bed-96db-331b7b7b5bc2\") " Jul 14 14:59:29.908694 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:29.908666 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c21bf4c1-a717-4bed-96db-331b7b7b5bc2" (UID: "c21bf4c1-a717-4bed-96db-331b7b7b5bc2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:59:29.908806 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:29.908783 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-kube-api-access-x8tjx" (OuterVolumeSpecName: "kube-api-access-x8tjx") pod "c21bf4c1-a717-4bed-96db-331b7b7b5bc2" (UID: "c21bf4c1-a717-4bed-96db-331b7b7b5bc2"). InnerVolumeSpecName "kube-api-access-x8tjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:59:30.007987 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:30.007961 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8tjx\" (UniqueName: \"kubernetes.io/projected/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-kube-api-access-x8tjx\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:59:30.007987 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:30.007985 2541 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c21bf4c1-a717-4bed-96db-331b7b7b5bc2-webhook-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 14:59:30.256112 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:30.256008 2541 generic.go:356] "Generic (PLEG): container finished" podID="c21bf4c1-a717-4bed-96db-331b7b7b5bc2" containerID="3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09" exitCode=0 Jul 14 14:59:30.256112 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:30.256084 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6948f666b4-sbwgl" event={"ID":"c21bf4c1-a717-4bed-96db-331b7b7b5bc2","Type":"ContainerDied","Data":"3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09"} Jul 14 14:59:30.256359 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:30.256174 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6948f666b4-sbwgl" event={"ID":"c21bf4c1-a717-4bed-96db-331b7b7b5bc2","Type":"ContainerDied","Data":"4a3100cd06a4a609144e7aa9a79f87abf450006ae6962fcd5232c90da4aad9dc"} Jul 14 14:59:30.256359 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:30.256220 2541 scope.go:117] "RemoveContainer" containerID="3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09" Jul 14 14:59:30.256476 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:30.256439 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6948f666b4-sbwgl" Jul 14 14:59:30.267471 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:30.267452 2541 scope.go:117] "RemoveContainer" containerID="3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09" Jul 14 14:59:30.267748 ip-10-0-142-186 kubenswrapper[2541]: E0714 14:59:30.267730 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09\": container with ID starting with 3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09 not found: ID does not exist" containerID="3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09" Jul 14 14:59:30.267834 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:30.267755 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09"} err="failed to get container status \"3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09\": rpc error: code = NotFound desc = could not find container \"3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09\": container with ID starting with 3b3f6c67c724926d1838536eafdaf994d9e7eef16528d4c486353ff317e0ba09 not found: ID does not exist" Jul 14 14:59:30.285333 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:30.285308 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6948f666b4-sbwgl"] Jul 14 14:59:30.291754 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:30.291733 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6948f666b4-sbwgl"] Jul 14 14:59:31.206029 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.205996 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6948f666b4-smd7n"] Jul 14 14:59:31.206380 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.206356 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c21bf4c1-a717-4bed-96db-331b7b7b5bc2" containerName="manager" Jul 14 14:59:31.206380 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.206367 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="c21bf4c1-a717-4bed-96db-331b7b7b5bc2" containerName="manager" Jul 14 14:59:31.206459 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.206426 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="c21bf4c1-a717-4bed-96db-331b7b7b5bc2" containerName="manager" Jul 14 14:59:31.210569 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.210551 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6948f666b4-smd7n" Jul 14 14:59:31.214532 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.214512 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j24c8\"" Jul 14 14:59:31.215410 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.215392 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 14:59:31.215467 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.215408 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 14:59:31.232003 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.231982 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6948f666b4-smd7n"] Jul 14 14:59:31.318120 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.318096 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6eee6767-cd6b-42dc-9d75-155eefd0fe46-webhook-cert\") pod \"maas-controller-6948f666b4-smd7n\" (UID: \"6eee6767-cd6b-42dc-9d75-155eefd0fe46\") " pod="opendatahub/maas-controller-6948f666b4-smd7n" Jul 14 14:59:31.318270 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.318135 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfwlb\" (UniqueName: \"kubernetes.io/projected/6eee6767-cd6b-42dc-9d75-155eefd0fe46-kube-api-access-dfwlb\") pod \"maas-controller-6948f666b4-smd7n\" (UID: \"6eee6767-cd6b-42dc-9d75-155eefd0fe46\") " pod="opendatahub/maas-controller-6948f666b4-smd7n" Jul 14 14:59:31.418950 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.418926 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfwlb\" (UniqueName: \"kubernetes.io/projected/6eee6767-cd6b-42dc-9d75-155eefd0fe46-kube-api-access-dfwlb\") pod \"maas-controller-6948f666b4-smd7n\" (UID: \"6eee6767-cd6b-42dc-9d75-155eefd0fe46\") " pod="opendatahub/maas-controller-6948f666b4-smd7n" Jul 14 14:59:31.419073 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.419018 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6eee6767-cd6b-42dc-9d75-155eefd0fe46-webhook-cert\") pod \"maas-controller-6948f666b4-smd7n\" (UID: \"6eee6767-cd6b-42dc-9d75-155eefd0fe46\") " pod="opendatahub/maas-controller-6948f666b4-smd7n" Jul 14 14:59:31.421457 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.421436 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6eee6767-cd6b-42dc-9d75-155eefd0fe46-webhook-cert\") pod \"maas-controller-6948f666b4-smd7n\" (UID: \"6eee6767-cd6b-42dc-9d75-155eefd0fe46\") " pod="opendatahub/maas-controller-6948f666b4-smd7n" Jul 14 14:59:31.429198 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.429178 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfwlb\" (UniqueName: \"kubernetes.io/projected/6eee6767-cd6b-42dc-9d75-155eefd0fe46-kube-api-access-dfwlb\") pod \"maas-controller-6948f666b4-smd7n\" (UID: \"6eee6767-cd6b-42dc-9d75-155eefd0fe46\") " pod="opendatahub/maas-controller-6948f666b4-smd7n" Jul 14 14:59:31.520024 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.519967 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6948f666b4-smd7n" Jul 14 14:59:31.655693 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.655670 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6948f666b4-smd7n"] Jul 14 14:59:31.657017 ip-10-0-142-186 kubenswrapper[2541]: W0714 14:59:31.656987 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eee6767_cd6b_42dc_9d75_155eefd0fe46.slice/crio-59abf3f69a0364691b9b839e02d56b9141bef5d1c4290a5b3b1d5d7a2ce86ff6 WatchSource:0}: Error finding container 59abf3f69a0364691b9b839e02d56b9141bef5d1c4290a5b3b1d5d7a2ce86ff6: Status 404 returned error can't find the container with id 59abf3f69a0364691b9b839e02d56b9141bef5d1c4290a5b3b1d5d7a2ce86ff6 Jul 14 14:59:31.658478 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.658461 2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 14:59:31.850891 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:31.850818 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c21bf4c1-a717-4bed-96db-331b7b7b5bc2" path="/var/lib/kubelet/pods/c21bf4c1-a717-4bed-96db-331b7b7b5bc2/volumes" Jul 14 14:59:32.268857 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:32.268809 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6948f666b4-smd7n" event={"ID":"6eee6767-cd6b-42dc-9d75-155eefd0fe46","Type":"ContainerStarted","Data":"f3a19cd765d6fce65545cb96c532520517109e50063e16bb6b415e97769c2ea3"} Jul 14 14:59:32.269235 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:32.268878 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6948f666b4-smd7n" event={"ID":"6eee6767-cd6b-42dc-9d75-155eefd0fe46","Type":"ContainerStarted","Data":"59abf3f69a0364691b9b839e02d56b9141bef5d1c4290a5b3b1d5d7a2ce86ff6"} Jul 14 14:59:32.269235 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:32.268903 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6948f666b4-smd7n" Jul 14 14:59:32.294896 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:32.294843 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6948f666b4-smd7n" podStartSLOduration=0.837671954 podStartE2EDuration="1.29482816s" totalImagesPullingTime="457.156206ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:59:32.293189688 +0000 UTC m=+768.848851814" watchObservedRunningTime="2026-07-14 14:59:32.29482816 +0000 UTC m=+768.850490248" Jul 14 14:59:43.275511 ip-10-0-142-186 kubenswrapper[2541]: I0714 14:59:43.275474 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6948f666b4-smd7n" Jul 14 15:01:43.819908 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:01:43.819879 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 15:01:43.820403 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:01:43.819998 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 15:04:30.730062 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:30.730021 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck"] Jul 14 15:04:30.732732 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:30.730227 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" podUID="fa1c5143-6e00-436b-9d0c-710e20a7321c" containerName="manager" containerID="cri-o://ca574562ee26079d2aa602f8d1e9966951c3a69c4f0fd35e36e2bb7cc0a4d240" gracePeriod=10 Jul 14 15:04:33.672073 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:33.672036 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" podUID="fa1c5143-6e00-436b-9d0c-710e20a7321c" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.29:8081/readyz\": dial tcp 10.133.0.29:8081: connect: connection refused" Jul 14 15:04:33.723731 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:33.723687 2541 generic.go:356] "Generic (PLEG): container finished" podID="fa1c5143-6e00-436b-9d0c-710e20a7321c" containerID="ca574562ee26079d2aa602f8d1e9966951c3a69c4f0fd35e36e2bb7cc0a4d240" exitCode=0 Jul 14 15:04:33.723892 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:33.723747 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" event={"ID":"fa1c5143-6e00-436b-9d0c-710e20a7321c","Type":"ContainerDied","Data":"ca574562ee26079d2aa602f8d1e9966951c3a69c4f0fd35e36e2bb7cc0a4d240"} Jul 14 15:04:33.798232 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:33.798208 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 15:04:33.867468 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:33.867433 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfsc6\" (UniqueName: \"kubernetes.io/projected/fa1c5143-6e00-436b-9d0c-710e20a7321c-kube-api-access-vfsc6\") pod \"fa1c5143-6e00-436b-9d0c-710e20a7321c\" (UID: \"fa1c5143-6e00-436b-9d0c-710e20a7321c\") " Jul 14 15:04:33.867660 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:33.867554 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1c5143-6e00-436b-9d0c-710e20a7321c-extensions-socket-volume\") pod \"fa1c5143-6e00-436b-9d0c-710e20a7321c\" (UID: \"fa1c5143-6e00-436b-9d0c-710e20a7321c\") " Jul 14 15:04:33.867930 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:33.867906 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1c5143-6e00-436b-9d0c-710e20a7321c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fa1c5143-6e00-436b-9d0c-710e20a7321c" (UID: "fa1c5143-6e00-436b-9d0c-710e20a7321c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:04:33.869712 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:33.869683 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa1c5143-6e00-436b-9d0c-710e20a7321c-kube-api-access-vfsc6" (OuterVolumeSpecName: "kube-api-access-vfsc6") pod "fa1c5143-6e00-436b-9d0c-710e20a7321c" (UID: "fa1c5143-6e00-436b-9d0c-710e20a7321c"). InnerVolumeSpecName "kube-api-access-vfsc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:04:33.968865 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:33.968833 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfsc6\" (UniqueName: \"kubernetes.io/projected/fa1c5143-6e00-436b-9d0c-710e20a7321c-kube-api-access-vfsc6\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 15:04:33.968865 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:33.968863 2541 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1c5143-6e00-436b-9d0c-710e20a7321c-extensions-socket-volume\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 14 15:04:34.730230 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:34.730193 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" event={"ID":"fa1c5143-6e00-436b-9d0c-710e20a7321c","Type":"ContainerDied","Data":"71b3c1ce1a95432e55c9f38c65ce1b26fa42010be919de674eb2bd33ed4cef2c"} Jul 14 15:04:34.730671 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:34.730260 2541 scope.go:117] "RemoveContainer" containerID="ca574562ee26079d2aa602f8d1e9966951c3a69c4f0fd35e36e2bb7cc0a4d240" Jul 14 15:04:34.730671 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:34.730205 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck" Jul 14 15:04:34.758677 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:34.758649 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck"] Jul 14 15:04:34.767506 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:34.767482 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vdck"] Jul 14 15:04:35.851609 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:04:35.851577 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa1c5143-6e00-436b-9d0c-710e20a7321c" path="/var/lib/kubelet/pods/fa1c5143-6e00-436b-9d0c-710e20a7321c/volumes" Jul 14 15:05:31.916066 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:31.916029 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5"] Jul 14 15:05:31.916558 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:31.916407 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa1c5143-6e00-436b-9d0c-710e20a7321c" containerName="manager" Jul 14 15:05:31.916558 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:31.916419 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa1c5143-6e00-436b-9d0c-710e20a7321c" containerName="manager" Jul 14 15:05:31.916558 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:31.916479 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa1c5143-6e00-436b-9d0c-710e20a7321c" containerName="manager" Jul 14 15:05:31.919510 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:31.919491 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" Jul 14 15:05:31.923083 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:31.923063 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cmtr2\"" Jul 14 15:05:31.938883 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:31.938857 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5"] Jul 14 15:05:32.104608 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:32.104563 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63c39123-5445-4abc-9fbe-83ddaa95596b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pznf5\" (UID: \"63c39123-5445-4abc-9fbe-83ddaa95596b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" Jul 14 15:05:32.104823 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:32.104721 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkwbj\" (UniqueName: \"kubernetes.io/projected/63c39123-5445-4abc-9fbe-83ddaa95596b-kube-api-access-gkwbj\") pod \"kuadrant-operator-controller-manager-86878c769f-pznf5\" (UID: \"63c39123-5445-4abc-9fbe-83ddaa95596b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" Jul 14 15:05:32.205283 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:32.205186 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkwbj\" (UniqueName: \"kubernetes.io/projected/63c39123-5445-4abc-9fbe-83ddaa95596b-kube-api-access-gkwbj\") pod \"kuadrant-operator-controller-manager-86878c769f-pznf5\" (UID: \"63c39123-5445-4abc-9fbe-83ddaa95596b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" Jul 14 15:05:32.205283 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:32.205268 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63c39123-5445-4abc-9fbe-83ddaa95596b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pznf5\" (UID: \"63c39123-5445-4abc-9fbe-83ddaa95596b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" Jul 14 15:05:32.205712 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:32.205694 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63c39123-5445-4abc-9fbe-83ddaa95596b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pznf5\" (UID: \"63c39123-5445-4abc-9fbe-83ddaa95596b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" Jul 14 15:05:32.215386 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:32.215359 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkwbj\" (UniqueName: \"kubernetes.io/projected/63c39123-5445-4abc-9fbe-83ddaa95596b-kube-api-access-gkwbj\") pod \"kuadrant-operator-controller-manager-86878c769f-pznf5\" (UID: \"63c39123-5445-4abc-9fbe-83ddaa95596b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" Jul 14 15:05:32.230498 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:32.230466 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" Jul 14 15:05:32.383478 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:32.383454 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5"] Jul 14 15:05:32.385232 ip-10-0-142-186 kubenswrapper[2541]: W0714 15:05:32.385203 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c39123_5445_4abc_9fbe_83ddaa95596b.slice/crio-b1b2f7af049ae4c0a09ca4fc82befb44dbd32ab96c4ab6e5a24d137502314e05 WatchSource:0}: Error finding container b1b2f7af049ae4c0a09ca4fc82befb44dbd32ab96c4ab6e5a24d137502314e05: Status 404 returned error can't find the container with id b1b2f7af049ae4c0a09ca4fc82befb44dbd32ab96c4ab6e5a24d137502314e05 Jul 14 15:05:32.997583 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:32.997548 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" event={"ID":"63c39123-5445-4abc-9fbe-83ddaa95596b","Type":"ContainerStarted","Data":"2734b0397ffe1e261ec1088c97708ec8e033cb9a3e29323f3a5930027014065d"} Jul 14 15:05:32.997998 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:32.997597 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" event={"ID":"63c39123-5445-4abc-9fbe-83ddaa95596b","Type":"ContainerStarted","Data":"b1b2f7af049ae4c0a09ca4fc82befb44dbd32ab96c4ab6e5a24d137502314e05"} Jul 14 15:05:32.997998 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:32.997688 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" Jul 14 15:05:33.037669 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:33.037591 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" podStartSLOduration=2.037574087 podStartE2EDuration="2.037574087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:05:33.037334185 +0000 UTC m=+1129.592996301" watchObservedRunningTime="2026-07-14 15:05:33.037574087 +0000 UTC m=+1129.593236173" Jul 14 15:05:44.005094 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:05:44.005012 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pznf5" Jul 14 15:06:43.849390 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:06:43.849359 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 15:06:43.851767 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:06:43.851743 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 15:11:43.883100 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:43.883068 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 15:11:43.885626 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:43.885590 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxtlv_c8e69f20-adc1-4e0e-8ba1-735a3db0e3fd/ovn-acl-logging/0.log" Jul 14 15:11:45.603122 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:45.603087 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sg4sp_264ac1c0-907b-4394-82ca-75019e84eebb/manager/0.log" Jul 14 15:11:45.856866 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:45.856787 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6948f666b4-smd7n_6eee6767-cd6b-42dc-9d75-155eefd0fe46/manager/0.log" Jul 14 15:11:46.234113 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:46.234083 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8ddb9f9b5-62dfh_158bac80-bb24-4567-8095-f979f06cde2b/copy-manifests/0.log" Jul 14 15:11:46.248207 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:46.248173 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8ddb9f9b5-62dfh_158bac80-bb24-4567-8095-f979f06cde2b/manager/0.log" Jul 14 15:11:46.895822 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:46.895792 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-74bc5d7f86-9kbxg_7a21f7f5-e9c6-491e-86cd-0b7b1c5f96fe/maas-api/0.log" Jul 14 15:11:47.149532 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:47.149447 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-p48jt_1f3b538d-84f1-41c9-89e7-0d41c8cfe16d/postgres/0.log" Jul 14 15:11:48.876457 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:48.876419 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cpr57_632be6f3-f24e-489e-8955-7d09b2aea091/manager/0.log" Jul 14 15:11:49.145254 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:49.145168 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dvt7q_4680550d-918d-4ebd-9950-cd692be9d5f1/registry-server/0.log" Jul 14 15:11:49.292780 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:49.292745 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pznf5_63c39123-5445-4abc-9fbe-83ddaa95596b/manager/0.log" Jul 14 15:11:49.564890 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:49.564858 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jbdfn_2c854e7d-43ae-4543-9ac2-df5cddf38efc/manager/0.log" Jul 14 15:11:50.091502 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:50.091466 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lt9tq_c3a7c254-3e7a-44b1-bdde-4b707d158132/discovery/0.log" Jul 14 15:11:50.230215 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:50.230187 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cb8f87c7d-7fvld_4a6334cc-9689-4762-9990-02ba442a86df/kube-auth-proxy/0.log" Jul 14 15:11:50.604350 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:50.604317 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d9gsc_f547b73f-a83c-4ce2-a856-cd6cc97570cc/payload-pre-processing/0.log" Jul 14 15:11:50.737535 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:50.737501 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-j8lbb_ee39061a-8411-41de-b6da-a5f2613824eb/payload-processing/0.log" Jul 14 15:11:51.231979 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:51.231952 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gt2x8_3e8c3e64-22e5-4073-b1d2-557f3839ca0c/main/0.log" Jul 14 15:11:51.466850 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:51.466815 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rhbmg_c4595a1d-29af-41fc-aff9-ab9dc8303d32/main/0.log" Jul 14 15:11:51.707950 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:51.707914 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-brfb9_06f5988d-85c1-4526-ad96-792ef81b5ce4/main/0.log" Jul 14 15:11:59.374501 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:59.374467 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-drxfb_7544136c-f86b-4065-a311-c908c9fbb4e6/global-pull-secret-syncer/0.log" Jul 14 15:11:59.701793 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:59.701757 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cnffx_ec5e38d0-07c1-4ec3-9d2d-310c5c41192f/konnectivity-agent/0.log" Jul 14 15:11:59.770071 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:11:59.770041 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-186.ec2.internal_065a773ad515b5bc840f4897c38a83d1/haproxy/0.log" Jul 14 15:12:04.883123 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:04.883096 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cpr57_632be6f3-f24e-489e-8955-7d09b2aea091/manager/0.log" Jul 14 15:12:04.953579 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:04.953539 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dvt7q_4680550d-918d-4ebd-9950-cd692be9d5f1/registry-server/0.log" Jul 14 15:12:05.007911 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:05.007879 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pznf5_63c39123-5445-4abc-9fbe-83ddaa95596b/manager/0.log" Jul 14 15:12:05.109342 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:05.109310 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jbdfn_2c854e7d-43ae-4543-9ac2-df5cddf38efc/manager/0.log" Jul 14 15:12:07.048823 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.048794 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sxnd9_56196967-dc3f-4366-bdd1-811b510e946f/kube-state-metrics/0.log" Jul 14 15:12:07.081646 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.081603 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sxnd9_56196967-dc3f-4366-bdd1-811b510e946f/kube-rbac-proxy-main/0.log" Jul 14 15:12:07.126710 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.126680 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sxnd9_56196967-dc3f-4366-bdd1-811b510e946f/kube-rbac-proxy-self/0.log" Jul 14 15:12:07.471353 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.471325 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prh66_96141f5f-ddf0-431d-9d3a-5306269c84ba/node-exporter/0.log" Jul 14 15:12:07.501233 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.501209 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prh66_96141f5f-ddf0-431d-9d3a-5306269c84ba/kube-rbac-proxy/0.log" Jul 14 15:12:07.537545 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.537519 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prh66_96141f5f-ddf0-431d-9d3a-5306269c84ba/init-textfile/0.log" Jul 14 15:12:07.586352 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.586324 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vgx5q_cf46951e-b6b7-4ae6-a859-8febe46c3045/kube-rbac-proxy-main/0.log" Jul 14 15:12:07.618840 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.618817 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vgx5q_cf46951e-b6b7-4ae6-a859-8febe46c3045/kube-rbac-proxy-self/0.log" Jul 14 15:12:07.652667 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.652639 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vgx5q_cf46951e-b6b7-4ae6-a859-8febe46c3045/openshift-state-metrics/0.log" Jul 14 15:12:07.720261 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.720226 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_727af093-b130-47d4-a9d5-4835189f5cab/prometheus/0.log" Jul 14 15:12:07.758843 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.758763 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_727af093-b130-47d4-a9d5-4835189f5cab/config-reloader/0.log" Jul 14 15:12:07.788348 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.788321 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_727af093-b130-47d4-a9d5-4835189f5cab/thanos-sidecar/0.log" Jul 14 15:12:07.818155 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.818127 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_727af093-b130-47d4-a9d5-4835189f5cab/kube-rbac-proxy-web/0.log" Jul 14 15:12:07.855774 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.855741 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_727af093-b130-47d4-a9d5-4835189f5cab/kube-rbac-proxy/0.log" Jul 14 15:12:07.888322 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.888288 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_727af093-b130-47d4-a9d5-4835189f5cab/kube-rbac-proxy-thanos/0.log" Jul 14 15:12:07.918336 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:07.918311 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_727af093-b130-47d4-a9d5-4835189f5cab/init-config-reloader/0.log" Jul 14 15:12:08.030521 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:08.030446 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-fqxpk_552d9e2e-8c46-4fe7-8c06-08cdab38ad74/prometheus-operator-admission-webhook/0.log" Jul 14 15:12:09.636989 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.636957 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh"] Jul 14 15:12:09.640944 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.640915 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.646925 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.646899 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gxvrk\"/\"openshift-service-ca.crt\"" Jul 14 15:12:09.647185 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.646939 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gxvrk\"/\"default-dockercfg-f6d6w\"" Jul 14 15:12:09.647922 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.647640 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gxvrk\"/\"kube-root-ca.crt\"" Jul 14 15:12:09.654752 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.654731 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh"] Jul 14 15:12:09.785362 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.785311 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-sys\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.785362 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.785360 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-lib-modules\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.785585 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.785382 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-podres\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.785585 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.785533 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-proc\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.785690 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.785604 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvzcn\" (UniqueName: \"kubernetes.io/projected/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-kube-api-access-gvzcn\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.886833 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.886803 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvzcn\" (UniqueName: \"kubernetes.io/projected/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-kube-api-access-gvzcn\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.887092 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.886840 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-sys\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.887092 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.886859 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-lib-modules\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.887092 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.886930 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-podres\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.887092 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.886950 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-sys\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.887092 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.887002 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-lib-modules\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.887092 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.887078 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-podres\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.887092 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.887085 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-proc\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.887367 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.887127 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-proc\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.896786 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.896756 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvzcn\" (UniqueName: \"kubernetes.io/projected/5c8b511f-9896-4d55-b60d-b7ab2aaf1f97-kube-api-access-gvzcn\") pod \"perf-node-gather-daemonset-75zbh\" (UID: \"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97\") " pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:09.950998 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:09.950963 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:10.096189 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:10.096156 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh"] Jul 14 15:12:10.100736 ip-10-0-142-186 kubenswrapper[2541]: W0714 15:12:10.100703 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5c8b511f_9896_4d55_b60d_b7ab2aaf1f97.slice/crio-42db2e38c355d65470adb353d248351b447fa1f5757f77230a557d876ae9d07d WatchSource:0}: Error finding container 42db2e38c355d65470adb353d248351b447fa1f5757f77230a557d876ae9d07d: Status 404 returned error can't find the container with id 42db2e38c355d65470adb353d248351b447fa1f5757f77230a557d876ae9d07d Jul 14 15:12:10.934536 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:10.934491 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" event={"ID":"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97","Type":"ContainerStarted","Data":"02cfa09a2f5a7735552a64be38bde7b2d44b28f2193afc48ad11d76ab51b26cf"} Jul 14 15:12:10.934536 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:10.934543 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" event={"ID":"5c8b511f-9896-4d55-b60d-b7ab2aaf1f97","Type":"ContainerStarted","Data":"42db2e38c355d65470adb353d248351b447fa1f5757f77230a557d876ae9d07d"} Jul 14 15:12:10.935093 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:10.934643 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:10.955942 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:10.955888 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" podStartSLOduration=1.955873322 podStartE2EDuration="1.955873322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:10.95419641 +0000 UTC m=+1527.509858502" watchObservedRunningTime="2026-07-14 15:12:10.955873322 +0000 UTC m=+1527.511535411" Jul 14 15:12:12.671144 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:12.671110 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4n8nt_cc8335aa-48ec-4491-8e70-50eead5d7ca2/dns/0.log" Jul 14 15:12:12.700542 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:12.700512 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4n8nt_cc8335aa-48ec-4491-8e70-50eead5d7ca2/kube-rbac-proxy/0.log" Jul 14 15:12:12.884296 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:12.884267 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2xlbv_41936526-5a0b-4f4a-b73b-114da1d56ac7/dns-node-resolver/0.log" Jul 14 15:12:13.533950 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:13.533921 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-77cfc8956d-7286b_c444d387-3a11-48bc-bb40-55be3e03263f/registry/0.log" Jul 14 15:12:13.643278 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:13.643249 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wzkz8_ec7482f3-a534-4bf4-808b-7605a929d1aa/node-ca/0.log" Jul 14 15:12:14.728439 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:14.728402 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lt9tq_c3a7c254-3e7a-44b1-bdde-4b707d158132/discovery/0.log" Jul 14 15:12:14.752643 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:14.752603 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cb8f87c7d-7fvld_4a6334cc-9689-4762-9990-02ba442a86df/kube-auth-proxy/0.log" Jul 14 15:12:14.900544 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:14.900512 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d9gsc_f547b73f-a83c-4ce2-a856-cd6cc97570cc/payload-pre-processing/0.log" Jul 14 15:12:14.932595 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:14.932557 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-j8lbb_ee39061a-8411-41de-b6da-a5f2613824eb/payload-processing/0.log" Jul 14 15:12:15.702381 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:15.702348 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zv5xw_13b858cb-904e-4ed2-9b43-2799f9db7967/serve-healthcheck-canary/0.log" Jul 14 15:12:16.322335 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:16.322310 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-796g9_1a48b73e-8f68-47b9-b81e-033c58587857/kube-rbac-proxy/0.log" Jul 14 15:12:16.352242 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:16.352218 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-796g9_1a48b73e-8f68-47b9-b81e-033c58587857/exporter/0.log" Jul 14 15:12:16.384132 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:16.384102 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-796g9_1a48b73e-8f68-47b9-b81e-033c58587857/extractor/0.log" Jul 14 15:12:16.950822 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:16.950792 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gxvrk/perf-node-gather-daemonset-75zbh" Jul 14 15:12:19.377462 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:19.377432 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sg4sp_264ac1c0-907b-4394-82ca-75019e84eebb/manager/0.log" Jul 14 15:12:19.580339 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:19.580305 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6948f666b4-smd7n_6eee6767-cd6b-42dc-9d75-155eefd0fe46/manager/0.log" Jul 14 15:12:19.750747 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:19.750712 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8ddb9f9b5-62dfh_158bac80-bb24-4567-8095-f979f06cde2b/manager/0.log" Jul 14 15:12:19.772576 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:19.772546 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8ddb9f9b5-62dfh_158bac80-bb24-4567-8095-f979f06cde2b/copy-manifests/0.log" Jul 14 15:12:20.245180 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:20.245148 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lt9tq_c3a7c254-3e7a-44b1-bdde-4b707d158132/discovery/0.log" Jul 14 15:12:20.255956 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:20.255928 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cb8f87c7d-7fvld_4a6334cc-9689-4762-9990-02ba442a86df/kube-auth-proxy/0.log" Jul 14 15:12:20.359867 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:20.359833 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d9gsc_f547b73f-a83c-4ce2-a856-cd6cc97570cc/payload-pre-processing/0.log" Jul 14 15:12:20.375786 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:20.375761 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-j8lbb_ee39061a-8411-41de-b6da-a5f2613824eb/payload-processing/0.log" Jul 14 15:12:21.646449 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:21.646417 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lt9tq_c3a7c254-3e7a-44b1-bdde-4b707d158132/discovery/0.log" Jul 14 15:12:21.660583 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:21.660505 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cb8f87c7d-7fvld_4a6334cc-9689-4762-9990-02ba442a86df/kube-auth-proxy/0.log" Jul 14 15:12:21.768687 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:21.768649 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d9gsc_f547b73f-a83c-4ce2-a856-cd6cc97570cc/payload-pre-processing/0.log" Jul 14 15:12:21.789307 ip-10-0-142-186 kubenswrapper[2541]: I0714 15:12:21.789281 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-j8lbb_ee39061a-8411-41de-b6da-a5f2613824eb/payload-processing/0.log"