Jul 06 19:21:16.258862 ip-10-0-138-110 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 19:21:16.258873 ip-10-0-138-110 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 19:21:16.258880 ip-10-0-138-110 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 19:21:16.259138 ip-10-0-138-110 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 19:21:26.508278 ip-10-0-138-110 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 19:21:26.508298 ip-10-0-138-110 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b6afdbcd0c3945dda3e8068eaada120f -- Jul 06 19:23:28.502948 ip-10-0-138-110 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.948017 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956486 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956504 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956509 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956513 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956517 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956520 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956523 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:28.981935 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956526 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956530 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956532 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956535 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956538 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956542 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956545 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956548 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956551 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956553 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956556 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956559 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956562 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956564 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956567 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956570 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956573 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956575 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956578 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956584 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:28.985961 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956588 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956591 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956594 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956596 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956599 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956603 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956606 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956610 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956613 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956618 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956623 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956626 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956629 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956632 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956634 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956637 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956640 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956644 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956646 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:28.986556 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956649 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956652 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956655 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956658 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956661 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956663 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956666 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956688 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956691 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956694 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956697 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956701 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956704 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956707 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956709 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956712 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956715 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956718 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956721 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956724 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:28.987172 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956727 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956730 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956732 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956736 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956739 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956741 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956744 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956747 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956750 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956753 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956756 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956758 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956763 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956767 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956770 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956773 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956777 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956780 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956786 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956790 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:28.987849 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956793 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956801 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956804 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956807 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956810 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956813 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956816 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956820 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956824 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956828 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956831 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956834 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.956836 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957598 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957604 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957609 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957612 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957615 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957618 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957621 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:28.988403 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957624 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957628 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957631 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957633 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957636 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957639 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957643 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957646 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957649 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957651 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957655 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957658 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957661 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957663 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957666 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957669 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957671 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957674 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957677 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957680 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:28.989039 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957683 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957685 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957688 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957691 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957694 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957696 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957700 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957703 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957705 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957729 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957732 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957735 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957739 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957745 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957747 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957750 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957754 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957756 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957759 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957762 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:28.989632 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957765 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957768 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957771 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957775 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957778 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957780 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957784 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957786 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957789 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957792 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957795 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957801 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957805 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957808 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957812 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957815 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957818 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957821 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957824 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:28.990276 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957826 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957829 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957834 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957838 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957841 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957844 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957849 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957852 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957855 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957858 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957862 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957866 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957869 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957872 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957875 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957878 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957880 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957884 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957888 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:28.990871 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957891 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957894 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957897 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957900 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957902 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957906 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957909 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957912 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957914 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957917 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957920 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957923 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957926 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.957929 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958348 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958353 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958356 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958359 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958364 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:28.991446 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958370 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958374 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958377 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958381 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958384 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958388 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958391 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958394 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958399 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958402 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958406 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958410 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958414 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958418 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958421 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958424 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958430 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958434 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958437 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958440 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:29.154662 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958443 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:29.036241 ip-10-0-138-110 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958446 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958449 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958452 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958455 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958457 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958460 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958463 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958466 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958469 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958471 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958475 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958481 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958484 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958487 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958489 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958492 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958495 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958498 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958501 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:29.169148 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958503 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958506 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958509 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958512 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958516 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958519 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958522 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958524 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958527 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958530 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958533 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958535 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958538 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958541 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958544 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958546 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958557 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958562 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958565 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958568 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:29.170094 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958571 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958574 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958577 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958582 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958586 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958589 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958592 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958595 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958597 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958600 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958603 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958606 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958608 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958611 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958614 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958617 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958620 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958623 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958626 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958629 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:29.170858 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958632 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958635 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958637 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958640 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958643 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958646 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958648 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958651 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958654 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958657 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958659 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958662 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958665 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.958667 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958757 2584 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958769 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958779 2584 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958784 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958788 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958791 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958796 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:23:29.175194 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958800 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958804 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958807 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958811 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958815 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958818 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958822 2584 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958825 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958828 2584 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958832 2584 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958835 2584 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958840 2584 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958843 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958846 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958850 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958854 2584 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958858 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958861 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958864 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958868 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958871 2584 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958874 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958878 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958881 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:23:29.175953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958884 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958888 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958893 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958898 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958901 2584 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958904 2584 flags.go:64] FLAG: --enable-server="true" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958907 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958913 2584 flags.go:64] FLAG: --event-burst="100" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958916 2584 flags.go:64] FLAG: --event-qps="50" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958919 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958922 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958926 2584 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958930 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958933 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958936 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958939 2584 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958942 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958945 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958949 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958952 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958955 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958958 2584 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958961 2584 flags.go:64] FLAG: --feature-gates="" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958965 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958969 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:23:29.176692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958972 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958975 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958978 2584 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958982 2584 flags.go:64] FLAG: --help="false" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958985 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958988 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958991 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958994 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.958998 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959003 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959007 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959011 2584 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959014 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959017 2584 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959020 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959023 2584 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959026 2584 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959029 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959032 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959036 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959039 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959042 2584 flags.go:64] FLAG: --lock-file="" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959045 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959048 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:23:29.177600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959052 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959057 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959061 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959064 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959067 2584 flags.go:64] FLAG: --logging-format="text" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959070 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959074 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959077 2584 flags.go:64] FLAG: --manifest-url="" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959080 2584 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959085 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959088 2584 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959092 2584 flags.go:64] FLAG: --max-pods="110" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959095 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959098 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959101 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959104 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959108 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959112 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959118 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959125 2584 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959129 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959132 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959136 2584 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:23:29.178449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959139 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959144 2584 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959148 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959151 2584 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959154 2584 flags.go:64] FLAG: --port="10250" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959157 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959161 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0017c058392156459" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959164 2584 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959167 2584 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959171 2584 flags.go:64] FLAG: --register-node="true" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959174 2584 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959177 2584 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959181 2584 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959184 2584 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959187 2584 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959191 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959194 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959198 2584 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959201 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959204 2584 flags.go:64] FLAG: --runonce="false" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959207 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959210 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959214 2584 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959217 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959220 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959224 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:23:29.179259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959227 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959233 2584 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959236 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959239 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959242 2584 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959245 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959248 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959252 2584 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959255 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959260 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959263 2584 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959266 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959270 2584 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959273 2584 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959277 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959280 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959283 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959286 2584 flags.go:64] FLAG: --v="2" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959290 2584 flags.go:64] FLAG: --version="false" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959295 2584 flags.go:64] FLAG: --vmodule="" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959299 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.959302 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959447 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959451 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:29.180457 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959454 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959458 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959463 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959466 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959469 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959473 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959476 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959479 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959482 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959488 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959491 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959494 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959497 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959500 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959502 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959506 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959508 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959511 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959514 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:29.181295 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959516 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959519 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959522 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959525 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959528 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959531 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959534 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959536 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959540 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959548 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959551 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959554 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959557 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959559 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959562 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959565 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959568 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959571 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959573 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959576 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:29.385963 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959579 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959582 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959587 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959590 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959593 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959595 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959598 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959601 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959604 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959607 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959609 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959612 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959615 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959618 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959621 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959624 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959628 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959632 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959635 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959638 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:29.386678 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959641 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959644 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959656 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959659 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959661 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959664 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959667 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959670 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959673 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959676 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959680 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959683 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959686 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959689 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959694 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959697 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959700 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959703 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959719 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959723 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:29.387292 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959726 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959729 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959731 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959734 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959737 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959740 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959743 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959746 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959748 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959751 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959755 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959758 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959761 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959764 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959766 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959770 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959773 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:29.387941 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.959776 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.960669 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.968291 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.968318 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.969312 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.969319 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969386 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969394 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969398 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969402 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969406 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969409 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969411 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969414 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:29.388441 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969418 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969420 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969423 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969426 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969429 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969432 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969435 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969437 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969440 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969445 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969448 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969452 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969455 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969459 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969462 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969464 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969467 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969470 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969474 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:29.388937 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969477 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969480 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969491 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969494 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969496 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969499 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969502 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969505 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969508 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969511 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969517 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969520 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969523 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969526 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969529 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969532 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969535 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969538 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969540 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969543 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969546 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:29.389489 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969549 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969552 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969555 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969557 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969560 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969563 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969566 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969570 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969573 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969576 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969579 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969582 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969585 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969588 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969597 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969600 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969603 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969606 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969609 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:29.390155 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969611 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969614 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969619 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969622 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969625 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969628 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969631 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969633 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969636 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969639 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969642 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969644 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969647 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969650 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969653 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969656 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969658 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969661 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969664 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969667 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:29.390689 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969670 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969672 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969675 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969678 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969681 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969686 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969689 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969692 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969703 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969731 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969734 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969737 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.969743 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969897 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969902 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:29.391322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969907 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969910 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969913 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969916 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969919 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969922 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969925 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969928 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969931 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969934 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969937 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969940 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969942 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969945 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969948 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969951 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969953 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969956 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969959 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969962 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:29.391784 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969965 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969967 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969972 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969975 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969977 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969980 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969989 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969992 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969994 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.969997 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970000 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970002 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970007 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970010 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970012 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970015 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970018 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970021 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970024 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970026 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:29.392416 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970029 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970032 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970035 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970037 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970040 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970043 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970045 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970048 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970051 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970053 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970056 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970059 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970062 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970065 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970069 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970072 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970074 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970077 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970079 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:29.393012 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970090 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970094 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970097 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970101 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970104 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970108 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970111 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970114 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970117 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970120 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970123 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970126 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970128 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970131 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970134 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970136 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970139 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970142 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970146 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:29.393623 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970150 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970153 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970156 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970159 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970162 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970165 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970167 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970170 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970178 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970180 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970183 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970187 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970191 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970194 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970204 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970207 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970210 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970213 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:29.394216 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:28.970218 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.970224 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.970375 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.972774 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.974552 2584 server.go:1019] "Starting client certificate rotation" Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.974673 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.974708 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.979666 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.986740 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:28.998226 2584 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.000912 2584 log.go:25] "Validated CRI v1 image API" Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.001563 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:23:29.394805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.004192 2584 fs.go:135] Filesystem UUIDs: map[58cadca7-3556-49e7-aa0a-db05d30cb15d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 833728e5-64b9-4792-b45e-9c4877ea2c50:/dev/nvme0n1p3] Jul 06 19:23:29.395203 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.004217 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:23:29.395332 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.010625 2584 manager.go:216] Machine: {Timestamp:2026-07-06 19:23:29.009242413 +0000 UTC m=+0.382771097 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098119 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29a17eba544da8e2744976ab35351b SystemUUID:ec29a17e-ba54-4da8-e274-4976ab35351b BootID:b6afdbcd-0c39-45dd-a3e8-068eaada120f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:86:b7:9f:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:86:b7:9f:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:45:3e:cb:09:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:23:29.395332 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.010762 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:23:29.395332 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.010850 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:23:29.395332 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.012446 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:23:29.395332 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.014694 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:23:29.395332 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.014742 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:23:29.395332 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.015601 2584 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.015620 2584 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.015631 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.017610 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.019795 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.023730 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.023872 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.023904 2584 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.023918 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.023942 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.023957 2584 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.023968 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.024427 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.024452 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.027580 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.029905 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.029935 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031308 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031330 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031337 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031343 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031354 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031360 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031369 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031374 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031382 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031389 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031398 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.031404 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.032168 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.032175 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.035565 2584 server.go:1268] "Started kubelet" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.038531 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.038531 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.038781 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.038695 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.039095 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.039336 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.040419 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.041973 2584 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:23:29.395746 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.043239 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h9h9k" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.045659 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.045375 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-110.ec2.internal.18bfc9c13021759a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-110.ec2.internal,UID:ip-10-0-138-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-110.ec2.internal,},FirstTimestamp:2026-07-06 19:23:29.035376026 +0000 UTC m=+0.408904710,LastTimestamp:2026-07-06 19:23:29.035376026 +0000 UTC m=+0.408904710,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-110.ec2.internal,}" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.047553 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.047565 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.048177 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.048278 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.048286 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.048307 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.048452 2584 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.048462 2584 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.048643 2584 factory.go:55] Registering systemd factory Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.048659 2584 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.048913 2584 factory.go:153] Registering CRI-O factory Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.048927 2584 factory.go:223] Registration of the crio container factory successfully Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.048982 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.049008 2584 factory.go:103] Registering Raw factory Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.049024 2584 manager.go:1196] Started watching for new ooms in manager Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.049469 2584 manager.go:349] Starting recovery of all containers Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.051665 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.051822 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.059538 2584 manager.go:354] Recovery completed Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.063459 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h9h9k" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.064207 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.066036 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.066062 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.066072 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.066606 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.066618 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.066607 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.066808 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.067505 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:29.397540 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.067572 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.067587 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.068059 2584 policy_none.go:49] "None policy: Start" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.068075 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.068089 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.069153 2584 policy_none.go:47] "Start" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.071745 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-110.ec2.internal.18bfc9c131f57619 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-110.ec2.internal,UID:ip-10-0-138-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-110.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-110.ec2.internal,},FirstTimestamp:2026-07-06 19:23:29.066047001 +0000 UTC m=+0.439575684,LastTimestamp:2026-07-06 19:23:29.066047001 +0000 UTC m=+0.439575684,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-110.ec2.internal,}" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.113338 2584 manager.go:337] "Starting Device Plugin manager" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.113372 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.113382 2584 server.go:87] "Starting device plugin registration server" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.113616 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.113627 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.113761 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.113857 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.113868 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.114430 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.114491 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.213834 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.214902 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.214959 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.214971 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.214999 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.223870 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.223903 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-110.ec2.internal\": node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.247464 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.248830 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.248867 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.248899 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.248939 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.252124 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.258373 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.350441 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal"] Jul 06 19:23:29.401536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.350531 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.353364 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.353395 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.353410 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.354977 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.355094 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.355130 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.355769 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.355797 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.355812 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.355823 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.355844 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.355855 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.357053 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.357076 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.358435 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.358716 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.358748 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.358764 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:29.402984 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.392525 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-110.ec2.internal\" not found" node="ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.409870 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-110.ec2.internal\" not found" node="ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.450727 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a82202aae61ad36a164e7de6fe394cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-110.ec2.internal\" (UID: \"7a82202aae61ad36a164e7de6fe394cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.450756 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.450774 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.459127 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.551450 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.551485 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.551512 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a82202aae61ad36a164e7de6fe394cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-110.ec2.internal\" (UID: \"7a82202aae61ad36a164e7de6fe394cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.551591 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a82202aae61ad36a164e7de6fe394cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-110.ec2.internal\" (UID: \"7a82202aae61ad36a164e7de6fe394cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.551618 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.551592 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.614994 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.560066 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:29.855069 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.661492 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:29.855069 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.699735 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.855069 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.714098 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" Jul 06 19:23:29.855069 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.762068 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:30.078501 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.862338 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:30.078501 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:29.962694 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:30.078501 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.973632 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:23:30.078501 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:29.973867 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:23:30.078501 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:30.011845 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:23:30.078501 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:30.063097 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:30.078501 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:30.065348 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:18:29 +0000 UTC" deadline="2027-12-08 21:05:07.637513754 +0000 UTC" Jul 06 19:23:30.078501 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:30.065379 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12481h41m37.572138106s" Jul 06 19:23:30.290456 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:30.163967 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:30.290456 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:30.264585 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:30.513322 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:30.365648 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found" Jul 06 19:23:30.513322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:30.430374 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a82202aae61ad36a164e7de6fe394cc.slice/crio-d41052bd7b9aab1a43774f42249134aac47c1819559af1cf45e965a6b0a8d5b9 WatchSource:0}: Error finding container d41052bd7b9aab1a43774f42249134aac47c1819559af1cf45e965a6b0a8d5b9: Status 404 returned error can't find the container with id d41052bd7b9aab1a43774f42249134aac47c1819559af1cf45e965a6b0a8d5b9 Jul 06 19:23:30.513322 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:30.430658 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc13721c40e9855f83088b2fec76aeb.slice/crio-14a0278a7d21e6d8c309cc140b232e769f2ad8fa68014f4c952024419a561428 WatchSource:0}: Error finding container 14a0278a7d21e6d8c309cc140b232e769f2ad8fa68014f4c952024419a561428: Status 404 returned error can't find the container with id 14a0278a7d21e6d8c309cc140b232e769f2ad8fa68014f4c952024419a561428 Jul 06 19:23:30.513322 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:30.435234 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:23:30.513322 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:30.445023 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:23:30.513322 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:30.448269 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" Jul 06 19:23:30.513322 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:30.463953 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:23:30.513322 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:30.465622 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" Jul 06 19:23:30.513322 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:30.466045 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:23:30.513322 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:30.478878 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:23:31.090200 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.025105 2584 apiserver.go:52] "Watching apiserver" Jul 06 19:23:31.090200 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.053182 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:23:31.090200 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.090117 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:23:31.091796 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.091285 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal","openshift-multus/multus-shn74","openshift-multus/network-metrics-daemon-xn49t","openshift-network-diagnostics/network-check-target-jnw4q","openshift-ovn-kubernetes/ovnkube-node-td969","kube-system/global-pull-secret-syncer-nr7zv","kube-system/konnectivity-agent-jr677","kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc","openshift-dns/node-resolver-4s9gs","openshift-image-registry/node-ca-lnlbz","openshift-multus/multus-additional-cni-plugins-4t6jr","openshift-network-operator/iptables-alerter-lcnwq","openshift-cluster-node-tuning-operator/tuned-8kfhq"] Jul 06 19:23:31.154725 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.094997 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:31.241799 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.214450 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93636edc-249a-4292-9002-099de6718579-agent-certs\") pod \"konnectivity-agent-jr677\" (UID: \"93636edc-249a-4292-9002-099de6718579\") " pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:31.241799 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.214506 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93636edc-249a-4292-9002-099de6718579-konnectivity-ca\") pod \"konnectivity-agent-jr677\" (UID: \"93636edc-249a-4292-9002-099de6718579\") " pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:31.241799 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.214583 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3da7875-07c9-4266-bbb0-8407ed265d1c-iptables-alerter-script\") pod \"iptables-alerter-lcnwq\" (UID: \"c3da7875-07c9-4266-bbb0-8407ed265d1c\") " pod="openshift-network-operator/iptables-alerter-lcnwq" Jul 06 19:23:31.241799 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.215487 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3da7875-07c9-4266-bbb0-8407ed265d1c-host-slash\") pod \"iptables-alerter-lcnwq\" (UID: \"c3da7875-07c9-4266-bbb0-8407ed265d1c\") " pod="openshift-network-operator/iptables-alerter-lcnwq" Jul 06 19:23:31.241799 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.216006 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:23:31.241799 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.216353 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tqk6j\"" Jul 06 19:23:31.241799 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.216355 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:23:31.241799 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.216440 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksmdz\" (UniqueName: \"kubernetes.io/projected/c3da7875-07c9-4266-bbb0-8407ed265d1c-kube-api-access-ksmdz\") pod \"iptables-alerter-lcnwq\" (UID: \"c3da7875-07c9-4266-bbb0-8407ed265d1c\") " pod="openshift-network-operator/iptables-alerter-lcnwq" Jul 06 19:23:31.241799 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.217664 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lcnwq" Jul 06 19:23:31.241799 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.220073 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:23:31.241799 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.220258 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nblcq" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.276067 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.276165 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.276536 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.276610 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.276981 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vvt5g\"" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.277086 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.278684 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.278798 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.280413 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.282687 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.282758 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.285370 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.287307 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.289498 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-shn74" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.290881 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4s9gs" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.292918 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lnlbz" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.294659 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.294565 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" event={"ID":"bdc13721c40e9855f83088b2fec76aeb","Type":"ContainerStarted","Data":"14a0278a7d21e6d8c309cc140b232e769f2ad8fa68014f4c952024419a561428"} Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.297991 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.298044 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.298258 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.298307 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.298330 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.298536 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:23:31.315026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.298573 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.298592 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.315241 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.315401 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.298858 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.315453 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dt4d5\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.314422 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" event={"ID":"7a82202aae61ad36a164e7de6fe394cc","Type":"ContainerStarted","Data":"d41052bd7b9aab1a43774f42249134aac47c1819559af1cf45e965a6b0a8d5b9"} Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.315637 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.314727 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.314789 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bxd6q\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.314845 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rkmwl\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.314368 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.315830 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sb57p\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.315181 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.314234 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qf4c4\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.315958 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xnxf9\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.315595 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.314609 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:23:31.316411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.316193 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:23:31.317521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.316562 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:23:31.317521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.316808 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93636edc-249a-4292-9002-099de6718579-konnectivity-ca\") pod \"konnectivity-agent-jr677\" (UID: \"93636edc-249a-4292-9002-099de6718579\") " pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:31.317521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.316842 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3da7875-07c9-4266-bbb0-8407ed265d1c-iptables-alerter-script\") pod \"iptables-alerter-lcnwq\" (UID: \"c3da7875-07c9-4266-bbb0-8407ed265d1c\") " pod="openshift-network-operator/iptables-alerter-lcnwq" Jul 06 19:23:31.317521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.316868 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:23:31.317521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.316883 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3da7875-07c9-4266-bbb0-8407ed265d1c-host-slash\") pod \"iptables-alerter-lcnwq\" (UID: \"c3da7875-07c9-4266-bbb0-8407ed265d1c\") " pod="openshift-network-operator/iptables-alerter-lcnwq" Jul 06 19:23:31.317521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.316934 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:31.317521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.316962 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j52m7\" (UniqueName: \"kubernetes.io/projected/3c02955a-69f5-44b2-8f38-566209f69065-kube-api-access-j52m7\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:31.317521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.316995 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93636edc-249a-4292-9002-099de6718579-agent-certs\") pod \"konnectivity-agent-jr677\" (UID: \"93636edc-249a-4292-9002-099de6718579\") " pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:31.317521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.317021 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksmdz\" (UniqueName: \"kubernetes.io/projected/c3da7875-07c9-4266-bbb0-8407ed265d1c-kube-api-access-ksmdz\") pod \"iptables-alerter-lcnwq\" (UID: \"c3da7875-07c9-4266-bbb0-8407ed265d1c\") " pod="openshift-network-operator/iptables-alerter-lcnwq" Jul 06 19:23:31.317521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.317099 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:23:31.317521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.317332 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5vf7b\"" Jul 06 19:23:31.318257 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.318069 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:23:31.318257 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.318161 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93636edc-249a-4292-9002-099de6718579-konnectivity-ca\") pod \"konnectivity-agent-jr677\" (UID: \"93636edc-249a-4292-9002-099de6718579\") " pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:31.318613 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.318303 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3da7875-07c9-4266-bbb0-8407ed265d1c-iptables-alerter-script\") pod \"iptables-alerter-lcnwq\" (UID: \"c3da7875-07c9-4266-bbb0-8407ed265d1c\") " pod="openshift-network-operator/iptables-alerter-lcnwq" Jul 06 19:23:31.318845 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.318630 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:23:31.319340 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.319078 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3da7875-07c9-4266-bbb0-8407ed265d1c-host-slash\") pod \"iptables-alerter-lcnwq\" (UID: \"c3da7875-07c9-4266-bbb0-8407ed265d1c\") " pod="openshift-network-operator/iptables-alerter-lcnwq" Jul 06 19:23:31.326104 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.326053 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93636edc-249a-4292-9002-099de6718579-agent-certs\") pod \"konnectivity-agent-jr677\" (UID: \"93636edc-249a-4292-9002-099de6718579\") " pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:31.340804 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.340740 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksmdz\" (UniqueName: \"kubernetes.io/projected/c3da7875-07c9-4266-bbb0-8407ed265d1c-kube-api-access-ksmdz\") pod \"iptables-alerter-lcnwq\" (UID: \"c3da7875-07c9-4266-bbb0-8407ed265d1c\") " pod="openshift-network-operator/iptables-alerter-lcnwq" Jul 06 19:23:31.349355 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.349274 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:23:31.388427 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.388372 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:23:31.417301 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417265 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/917c318d-6192-4c07-8749-b33d3098f63e-tmp-dir\") pod \"node-resolver-4s9gs\" (UID: \"917c318d-6192-4c07-8749-b33d3098f63e\") " pod="openshift-dns/node-resolver-4s9gs" Jul 06 19:23:31.417301 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417310 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-node-log\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.417532 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417342 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5ebb206-8374-4d8b-8986-ec09fb32252c-env-overrides\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.417532 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417366 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-device-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.417532 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417389 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-run-systemd\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.417532 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417412 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-run-ovn-kubernetes\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.417532 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417440 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-sysctl-d\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.417532 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417464 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-run\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.417532 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417495 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-run-netns\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.417932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417605 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-cnibin\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.417932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417664 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-etc-selinux\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.417932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417693 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-cnibin\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.417932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417722 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srqn\" (UniqueName: \"kubernetes.io/projected/97f2dc48-156f-46b1-b253-2c5b27f2624f-kube-api-access-9srqn\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.417932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417749 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-cni-netd\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.417932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417777 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-var-lib-kubelet\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.417932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417807 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7t7b\" (UniqueName: \"kubernetes.io/projected/ab267f63-ad76-4852-a760-0d69bba953b4-kube-api-access-v7t7b\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.417932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417835 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89lff\" (UniqueName: \"kubernetes.io/projected/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-kube-api-access-89lff\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.417932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417863 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5ebb206-8374-4d8b-8986-ec09fb32252c-ovnkube-script-lib\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.417932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417889 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-sys\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.417932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417928 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9a93664-b666-4d6e-8f0f-cc972bcd6442-serviceca\") pod \"node-ca-lnlbz\" (UID: \"f9a93664-b666-4d6e-8f0f-cc972bcd6442\") " pod="openshift-image-registry/node-ca-lnlbz" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.417970 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5ebb206-8374-4d8b-8986-ec09fb32252c-ovnkube-config\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418058 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whdwq\" (UniqueName: \"kubernetes.io/projected/b5ebb206-8374-4d8b-8986-ec09fb32252c-kube-api-access-whdwq\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418095 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-lib-modules\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418141 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418167 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-socket-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418220 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-var-lib-cni-bin\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418246 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-systemd-units\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418278 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-log-socket\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418295 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-kubernetes\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418312 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/917c318d-6192-4c07-8749-b33d3098f63e-hosts-file\") pod \"node-resolver-4s9gs\" (UID: \"917c318d-6192-4c07-8749-b33d3098f63e\") " pod="openshift-dns/node-resolver-4s9gs" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418334 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-system-cni-dir\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418351 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab267f63-ad76-4852-a760-0d69bba953b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418373 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-run-netns\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.418454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418392 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-modprobe-d\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418417 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-sysctl-conf\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418434 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-var-lib-cni-multus\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418450 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-etc-kubernetes\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418481 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9a93664-b666-4d6e-8f0f-cc972bcd6442-host\") pod \"node-ca-lnlbz\" (UID: \"f9a93664-b666-4d6e-8f0f-cc972bcd6442\") " pod="openshift-image-registry/node-ca-lnlbz" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418514 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-slash\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418553 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7637e55c-ea03-45d3-aeb8-db957eefe955-dbus\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418578 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-cni-dir\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418605 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97f2dc48-156f-46b1-b253-2c5b27f2624f-cni-binary-copy\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418631 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418674 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418724 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxrzb\" (UniqueName: \"kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb\") pod \"network-check-target-jnw4q\" (UID: \"6ab1c135-542e-4d9e-8b9c-39f012dedade\") " pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418749 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-var-lib-openvswitch\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418807 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-sys-fs\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.419188 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418838 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-conf-dir\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418873 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-daemon-config\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.418886 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418913 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-run-ovn\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.418941 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419005 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-systemd\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419040 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k5f5\" (UniqueName: \"kubernetes.io/projected/917c318d-6192-4c07-8749-b33d3098f63e-kube-api-access-5k5f5\") pod \"node-resolver-4s9gs\" (UID: \"917c318d-6192-4c07-8749-b33d3098f63e\") " pod="openshift-dns/node-resolver-4s9gs" Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.419064 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs podName:3c02955a-69f5-44b2-8f38-566209f69065 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:31.91903602 +0000 UTC m=+3.292564695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs") pod "network-metrics-daemon-xn49t" (UID: "3c02955a-69f5-44b2-8f38-566209f69065") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419116 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j52m7\" (UniqueName: \"kubernetes.io/projected/3c02955a-69f5-44b2-8f38-566209f69065-kube-api-access-j52m7\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419160 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab267f63-ad76-4852-a760-0d69bba953b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419216 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-kubelet\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419249 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5ebb206-8374-4d8b-8986-ec09fb32252c-ovn-node-metrics-cert\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419278 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-tmp\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.419912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419305 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419343 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-registration-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419374 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-os-release\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419409 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-run-k8s-cni-cncf-io\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419442 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-run-multus-certs\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419468 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj2lk\" (UniqueName: \"kubernetes.io/projected/f9a93664-b666-4d6e-8f0f-cc972bcd6442-kube-api-access-vj2lk\") pod \"node-ca-lnlbz\" (UID: \"f9a93664-b666-4d6e-8f0f-cc972bcd6442\") " pod="openshift-image-registry/node-ca-lnlbz" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419505 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x72tz\" (UniqueName: \"kubernetes.io/projected/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-kube-api-access-x72tz\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419539 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab267f63-ad76-4852-a760-0d69bba953b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419556 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-system-cni-dir\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419595 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-etc-openvswitch\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419625 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-run-openvswitch\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419674 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7637e55c-ea03-45d3-aeb8-db957eefe955-kubelet-config\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419700 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-sysconfig\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419734 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-tuned\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.420571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419759 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-socket-dir-parent\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.421243 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419790 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-var-lib-kubelet\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.421243 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419819 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-hostroot\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.421243 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419843 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-cni-bin\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.421243 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419859 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-os-release\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.421243 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.419896 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-host\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.438051 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.437941 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j52m7\" (UniqueName: \"kubernetes.io/projected/3c02955a-69f5-44b2-8f38-566209f69065-kube-api-access-j52m7\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:31.520978 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.520895 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.521152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521049 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.521152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521061 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-socket-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.521152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521098 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-var-lib-cni-bin\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.521152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521124 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-systemd-units\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.521152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521149 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-log-socket\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521173 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-var-lib-cni-bin\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521173 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-kubernetes\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521226 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-socket-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521233 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-kubernetes\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521246 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/917c318d-6192-4c07-8749-b33d3098f63e-hosts-file\") pod \"node-resolver-4s9gs\" (UID: \"917c318d-6192-4c07-8749-b33d3098f63e\") " pod="openshift-dns/node-resolver-4s9gs" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521267 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-system-cni-dir\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521269 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-log-socket\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521269 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-systemd-units\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521286 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab267f63-ad76-4852-a760-0d69bba953b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521348 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-run-netns\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521362 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/917c318d-6192-4c07-8749-b33d3098f63e-hosts-file\") pod \"node-resolver-4s9gs\" (UID: \"917c318d-6192-4c07-8749-b33d3098f63e\") " pod="openshift-dns/node-resolver-4s9gs" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521370 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-system-cni-dir\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521383 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-modprobe-d\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.521449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521421 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-run-netns\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521496 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-sysctl-conf\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521517 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-modprobe-d\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521541 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-var-lib-cni-multus\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521565 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-etc-kubernetes\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521589 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9a93664-b666-4d6e-8f0f-cc972bcd6442-host\") pod \"node-ca-lnlbz\" (UID: \"f9a93664-b666-4d6e-8f0f-cc972bcd6442\") " pod="openshift-image-registry/node-ca-lnlbz" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521608 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-var-lib-cni-multus\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521614 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-slash\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521663 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7637e55c-ea03-45d3-aeb8-db957eefe955-dbus\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521653 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-etc-kubernetes\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521666 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-sysctl-conf\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521696 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9a93664-b666-4d6e-8f0f-cc972bcd6442-host\") pod \"node-ca-lnlbz\" (UID: \"f9a93664-b666-4d6e-8f0f-cc972bcd6442\") " pod="openshift-image-registry/node-ca-lnlbz" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521691 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-cni-dir\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521719 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-slash\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521743 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97f2dc48-156f-46b1-b253-2c5b27f2624f-cni-binary-copy\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.522122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521769 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521811 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrzb\" (UniqueName: \"kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb\") pod \"network-check-target-jnw4q\" (UID: \"6ab1c135-542e-4d9e-8b9c-39f012dedade\") " pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521851 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-var-lib-openvswitch\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521877 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-sys-fs\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521879 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7637e55c-ea03-45d3-aeb8-db957eefe955-dbus\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521924 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-var-lib-openvswitch\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521943 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-sys-fs\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521880 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-cni-dir\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521959 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-conf-dir\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.521998 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-conf-dir\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.521994 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522025 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab267f63-ad76-4852-a760-0d69bba953b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522005 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-daemon-config\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522127 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-run-ovn\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522164 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.522893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522199 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-systemd\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522257 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.522276 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret podName:7637e55c-ea03-45d3-aeb8-db957eefe955 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:32.022238888 +0000 UTC m=+3.395767574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret") pod "global-pull-secret-syncer-nr7zv" (UID: "7637e55c-ea03-45d3-aeb8-db957eefe955") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522268 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-run-ovn\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522319 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-systemd\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522358 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k5f5\" (UniqueName: \"kubernetes.io/projected/917c318d-6192-4c07-8749-b33d3098f63e-kube-api-access-5k5f5\") pod \"node-resolver-4s9gs\" (UID: \"917c318d-6192-4c07-8749-b33d3098f63e\") " pod="openshift-dns/node-resolver-4s9gs" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522465 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab267f63-ad76-4852-a760-0d69bba953b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522529 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-kubelet\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522550 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97f2dc48-156f-46b1-b253-2c5b27f2624f-cni-binary-copy\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522556 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5ebb206-8374-4d8b-8986-ec09fb32252c-ovn-node-metrics-cert\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522591 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-daemon-config\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522611 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-kubelet\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522614 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-tmp\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.523676 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522789 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522819 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-registration-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522843 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-os-release\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522867 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-run-k8s-cni-cncf-io\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522905 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-run-multus-certs\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522930 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj2lk\" (UniqueName: \"kubernetes.io/projected/f9a93664-b666-4d6e-8f0f-cc972bcd6442-kube-api-access-vj2lk\") pod \"node-ca-lnlbz\" (UID: \"f9a93664-b666-4d6e-8f0f-cc972bcd6442\") " pod="openshift-image-registry/node-ca-lnlbz" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522955 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x72tz\" (UniqueName: \"kubernetes.io/projected/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-kube-api-access-x72tz\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522981 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.522980 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab267f63-ad76-4852-a760-0d69bba953b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523024 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-run-k8s-cni-cncf-io\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523034 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-system-cni-dir\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523077 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-etc-openvswitch\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523111 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-os-release\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523116 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-run-openvswitch\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.524365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523164 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-run-openvswitch\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523171 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7637e55c-ea03-45d3-aeb8-db957eefe955-kubelet-config\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523201 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-sysconfig\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523211 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-system-cni-dir\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523271 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-sysconfig\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523287 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-registration-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523322 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7637e55c-ea03-45d3-aeb8-db957eefe955-kubelet-config\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523318 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-tuned\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523370 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-socket-dir-parent\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523403 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-var-lib-kubelet\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523434 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-hostroot\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523462 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-cni-bin\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523500 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-os-release\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523532 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab267f63-ad76-4852-a760-0d69bba953b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523544 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-host\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.525117 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523586 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/917c318d-6192-4c07-8749-b33d3098f63e-tmp-dir\") pod \"node-resolver-4s9gs\" (UID: \"917c318d-6192-4c07-8749-b33d3098f63e\") " pod="openshift-dns/node-resolver-4s9gs" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523616 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-multus-socket-dir-parent\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523622 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-hostroot\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523632 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-node-log\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523659 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5ebb206-8374-4d8b-8986-ec09fb32252c-env-overrides\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523656 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-run-multus-certs\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523667 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-host-var-lib-kubelet\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523687 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-device-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524019 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-os-release\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524058 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-cni-bin\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524071 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-node-log\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524081 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/917c318d-6192-4c07-8749-b33d3098f63e-tmp-dir\") pod \"node-resolver-4s9gs\" (UID: \"917c318d-6192-4c07-8749-b33d3098f63e\") " pod="openshift-dns/node-resolver-4s9gs" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524120 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-etc-openvswitch\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.523081 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab267f63-ad76-4852-a760-0d69bba953b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524129 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-run-systemd\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.525891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524176 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-run-systemd\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524178 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-host\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524196 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-run-ovn-kubernetes\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524233 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-device-dir\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524275 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-sysctl-d\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524275 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5ebb206-8374-4d8b-8986-ec09fb32252c-env-overrides\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524311 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-run-ovn-kubernetes\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524331 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-run\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524357 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-run-netns\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524392 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-cnibin\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524425 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-run-netns\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524446 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-sysctl-d\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524489 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-etc-selinux\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524502 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab267f63-ad76-4852-a760-0d69bba953b4-cnibin\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524496 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-run\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.526649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524544 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-cnibin\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524597 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9srqn\" (UniqueName: \"kubernetes.io/projected/97f2dc48-156f-46b1-b253-2c5b27f2624f-kube-api-access-9srqn\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524611 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97f2dc48-156f-46b1-b253-2c5b27f2624f-cnibin\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524608 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-etc-selinux\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524683 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-cni-netd\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524711 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-var-lib-kubelet\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524738 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7t7b\" (UniqueName: \"kubernetes.io/projected/ab267f63-ad76-4852-a760-0d69bba953b4-kube-api-access-v7t7b\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524793 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89lff\" (UniqueName: \"kubernetes.io/projected/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-kube-api-access-89lff\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524818 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5ebb206-8374-4d8b-8986-ec09fb32252c-ovnkube-script-lib\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524852 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-var-lib-kubelet\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524793 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5ebb206-8374-4d8b-8986-ec09fb32252c-host-cni-netd\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.524855 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-sys\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.525072 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-sys\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.525172 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9a93664-b666-4d6e-8f0f-cc972bcd6442-serviceca\") pod \"node-ca-lnlbz\" (UID: \"f9a93664-b666-4d6e-8f0f-cc972bcd6442\") " pod="openshift-image-registry/node-ca-lnlbz" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.525668 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5ebb206-8374-4d8b-8986-ec09fb32252c-ovnkube-config\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.527294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.525708 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9a93664-b666-4d6e-8f0f-cc972bcd6442-serviceca\") pod \"node-ca-lnlbz\" (UID: \"f9a93664-b666-4d6e-8f0f-cc972bcd6442\") " pod="openshift-image-registry/node-ca-lnlbz" Jul 06 19:23:31.528042 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.525720 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-tmp\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.528042 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.525726 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whdwq\" (UniqueName: \"kubernetes.io/projected/b5ebb206-8374-4d8b-8986-ec09fb32252c-kube-api-access-whdwq\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.528042 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.525766 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-lib-modules\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.528042 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.525832 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5ebb206-8374-4d8b-8986-ec09fb32252c-ovnkube-script-lib\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.528042 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.525960 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-lib-modules\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.528042 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.526231 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5ebb206-8374-4d8b-8986-ec09fb32252c-ovnkube-config\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.528042 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.526291 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5ebb206-8374-4d8b-8986-ec09fb32252c-ovn-node-metrics-cert\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.528042 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.526840 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-etc-tuned\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.529124 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.529031 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:31.540140 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.540041 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:31.540140 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.540069 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:31.540140 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.540084 2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxrzb for pod openshift-network-diagnostics/network-check-target-jnw4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:31.540381 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.540160 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb podName:6ab1c135-542e-4d9e-8b9c-39f012dedade nodeName:}" failed. No retries permitted until 2026-07-06 19:23:32.040138675 +0000 UTC m=+3.413667349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jxrzb" (UniqueName: "kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb") pod "network-check-target-jnw4q" (UID: "6ab1c135-542e-4d9e-8b9c-39f012dedade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:31.542358 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.542327 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89lff\" (UniqueName: \"kubernetes.io/projected/80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40-kube-api-access-89lff\") pod \"aws-ebs-csi-driver-node-bddcc\" (UID: \"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.543562 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.543539 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k5f5\" (UniqueName: \"kubernetes.io/projected/917c318d-6192-4c07-8749-b33d3098f63e-kube-api-access-5k5f5\") pod \"node-resolver-4s9gs\" (UID: \"917c318d-6192-4c07-8749-b33d3098f63e\") " pod="openshift-dns/node-resolver-4s9gs" Jul 06 19:23:31.544644 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.544622 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whdwq\" (UniqueName: \"kubernetes.io/projected/b5ebb206-8374-4d8b-8986-ec09fb32252c-kube-api-access-whdwq\") pod \"ovnkube-node-td969\" (UID: \"b5ebb206-8374-4d8b-8986-ec09fb32252c\") " pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.544644 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.544633 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srqn\" (UniqueName: \"kubernetes.io/projected/97f2dc48-156f-46b1-b253-2c5b27f2624f-kube-api-access-9srqn\") pod \"multus-shn74\" (UID: \"97f2dc48-156f-46b1-b253-2c5b27f2624f\") " pod="openshift-multus/multus-shn74" Jul 06 19:23:31.544826 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.544652 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7t7b\" (UniqueName: \"kubernetes.io/projected/ab267f63-ad76-4852-a760-0d69bba953b4-kube-api-access-v7t7b\") pod \"multus-additional-cni-plugins-4t6jr\" (UID: \"ab267f63-ad76-4852-a760-0d69bba953b4\") " pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.544826 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.544681 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj2lk\" (UniqueName: \"kubernetes.io/projected/f9a93664-b666-4d6e-8f0f-cc972bcd6442-kube-api-access-vj2lk\") pod \"node-ca-lnlbz\" (UID: \"f9a93664-b666-4d6e-8f0f-cc972bcd6442\") " pod="openshift-image-registry/node-ca-lnlbz" Jul 06 19:23:31.545908 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.545884 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x72tz\" (UniqueName: \"kubernetes.io/projected/b0c1cf90-114a-4090-9ddd-5bdacfc58bc9-kube-api-access-x72tz\") pod \"tuned-8kfhq\" (UID: \"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.597224 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.597131 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lcnwq" Jul 06 19:23:31.630208 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.630180 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:31.635430 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.635402 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" Jul 06 19:23:31.647550 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.647512 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" Jul 06 19:23:31.657046 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.657014 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-shn74" Jul 06 19:23:31.666916 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.666890 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4s9gs" Jul 06 19:23:31.675417 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.675391 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lnlbz" Jul 06 19:23:31.682415 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.682391 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4t6jr" Jul 06 19:23:31.928942 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:31.928860 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:31.929078 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.929019 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:31.929124 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:31.929088 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs podName:3c02955a-69f5-44b2-8f38-566209f69065 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:32.929067502 +0000 UTC m=+4.302596187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs") pod "network-metrics-daemon-xn49t" (UID: "3c02955a-69f5-44b2-8f38-566209f69065") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:32.029532 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:32.029497 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:32.029737 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:32.029633 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:32.029737 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:32.029710 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret podName:7637e55c-ea03-45d3-aeb8-db957eefe955 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:33.029693059 +0000 UTC m=+4.403221729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret") pod "global-pull-secret-syncer-nr7zv" (UID: "7637e55c-ea03-45d3-aeb8-db957eefe955") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:32.130303 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:32.130263 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrzb\" (UniqueName: \"kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb\") pod \"network-check-target-jnw4q\" (UID: \"6ab1c135-542e-4d9e-8b9c-39f012dedade\") " pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:32.130940 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:32.130420 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:32.130940 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:32.130436 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:32.130940 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:32.130447 2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxrzb for pod openshift-network-diagnostics/network-check-target-jnw4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:32.130940 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:32.130504 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb podName:6ab1c135-542e-4d9e-8b9c-39f012dedade nodeName:}" failed. No retries permitted until 2026-07-06 19:23:33.130490635 +0000 UTC m=+4.504019306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxrzb" (UniqueName: "kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb") pod "network-check-target-jnw4q" (UID: "6ab1c135-542e-4d9e-8b9c-39f012dedade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:32.264529 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:32.264455 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jr677" event={"ID":"93636edc-249a-4292-9002-099de6718579","Type":"ContainerStarted","Data":"0098003e7cf6275f7139a1a5e6a8c18c142fe533342c3d5b54f0dbb824218fa7"} Jul 06 19:23:32.279762 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:32.279685 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:18:31 +0000 UTC" deadline="2028-01-19 12:12:59.303377363 +0000 UTC" Jul 06 19:23:32.279762 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:32.279753 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13480h49m27.023628023s" Jul 06 19:23:32.644138 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:32.644054 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c1cf90_114a_4090_9ddd_5bdacfc58bc9.slice/crio-d8c7a1652f5d3a474d2669e244770a08ec8e765488cbd3100297828f888e49f6 WatchSource:0}: Error finding container d8c7a1652f5d3a474d2669e244770a08ec8e765488cbd3100297828f888e49f6: Status 404 returned error can't find the container with id d8c7a1652f5d3a474d2669e244770a08ec8e765488cbd3100297828f888e49f6 Jul 06 19:23:32.646717 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:32.646102 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3da7875_07c9_4266_bbb0_8407ed265d1c.slice/crio-0a1ef28a76f4532906935f7da9f202dabdbf4348fa62f0673012135928c9cfc9 WatchSource:0}: Error finding container 0a1ef28a76f4532906935f7da9f202dabdbf4348fa62f0673012135928c9cfc9: Status 404 returned error can't find the container with id 0a1ef28a76f4532906935f7da9f202dabdbf4348fa62f0673012135928c9cfc9 Jul 06 19:23:32.647850 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:32.647192 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a93664_b666_4d6e_8f0f_cc972bcd6442.slice/crio-ae5fb3f5054378bf5b59c3f554b8285fad86ac444d08b6a96b7f1c633325704a WatchSource:0}: Error finding container ae5fb3f5054378bf5b59c3f554b8285fad86ac444d08b6a96b7f1c633325704a: Status 404 returned error can't find the container with id ae5fb3f5054378bf5b59c3f554b8285fad86ac444d08b6a96b7f1c633325704a Jul 06 19:23:32.649857 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:32.649664 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ebb206_8374_4d8b_8986_ec09fb32252c.slice/crio-000c289e3861f4e32858a07d645e77c5b6dbdffba3b0e70ae5a1a714a9e0f8ad WatchSource:0}: Error finding container 000c289e3861f4e32858a07d645e77c5b6dbdffba3b0e70ae5a1a714a9e0f8ad: Status 404 returned error can't find the container with id 000c289e3861f4e32858a07d645e77c5b6dbdffba3b0e70ae5a1a714a9e0f8ad Jul 06 19:23:32.650745 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:32.650721 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917c318d_6192_4c07_8749_b33d3098f63e.slice/crio-a552f6f9284163e7676f4d6419cfb2ec2804569351842eb0c6f206bf62e62512 WatchSource:0}: Error finding container a552f6f9284163e7676f4d6419cfb2ec2804569351842eb0c6f206bf62e62512: Status 404 returned error can't find the container with id a552f6f9284163e7676f4d6419cfb2ec2804569351842eb0c6f206bf62e62512 Jul 06 19:23:32.652455 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:32.652415 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab267f63_ad76_4852_a760_0d69bba953b4.slice/crio-f97d3de5d581a4567d22f1e7a4f3bfb5ddedeea4f4f1ad9a5048da325c53c098 WatchSource:0}: Error finding container f97d3de5d581a4567d22f1e7a4f3bfb5ddedeea4f4f1ad9a5048da325c53c098: Status 404 returned error can't find the container with id f97d3de5d581a4567d22f1e7a4f3bfb5ddedeea4f4f1ad9a5048da325c53c098 Jul 06 19:23:32.654179 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:32.653133 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d5d7e1_b5f6_4650_8c72_e36ff9e4ea40.slice/crio-f7a450dbdf72e5cce9cf0d1d36f52e96d7403d0919d24026806c69168ece08ec WatchSource:0}: Error finding container f7a450dbdf72e5cce9cf0d1d36f52e96d7403d0919d24026806c69168ece08ec: Status 404 returned error can't find the container with id f7a450dbdf72e5cce9cf0d1d36f52e96d7403d0919d24026806c69168ece08ec Jul 06 19:23:32.654179 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:23:32.653957 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f2dc48_156f_46b1_b253_2c5b27f2624f.slice/crio-feaa65f921a6abf9eac3e561c769baaaa10333cbf17d1ed3942d63c2c946fbb6 WatchSource:0}: Error finding container feaa65f921a6abf9eac3e561c769baaaa10333cbf17d1ed3942d63c2c946fbb6: Status 404 returned error can't find the container with id feaa65f921a6abf9eac3e561c769baaaa10333cbf17d1ed3942d63c2c946fbb6 Jul 06 19:23:32.937911 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:32.937679 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:32.938034 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:32.937830 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:32.938124 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:32.938108 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs podName:3c02955a-69f5-44b2-8f38-566209f69065 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:34.938078287 +0000 UTC m=+6.311606965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs") pod "network-metrics-daemon-xn49t" (UID: "3c02955a-69f5-44b2-8f38-566209f69065") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:33.039363 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.038757 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:33.039363 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:33.038987 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:33.039363 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:33.039046 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret podName:7637e55c-ea03-45d3-aeb8-db957eefe955 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:35.039029674 +0000 UTC m=+6.412558343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret") pod "global-pull-secret-syncer-nr7zv" (UID: "7637e55c-ea03-45d3-aeb8-db957eefe955") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:33.143741 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.139912 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrzb\" (UniqueName: \"kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb\") pod \"network-check-target-jnw4q\" (UID: \"6ab1c135-542e-4d9e-8b9c-39f012dedade\") " pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:33.143741 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:33.140221 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:33.143741 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:33.140248 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:33.143741 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:33.140264 2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxrzb for pod openshift-network-diagnostics/network-check-target-jnw4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:33.143741 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:33.140332 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb podName:6ab1c135-542e-4d9e-8b9c-39f012dedade nodeName:}" failed. No retries permitted until 2026-07-06 19:23:35.140310904 +0000 UTC m=+6.513839575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxrzb" (UniqueName: "kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb") pod "network-check-target-jnw4q" (UID: "6ab1c135-542e-4d9e-8b9c-39f012dedade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:33.250938 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.250335 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:33.250938 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:33.250498 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:33.259467 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.259434 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:33.260011 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:33.259978 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:33.260139 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.260033 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:33.260358 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:33.260334 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:33.272618 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.272492 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lcnwq" event={"ID":"c3da7875-07c9-4266-bbb0-8407ed265d1c","Type":"ContainerStarted","Data":"0a1ef28a76f4532906935f7da9f202dabdbf4348fa62f0673012135928c9cfc9"} Jul 06 19:23:33.280128 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.280045 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:18:31 +0000 UTC" deadline="2028-04-02 04:51:47.769994104 +0000 UTC" Jul 06 19:23:33.280128 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.280096 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15249h28m14.489902038s" Jul 06 19:23:33.289538 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.288528 2584 generic.go:356] "Generic (PLEG): container finished" podID="bdc13721c40e9855f83088b2fec76aeb" containerID="7ededa828a084aefdbdb9eaa61065c52a59ed8fd2be602c0e5063133cc50e4e7" exitCode=0 Jul 06 19:23:33.289538 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.288620 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" event={"ID":"bdc13721c40e9855f83088b2fec76aeb","Type":"ContainerDied","Data":"7ededa828a084aefdbdb9eaa61065c52a59ed8fd2be602c0e5063133cc50e4e7"} Jul 06 19:23:33.292952 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.292865 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4t6jr" event={"ID":"ab267f63-ad76-4852-a760-0d69bba953b4","Type":"ContainerStarted","Data":"f97d3de5d581a4567d22f1e7a4f3bfb5ddedeea4f4f1ad9a5048da325c53c098"} Jul 06 19:23:33.298843 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.298770 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4s9gs" event={"ID":"917c318d-6192-4c07-8749-b33d3098f63e","Type":"ContainerStarted","Data":"a552f6f9284163e7676f4d6419cfb2ec2804569351842eb0c6f206bf62e62512"} Jul 06 19:23:33.302125 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.302040 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lnlbz" event={"ID":"f9a93664-b666-4d6e-8f0f-cc972bcd6442","Type":"ContainerStarted","Data":"ae5fb3f5054378bf5b59c3f554b8285fad86ac444d08b6a96b7f1c633325704a"} Jul 06 19:23:33.304294 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.304221 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" event={"ID":"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9","Type":"ContainerStarted","Data":"d8c7a1652f5d3a474d2669e244770a08ec8e765488cbd3100297828f888e49f6"} Jul 06 19:23:33.312063 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.311480 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" event={"ID":"7a82202aae61ad36a164e7de6fe394cc","Type":"ContainerStarted","Data":"1dcaf8a0083adbe2a20da5d9652108e2b8a2acd81e8ef885b553886a944d26eb"} Jul 06 19:23:33.323844 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.323810 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-shn74" event={"ID":"97f2dc48-156f-46b1-b253-2c5b27f2624f","Type":"ContainerStarted","Data":"feaa65f921a6abf9eac3e561c769baaaa10333cbf17d1ed3942d63c2c946fbb6"} Jul 06 19:23:33.340299 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.340255 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" event={"ID":"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40","Type":"ContainerStarted","Data":"f7a450dbdf72e5cce9cf0d1d36f52e96d7403d0919d24026806c69168ece08ec"} Jul 06 19:23:33.348438 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:33.348396 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td969" event={"ID":"b5ebb206-8374-4d8b-8986-ec09fb32252c","Type":"ContainerStarted","Data":"000c289e3861f4e32858a07d645e77c5b6dbdffba3b0e70ae5a1a714a9e0f8ad"} Jul 06 19:23:34.955821 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:34.955782 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:34.956299 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:34.955954 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:34.956299 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:34.956030 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs podName:3c02955a-69f5-44b2-8f38-566209f69065 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:38.956008775 +0000 UTC m=+10.329537467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs") pod "network-metrics-daemon-xn49t" (UID: "3c02955a-69f5-44b2-8f38-566209f69065") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:35.057558 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:35.057058 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:35.057558 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:35.057210 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:35.057558 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:35.057278 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret podName:7637e55c-ea03-45d3-aeb8-db957eefe955 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:39.057255702 +0000 UTC m=+10.430784379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret") pod "global-pull-secret-syncer-nr7zv" (UID: "7637e55c-ea03-45d3-aeb8-db957eefe955") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:35.158473 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:35.157820 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrzb\" (UniqueName: \"kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb\") pod \"network-check-target-jnw4q\" (UID: \"6ab1c135-542e-4d9e-8b9c-39f012dedade\") " pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:35.158473 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:35.158011 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:35.158473 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:35.158030 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:35.158473 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:35.158044 2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxrzb for pod openshift-network-diagnostics/network-check-target-jnw4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:35.158473 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:35.158110 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb podName:6ab1c135-542e-4d9e-8b9c-39f012dedade nodeName:}" failed. No retries permitted until 2026-07-06 19:23:39.158089342 +0000 UTC m=+10.531618021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxrzb" (UniqueName: "kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb") pod "network-check-target-jnw4q" (UID: "6ab1c135-542e-4d9e-8b9c-39f012dedade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:35.251934 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:35.251844 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:35.252091 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:35.252000 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:35.252091 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:35.252042 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:35.252208 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:35.252119 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:35.252208 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:35.252157 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:35.252315 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:35.252221 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:37.250730 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:37.250174 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:37.250730 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:37.250365 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:37.251276 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:37.250798 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:37.251276 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:37.250938 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:37.251276 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:37.251071 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:37.251276 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:37.251153 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:38.994916 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:38.994875 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:38.995402 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:38.995064 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:38.995402 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:38.995142 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs podName:3c02955a-69f5-44b2-8f38-566209f69065 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:46.995119109 +0000 UTC m=+18.368647791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs") pod "network-metrics-daemon-xn49t" (UID: "3c02955a-69f5-44b2-8f38-566209f69065") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:39.095328 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:39.095284 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:39.095504 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:39.095477 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:39.095592 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:39.095540 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret podName:7637e55c-ea03-45d3-aeb8-db957eefe955 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:47.095521216 +0000 UTC m=+18.469049901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret") pod "global-pull-secret-syncer-nr7zv" (UID: "7637e55c-ea03-45d3-aeb8-db957eefe955") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:39.196439 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:39.196397 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrzb\" (UniqueName: \"kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb\") pod \"network-check-target-jnw4q\" (UID: \"6ab1c135-542e-4d9e-8b9c-39f012dedade\") " pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:39.196862 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:39.196553 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:39.196862 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:39.196578 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:39.196862 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:39.196592 2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxrzb for pod openshift-network-diagnostics/network-check-target-jnw4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:39.196862 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:39.196656 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb podName:6ab1c135-542e-4d9e-8b9c-39f012dedade nodeName:}" failed. No retries permitted until 2026-07-06 19:23:47.196636302 +0000 UTC m=+18.570164975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxrzb" (UniqueName: "kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb") pod "network-check-target-jnw4q" (UID: "6ab1c135-542e-4d9e-8b9c-39f012dedade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:39.249786 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:39.249387 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:39.249786 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:39.249529 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:39.249786 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:39.249544 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:39.251693 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:39.250653 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:39.251693 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:39.250732 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:39.251693 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:39.250841 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:41.254533 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:41.253764 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:41.254533 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:41.253884 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:41.254533 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:41.254242 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:41.254533 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:41.254343 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:41.254533 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:41.254389 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:41.254533 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:41.254477 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:43.249647 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:43.249582 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:43.250067 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:43.249582 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:43.250067 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:43.249749 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:43.250067 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:43.249811 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:43.250067 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:43.249940 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:43.250067 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:43.250023 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:45.252357 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:45.252325 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:45.252796 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:45.252428 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:45.252796 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:45.252453 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:45.252796 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:45.252444 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:45.252796 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:45.252541 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:45.252796 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:45.252613 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:47.053111 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:47.053073 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:47.053595 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:47.053225 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:47.053595 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:47.053283 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs podName:3c02955a-69f5-44b2-8f38-566209f69065 nodeName:}" failed. No retries permitted until 2026-07-06 19:24:03.053268629 +0000 UTC m=+34.426797297 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs") pod "network-metrics-daemon-xn49t" (UID: "3c02955a-69f5-44b2-8f38-566209f69065") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:47.153512 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:47.153473 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:47.153722 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:47.153675 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:47.153778 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:47.153755 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret podName:7637e55c-ea03-45d3-aeb8-db957eefe955 nodeName:}" failed. No retries permitted until 2026-07-06 19:24:03.153735355 +0000 UTC m=+34.527264027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret") pod "global-pull-secret-syncer-nr7zv" (UID: "7637e55c-ea03-45d3-aeb8-db957eefe955") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:47.249695 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:47.249662 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:47.249838 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:47.249675 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:47.249838 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:47.249799 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:47.249967 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:47.249675 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:47.249967 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:47.249872 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:47.249967 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:47.249952 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:47.254771 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:47.254745 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrzb\" (UniqueName: \"kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb\") pod \"network-check-target-jnw4q\" (UID: \"6ab1c135-542e-4d9e-8b9c-39f012dedade\") " pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:47.254878 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:47.254866 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:47.254925 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:47.254882 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:47.254925 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:47.254896 2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxrzb for pod openshift-network-diagnostics/network-check-target-jnw4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:47.255012 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:47.254942 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb podName:6ab1c135-542e-4d9e-8b9c-39f012dedade nodeName:}" failed. No retries permitted until 2026-07-06 19:24:03.254924347 +0000 UTC m=+34.628453015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxrzb" (UniqueName: "kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb") pod "network-check-target-jnw4q" (UID: "6ab1c135-542e-4d9e-8b9c-39f012dedade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:49.250476 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:49.250443 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:49.250920 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:49.250557 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:49.250920 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:49.250565 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:49.250920 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:49.250597 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:49.250920 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:49.250656 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:49.250920 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:49.250735 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:51.250149 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:51.250113 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:51.250602 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:51.250113 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:51.250602 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:51.250256 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:51.250602 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:51.250113 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:51.250602 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:51.250326 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:51.250602 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:51.250378 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:52.399973 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.399465 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" event={"ID":"b0c1cf90-114a-4090-9ddd-5bdacfc58bc9","Type":"ContainerStarted","Data":"afaac1fce3c12be5237ec3b0071b1306ffdcf337267c2f29f19f4a4770a990e1"} Jul 06 19:23:52.401415 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.401379 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-shn74" event={"ID":"97f2dc48-156f-46b1-b253-2c5b27f2624f","Type":"ContainerStarted","Data":"a1b35e0d308f0cb0415a00ae093fc42f3aa6a7129ee06b5927433485bde95ee4"} Jul 06 19:23:52.403043 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.403021 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" event={"ID":"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40","Type":"ContainerStarted","Data":"5f183b95bd9b0b7cd8d1e5092c459d688143064e5785f6d140e176d004d136a8"} Jul 06 19:23:52.406447 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.406424 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td969" event={"ID":"b5ebb206-8374-4d8b-8986-ec09fb32252c","Type":"ContainerStarted","Data":"8ab300f89e542577bd40c593e63048c51c121e1aa2a2d84cf7bc368668f82228"} Jul 06 19:23:52.406565 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.406498 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td969" event={"ID":"b5ebb206-8374-4d8b-8986-ec09fb32252c","Type":"ContainerStarted","Data":"8751c6e1928bad7b321ab3c7a7e51b0737155c9741cccf05142a237b44b8e29d"} Jul 06 19:23:52.406565 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.406538 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td969" event={"ID":"b5ebb206-8374-4d8b-8986-ec09fb32252c","Type":"ContainerStarted","Data":"eb2041604473d485c65283aa66e686402b8683345ab11f973d73e0e9ee591965"} Jul 06 19:23:52.406703 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.406583 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td969" event={"ID":"b5ebb206-8374-4d8b-8986-ec09fb32252c","Type":"ContainerStarted","Data":"b03034e9a72b4b065348202c6fbe5d2346b7daabeb1c9761fcd56994df4f0f48"} Jul 06 19:23:52.406703 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.406627 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td969" event={"ID":"b5ebb206-8374-4d8b-8986-ec09fb32252c","Type":"ContainerStarted","Data":"ee57da3c7fd6e01778755c3726763845dc052b2c7f2030a9a3a32b114c6e6dfb"} Jul 06 19:23:52.406703 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.406690 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td969" event={"ID":"b5ebb206-8374-4d8b-8986-ec09fb32252c","Type":"ContainerStarted","Data":"05df080525a0c29b8bb7a7380a88c77a13f82f11a9b58277fe6495dbd6d5d636"} Jul 06 19:23:52.408458 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.408434 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" event={"ID":"bdc13721c40e9855f83088b2fec76aeb","Type":"ContainerStarted","Data":"3b833091ec65f51ddf028dda46badc1506105fb27b6b0e01ec9d21453e131485"} Jul 06 19:23:52.409900 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.409875 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jr677" event={"ID":"93636edc-249a-4292-9002-099de6718579","Type":"ContainerStarted","Data":"92fd2508bb3d3336f009016a88d1ed5bf435293021b61e5f269580323118a30a"} Jul 06 19:23:52.411462 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.411439 2584 generic.go:356] "Generic (PLEG): container finished" podID="ab267f63-ad76-4852-a760-0d69bba953b4" containerID="447e88f42c47611ed1b991352800d67380f7384f74271dd43cd93133c891113b" exitCode=0 Jul 06 19:23:52.411554 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.411523 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4t6jr" event={"ID":"ab267f63-ad76-4852-a760-0d69bba953b4","Type":"ContainerDied","Data":"447e88f42c47611ed1b991352800d67380f7384f74271dd43cd93133c891113b"} Jul 06 19:23:52.414462 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.414086 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4s9gs" event={"ID":"917c318d-6192-4c07-8749-b33d3098f63e","Type":"ContainerStarted","Data":"d7576c74be9bfab4512d8b54f666e44fc5fc0ff2f660f90407b6963b87118c9c"} Jul 06 19:23:52.416426 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.416402 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lnlbz" event={"ID":"f9a93664-b666-4d6e-8f0f-cc972bcd6442","Type":"ContainerStarted","Data":"a52b868e17376ba9a7760feb65b5a1fd2b30fc7e54ce724973bcd472aa5b03ef"} Jul 06 19:23:52.431015 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.430959 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8kfhq" podStartSLOduration=3.60325042 podStartE2EDuration="22.430923936s" totalImagesPullingTime="18.827673516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:52.429689766 +0000 UTC m=+23.803218455" watchObservedRunningTime="2026-07-06 19:23:52.430923936 +0000 UTC m=+23.804452619" Jul 06 19:23:52.431541 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.431513 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" podStartSLOduration=21.431503003 podStartE2EDuration="21.431503003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:33.343725953 +0000 UTC m=+4.717254641" watchObservedRunningTime="2026-07-06 19:23:52.431503003 +0000 UTC m=+23.805031770" Jul 06 19:23:52.490030 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.489979 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jr677" podStartSLOduration=10.668073804 podStartE2EDuration="22.489958463s" totalImagesPullingTime="11.821884659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:52.460917585 +0000 UTC m=+23.834446275" watchObservedRunningTime="2026-07-06 19:23:52.489958463 +0000 UTC m=+23.863487154" Jul 06 19:23:52.490515 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.490477 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-shn74" podStartSLOduration=3.5822996590000002 podStartE2EDuration="22.490462564s" totalImagesPullingTime="18.908162905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:52.490408417 +0000 UTC m=+23.863937109" watchObservedRunningTime="2026-07-06 19:23:52.490462564 +0000 UTC m=+23.863991254" Jul 06 19:23:52.552455 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.552403 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4s9gs" podStartSLOduration=3.734241108 podStartE2EDuration="22.552386786s" totalImagesPullingTime="18.818145678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:52.526471961 +0000 UTC m=+23.900000651" watchObservedRunningTime="2026-07-06 19:23:52.552386786 +0000 UTC m=+23.925915513" Jul 06 19:23:52.576189 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.576143 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" podStartSLOduration=21.576127358 podStartE2EDuration="21.576127358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:52.552176542 +0000 UTC m=+23.925705231" watchObservedRunningTime="2026-07-06 19:23:52.576127358 +0000 UTC m=+23.949656047" Jul 06 19:23:52.614303 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:52.614258 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lnlbz" podStartSLOduration=11.811559161 podStartE2EDuration="22.614240814s" totalImagesPullingTime="10.802681653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:52.576055245 +0000 UTC m=+23.949583946" watchObservedRunningTime="2026-07-06 19:23:52.614240814 +0000 UTC m=+23.987769494" Jul 06 19:23:53.250045 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:53.249989 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:53.250045 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:53.250027 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:53.250261 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:53.249988 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:53.250261 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:53.250133 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:53.250261 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:53.250226 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:53.250419 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:53.250309 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:53.259134 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:53.259101 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:23:53.423086 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:53.423004 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" event={"ID":"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40","Type":"ContainerStarted","Data":"9f43eac90e888ba6a575e2f55dde325e69b1db454ea8ab2171574ea5d8855178"} Jul 06 19:23:53.425237 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:53.425175 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lcnwq" event={"ID":"c3da7875-07c9-4266-bbb0-8407ed265d1c","Type":"ContainerStarted","Data":"bf84c08ee5cef78032cf731331bfd09b8cffed84720833727fda1fcf92174967"} Jul 06 19:23:54.129872 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:54.129758 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:23:53.259117477Z","UUID":"fe76d6e3-aacf-44e4-bfc7-0f3ed713a1f5","Handler":null,"Name":"","Endpoint":""} Jul 06 19:23:54.133175 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:54.133148 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:23:54.133175 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:54.133193 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:23:54.431884 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:54.431783 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td969" event={"ID":"b5ebb206-8374-4d8b-8986-ec09fb32252c","Type":"ContainerStarted","Data":"817f53ecfbd989dcd9c872f352e2ad40710a8ec88b659c424ceb4ca21c00367c"} Jul 06 19:23:55.097295 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:55.097219 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:55.097918 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:55.097897 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:55.118841 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:55.118793 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lcnwq" podStartSLOduration=6.295554362 podStartE2EDuration="25.118775794s" totalImagesPullingTime="18.823221432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:53.447879027 +0000 UTC m=+24.821407718" watchObservedRunningTime="2026-07-06 19:23:55.118775794 +0000 UTC m=+26.492304541" Jul 06 19:23:55.253787 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:55.253759 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:55.253972 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:55.253859 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:55.253972 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:55.253865 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:55.253972 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:55.253890 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:55.254133 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:55.253979 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:55.254133 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:55.254083 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:55.436883 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:55.436583 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" event={"ID":"80d5d7e1-b5f6-4650-8c72-e36ff9e4ea40","Type":"ContainerStarted","Data":"b9d960a50c6112cbf024d7eb8f920e53a08490cc6a8a404597ecea4ebdf780e6"} Jul 06 19:23:55.437356 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:55.437034 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:55.437560 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:55.437538 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jr677" Jul 06 19:23:55.462055 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:55.462005 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bddcc" podStartSLOduration=3.9570133309999997 podStartE2EDuration="25.461989703s" totalImagesPullingTime="21.504976372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:55.461331692 +0000 UTC m=+26.834860394" watchObservedRunningTime="2026-07-06 19:23:55.461989703 +0000 UTC m=+26.835518392" Jul 06 19:23:57.252851 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.252614 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:57.253481 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.252676 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:57.253481 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:57.252876 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:57.253481 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:57.252959 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:57.253481 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.252682 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:57.253481 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:57.253032 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:57.442903 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.442867 2584 generic.go:356] "Generic (PLEG): container finished" podID="ab267f63-ad76-4852-a760-0d69bba953b4" containerID="1636bf30507bf28e22f24033ff6219286db476625dbe30819186839afc0b9c81" exitCode=0 Jul 06 19:23:57.442903 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.442900 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4t6jr" event={"ID":"ab267f63-ad76-4852-a760-0d69bba953b4","Type":"ContainerDied","Data":"1636bf30507bf28e22f24033ff6219286db476625dbe30819186839afc0b9c81"} Jul 06 19:23:57.446668 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.446625 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td969" event={"ID":"b5ebb206-8374-4d8b-8986-ec09fb32252c","Type":"ContainerStarted","Data":"0898b46e8726c4d312367025354ee9647a4d88d9faaf9b79594cc2b1d2950461"} Jul 06 19:23:57.446891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.446875 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:57.446954 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.446923 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:57.447013 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.446955 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:57.461766 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.461746 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:57.461871 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.461843 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:23:57.508057 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:57.507987 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-td969" podStartSLOduration=8.608351122 podStartE2EDuration="27.507974495s" totalImagesPullingTime="18.899623373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:57.505204176 +0000 UTC m=+28.878732866" watchObservedRunningTime="2026-07-06 19:23:57.507974495 +0000 UTC m=+28.881503185" Jul 06 19:23:59.155024 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:59.154993 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xn49t"] Jul 06 19:23:59.155476 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:59.155130 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:23:59.155476 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:59.155221 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:23:59.156718 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:59.156694 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nr7zv"] Jul 06 19:23:59.156831 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:59.156792 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:23:59.156947 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:59.156928 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:23:59.173932 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:59.173909 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jnw4q"] Jul 06 19:23:59.174015 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:59.173994 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:23:59.174093 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:23:59.174073 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:23:59.452879 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:59.452845 2584 generic.go:356] "Generic (PLEG): container finished" podID="ab267f63-ad76-4852-a760-0d69bba953b4" containerID="d4e4cff682da4ab450dfa0172a6a2d233dad5d2c423ba9a18ba8c6001872e14d" exitCode=0 Jul 06 19:23:59.453052 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:23:59.452915 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4t6jr" event={"ID":"ab267f63-ad76-4852-a760-0d69bba953b4","Type":"ContainerDied","Data":"d4e4cff682da4ab450dfa0172a6a2d233dad5d2c423ba9a18ba8c6001872e14d"} Jul 06 19:24:00.250674 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:00.250626 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:24:00.251030 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:00.250626 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:24:00.251147 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:00.251120 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:24:00.251268 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:00.251243 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:24:01.249920 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:01.249880 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:24:01.250074 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:01.250032 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:24:01.459504 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:01.459426 2584 generic.go:356] "Generic (PLEG): container finished" podID="ab267f63-ad76-4852-a760-0d69bba953b4" containerID="ec3e8486745810f83e3228e0571c3c2016ccd293ff63092b5db1d1ea57c26df6" exitCode=0 Jul 06 19:24:01.459504 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:01.459468 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4t6jr" event={"ID":"ab267f63-ad76-4852-a760-0d69bba953b4","Type":"ContainerDied","Data":"ec3e8486745810f83e3228e0571c3c2016ccd293ff63092b5db1d1ea57c26df6"} Jul 06 19:24:02.249902 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:02.249865 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:24:02.250082 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:02.250007 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:24:02.250082 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:02.250034 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:24:02.250209 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:02.250171 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:24:03.067444 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:03.067398 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:24:03.067884 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:03.067528 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:24:03.067884 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:03.067600 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs podName:3c02955a-69f5-44b2-8f38-566209f69065 nodeName:}" failed. No retries permitted until 2026-07-06 19:24:35.067580122 +0000 UTC m=+66.441108796 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs") pod "network-metrics-daemon-xn49t" (UID: "3c02955a-69f5-44b2-8f38-566209f69065") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:24:03.168371 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:03.168322 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:24:03.168545 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:03.168499 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:24:03.168603 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:03.168570 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret podName:7637e55c-ea03-45d3-aeb8-db957eefe955 nodeName:}" failed. No retries permitted until 2026-07-06 19:24:35.168549087 +0000 UTC m=+66.542077758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret") pod "global-pull-secret-syncer-nr7zv" (UID: "7637e55c-ea03-45d3-aeb8-db957eefe955") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:24:03.249652 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:03.249606 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:24:03.249830 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:03.249766 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnw4q" podUID="6ab1c135-542e-4d9e-8b9c-39f012dedade" Jul 06 19:24:03.269535 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:03.269493 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrzb\" (UniqueName: \"kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb\") pod \"network-check-target-jnw4q\" (UID: \"6ab1c135-542e-4d9e-8b9c-39f012dedade\") " pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:24:03.269727 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:03.269653 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:24:03.269727 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:03.269668 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:24:03.269727 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:03.269678 2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxrzb for pod openshift-network-diagnostics/network-check-target-jnw4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:24:03.269843 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:03.269728 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb podName:6ab1c135-542e-4d9e-8b9c-39f012dedade nodeName:}" failed. No retries permitted until 2026-07-06 19:24:35.269711459 +0000 UTC m=+66.643240127 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxrzb" (UniqueName: "kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb") pod "network-check-target-jnw4q" (UID: "6ab1c135-542e-4d9e-8b9c-39f012dedade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:24:04.249175 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.249146 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:24:04.249679 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:04.249260 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xn49t" podUID="3c02955a-69f5-44b2-8f38-566209f69065" Jul 06 19:24:04.249679 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.249304 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:24:04.249679 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:04.249397 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr7zv" podUID="7637e55c-ea03-45d3-aeb8-db957eefe955" Jul 06 19:24:04.286762 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.286738 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeReady" Jul 06 19:24:04.286917 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.286881 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:24:04.375693 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.375665 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gmtjr"] Jul 06 19:24:04.378470 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.378451 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.392685 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.392663 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:24:04.392775 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.392737 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:24:04.393273 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.393251 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9s652\"" Jul 06 19:24:04.394092 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.394073 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s58cm"] Jul 06 19:24:04.395936 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.395921 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s58cm" Jul 06 19:24:04.399333 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.399312 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:24:04.399427 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.399357 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:24:04.399592 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.399560 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:24:04.399867 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.399850 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g8g2z\"" Jul 06 19:24:04.410846 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.410821 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gmtjr"] Jul 06 19:24:04.425797 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.425773 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s58cm"] Jul 06 19:24:04.478504 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.478470 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-config-volume\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.478610 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.478503 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4zt9\" (UniqueName: \"kubernetes.io/projected/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-kube-api-access-c4zt9\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.478610 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.478571 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shvhr\" (UniqueName: \"kubernetes.io/projected/789a3b43-97bc-4ff2-bde6-4b105225a257-kube-api-access-shvhr\") pod \"ingress-canary-s58cm\" (UID: \"789a3b43-97bc-4ff2-bde6-4b105225a257\") " pod="openshift-ingress-canary/ingress-canary-s58cm" Jul 06 19:24:04.478757 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.478663 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.478757 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.478700 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789a3b43-97bc-4ff2-bde6-4b105225a257-cert\") pod \"ingress-canary-s58cm\" (UID: \"789a3b43-97bc-4ff2-bde6-4b105225a257\") " pod="openshift-ingress-canary/ingress-canary-s58cm" Jul 06 19:24:04.478757 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.478720 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-tmp-dir\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.579737 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.579660 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-config-volume\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.579737 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.579708 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4zt9\" (UniqueName: \"kubernetes.io/projected/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-kube-api-access-c4zt9\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.579737 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.579731 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shvhr\" (UniqueName: \"kubernetes.io/projected/789a3b43-97bc-4ff2-bde6-4b105225a257-kube-api-access-shvhr\") pod \"ingress-canary-s58cm\" (UID: \"789a3b43-97bc-4ff2-bde6-4b105225a257\") " pod="openshift-ingress-canary/ingress-canary-s58cm" Jul 06 19:24:04.580003 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.579980 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.580049 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.580038 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789a3b43-97bc-4ff2-bde6-4b105225a257-cert\") pod \"ingress-canary-s58cm\" (UID: \"789a3b43-97bc-4ff2-bde6-4b105225a257\") " pod="openshift-ingress-canary/ingress-canary-s58cm" Jul 06 19:24:04.580087 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.580058 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-tmp-dir\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.580142 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:04.580127 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:24:04.580192 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:04.580183 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls podName:f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d nodeName:}" failed. No retries permitted until 2026-07-06 19:24:05.080167166 +0000 UTC m=+36.453695834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls") pod "dns-default-gmtjr" (UID: "f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d") : secret "dns-default-metrics-tls" not found Jul 06 19:24:04.580284 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.580263 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-config-volume\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.580321 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.580290 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-tmp-dir\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.584960 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.584941 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789a3b43-97bc-4ff2-bde6-4b105225a257-cert\") pod \"ingress-canary-s58cm\" (UID: \"789a3b43-97bc-4ff2-bde6-4b105225a257\") " pod="openshift-ingress-canary/ingress-canary-s58cm" Jul 06 19:24:04.606271 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.606249 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4zt9\" (UniqueName: \"kubernetes.io/projected/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-kube-api-access-c4zt9\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:04.607679 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.607660 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shvhr\" (UniqueName: \"kubernetes.io/projected/789a3b43-97bc-4ff2-bde6-4b105225a257-kube-api-access-shvhr\") pod \"ingress-canary-s58cm\" (UID: \"789a3b43-97bc-4ff2-bde6-4b105225a257\") " pod="openshift-ingress-canary/ingress-canary-s58cm" Jul 06 19:24:04.705813 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:04.705779 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s58cm" Jul 06 19:24:05.082948 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:05.082911 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:05.083119 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:05.083073 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:24:05.083175 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:05.083140 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls podName:f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d nodeName:}" failed. No retries permitted until 2026-07-06 19:24:06.083120882 +0000 UTC m=+37.456649550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls") pod "dns-default-gmtjr" (UID: "f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d") : secret "dns-default-metrics-tls" not found Jul 06 19:24:05.249536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:05.249502 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:24:05.254201 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:05.254172 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:24:05.254339 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:05.254220 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-grv4g\"" Jul 06 19:24:05.254339 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:05.254236 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:24:05.536521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:05.536311 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s58cm"] Jul 06 19:24:05.538842 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:24:05.538818 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789a3b43_97bc_4ff2_bde6_4b105225a257.slice/crio-bca38fb7f989291e9a654401f666cb7735263e83600eb01894c4ffdd0183b902 WatchSource:0}: Error finding container bca38fb7f989291e9a654401f666cb7735263e83600eb01894c4ffdd0183b902: Status 404 returned error can't find the container with id bca38fb7f989291e9a654401f666cb7735263e83600eb01894c4ffdd0183b902 Jul 06 19:24:06.089786 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:06.089755 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:06.089954 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:06.089892 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:24:06.090001 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:06.089957 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls podName:f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d nodeName:}" failed. No retries permitted until 2026-07-06 19:24:08.089940977 +0000 UTC m=+39.463469648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls") pod "dns-default-gmtjr" (UID: "f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d") : secret "dns-default-metrics-tls" not found Jul 06 19:24:06.249276 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:06.249243 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:24:06.249438 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:06.249285 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:24:06.254287 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:06.254240 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:24:06.254809 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:06.254687 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:24:06.254809 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:06.254687 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9fn8h\"" Jul 06 19:24:06.476933 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:06.476846 2584 generic.go:356] "Generic (PLEG): container finished" podID="ab267f63-ad76-4852-a760-0d69bba953b4" containerID="fe54046ba9d7f27a601487da7aeba7e23a20e9f4a2467dd6b6c5273ec25cc697" exitCode=0 Jul 06 19:24:06.477080 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:06.476929 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4t6jr" event={"ID":"ab267f63-ad76-4852-a760-0d69bba953b4","Type":"ContainerDied","Data":"fe54046ba9d7f27a601487da7aeba7e23a20e9f4a2467dd6b6c5273ec25cc697"} Jul 06 19:24:06.478544 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:06.478521 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s58cm" event={"ID":"789a3b43-97bc-4ff2-bde6-4b105225a257","Type":"ContainerStarted","Data":"bca38fb7f989291e9a654401f666cb7735263e83600eb01894c4ffdd0183b902"} Jul 06 19:24:07.486101 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:07.486061 2584 generic.go:356] "Generic (PLEG): container finished" podID="ab267f63-ad76-4852-a760-0d69bba953b4" containerID="6fd27a2a5798134ecfdbf6d438f23675eaa6bce5d0f8b41f08a3315cecabe33b" exitCode=0 Jul 06 19:24:07.486500 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:07.486139 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4t6jr" event={"ID":"ab267f63-ad76-4852-a760-0d69bba953b4","Type":"ContainerDied","Data":"6fd27a2a5798134ecfdbf6d438f23675eaa6bce5d0f8b41f08a3315cecabe33b"} Jul 06 19:24:08.107612 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:08.107437 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:08.107798 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:08.107654 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:24:08.107798 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:08.107723 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls podName:f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d nodeName:}" failed. No retries permitted until 2026-07-06 19:24:12.107708174 +0000 UTC m=+43.481236842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls") pod "dns-default-gmtjr" (UID: "f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d") : secret "dns-default-metrics-tls" not found Jul 06 19:24:08.491870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:08.491790 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4t6jr" event={"ID":"ab267f63-ad76-4852-a760-0d69bba953b4","Type":"ContainerStarted","Data":"a4f581fd2d419dde24aa3ba7d591d31a51f96e85ffa82770868982a96ff72152"} Jul 06 19:24:08.493171 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:08.493147 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s58cm" event={"ID":"789a3b43-97bc-4ff2-bde6-4b105225a257","Type":"ContainerStarted","Data":"2501950e413b4d481fb8d166ebb3b969342d2ecffe1c4e9257b47fce1441ea24"} Jul 06 19:24:08.525674 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:08.525605 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4t6jr" podStartSLOduration=9.543948696 podStartE2EDuration="38.525588187s" totalImagesPullingTime="28.981639491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:08.525325656 +0000 UTC m=+39.898854337" watchObservedRunningTime="2026-07-06 19:24:08.525588187 +0000 UTC m=+39.899116875" Jul 06 19:24:08.548533 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:08.548384 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s58cm" podStartSLOduration=2.4088726830000002 podStartE2EDuration="4.548369123s" totalImagesPullingTime="2.13949644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:08.548331165 +0000 UTC m=+39.921859868" watchObservedRunningTime="2026-07-06 19:24:08.548369123 +0000 UTC m=+39.921897813" Jul 06 19:24:12.135367 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:12.135329 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:12.135817 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:12.135447 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:24:12.135817 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:12.135497 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls podName:f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d nodeName:}" failed. No retries permitted until 2026-07-06 19:24:20.135484173 +0000 UTC m=+51.509012842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls") pod "dns-default-gmtjr" (UID: "f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d") : secret "dns-default-metrics-tls" not found Jul 06 19:24:20.190611 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:20.190567 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:20.191086 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:20.190731 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:24:20.191086 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:20.190794 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls podName:f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d nodeName:}" failed. No retries permitted until 2026-07-06 19:24:36.190778397 +0000 UTC m=+67.564307065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls") pod "dns-default-gmtjr" (UID: "f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d") : secret "dns-default-metrics-tls" not found Jul 06 19:24:29.470603 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:29.470576 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-td969" Jul 06 19:24:35.090998 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.090945 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:24:35.094378 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.094358 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:24:35.102185 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:35.102163 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:24:35.102252 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:35.102224 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs podName:3c02955a-69f5-44b2-8f38-566209f69065 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:39.102208914 +0000 UTC m=+130.475737582 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs") pod "network-metrics-daemon-xn49t" (UID: "3c02955a-69f5-44b2-8f38-566209f69065") : secret "metrics-daemon-secret" not found Jul 06 19:24:35.192071 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.192026 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:24:35.196706 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.196688 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:24:35.206351 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.206327 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7637e55c-ea03-45d3-aeb8-db957eefe955-original-pull-secret\") pod \"global-pull-secret-syncer-nr7zv\" (UID: \"7637e55c-ea03-45d3-aeb8-db957eefe955\") " pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:24:35.293011 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.292975 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrzb\" (UniqueName: \"kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb\") pod \"network-check-target-jnw4q\" (UID: \"6ab1c135-542e-4d9e-8b9c-39f012dedade\") " pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:24:35.296901 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.296885 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:24:35.306500 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.306481 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:24:35.316085 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.316060 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxrzb\" (UniqueName: \"kubernetes.io/projected/6ab1c135-542e-4d9e-8b9c-39f012dedade-kube-api-access-jxrzb\") pod \"network-check-target-jnw4q\" (UID: \"6ab1c135-542e-4d9e-8b9c-39f012dedade\") " pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:24:35.367791 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.367743 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr7zv" Jul 06 19:24:35.496120 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.496094 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nr7zv"] Jul 06 19:24:35.499251 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:24:35.499215 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7637e55c_ea03_45d3_aeb8_db957eefe955.slice/crio-7f58d0fc23dbef7358d38a12d1e76f52f40f708afe87a6263e197fb5fbb79293 WatchSource:0}: Error finding container 7f58d0fc23dbef7358d38a12d1e76f52f40f708afe87a6263e197fb5fbb79293: Status 404 returned error can't find the container with id 7f58d0fc23dbef7358d38a12d1e76f52f40f708afe87a6263e197fb5fbb79293 Jul 06 19:24:35.554856 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.554834 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nr7zv" event={"ID":"7637e55c-ea03-45d3-aeb8-db957eefe955","Type":"ContainerStarted","Data":"7f58d0fc23dbef7358d38a12d1e76f52f40f708afe87a6263e197fb5fbb79293"} Jul 06 19:24:35.562801 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.562788 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-grv4g\"" Jul 06 19:24:35.570680 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.570663 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:24:35.687649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:35.687606 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jnw4q"] Jul 06 19:24:35.690238 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:24:35.690211 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab1c135_542e_4d9e_8b9c_39f012dedade.slice/crio-9e5ff2df7df91df8fd29674239f850eb8276a1999da4d27f23219591fc4d49c2 WatchSource:0}: Error finding container 9e5ff2df7df91df8fd29674239f850eb8276a1999da4d27f23219591fc4d49c2: Status 404 returned error can't find the container with id 9e5ff2df7df91df8fd29674239f850eb8276a1999da4d27f23219591fc4d49c2 Jul 06 19:24:36.199432 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:36.199398 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:24:36.199908 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:36.199573 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:24:36.199908 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:24:36.199655 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls podName:f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d nodeName:}" failed. No retries permitted until 2026-07-06 19:25:08.199619092 +0000 UTC m=+99.573147767 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls") pod "dns-default-gmtjr" (UID: "f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d") : secret "dns-default-metrics-tls" not found Jul 06 19:24:36.559158 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:36.559122 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jnw4q" event={"ID":"6ab1c135-542e-4d9e-8b9c-39f012dedade","Type":"ContainerStarted","Data":"9e5ff2df7df91df8fd29674239f850eb8276a1999da4d27f23219591fc4d49c2"} Jul 06 19:24:40.571438 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:40.571401 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jnw4q" event={"ID":"6ab1c135-542e-4d9e-8b9c-39f012dedade","Type":"ContainerStarted","Data":"5a2c117f19e11999531b37f9fe1a58aa89bdda4e7fb59864609d9e03a5a594b9"} Jul 06 19:24:40.571965 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:40.571505 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:24:40.572847 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:40.572825 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nr7zv" event={"ID":"7637e55c-ea03-45d3-aeb8-db957eefe955","Type":"ContainerStarted","Data":"9a8ef6c22cd559a74175f396a4c43800bb77f5c90ba2ecad91086a4b6ba0683d"} Jul 06 19:24:40.613003 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:24:40.612952 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jnw4q" podStartSLOduration=66.116126578 podStartE2EDuration="1m10.612916732s" totalImagesPullingTime="4.496790154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:40.593234184 +0000 UTC m=+71.966762874" watchObservedRunningTime="2026-07-06 19:24:40.612916732 +0000 UTC m=+71.986445423" Jul 06 19:25:03.053969 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.053913 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nr7zv" podStartSLOduration=88.360196433 podStartE2EDuration="1m33.053896213s" totalImagesPullingTime="4.69369978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:40.613228553 +0000 UTC m=+71.986757243" watchObservedRunningTime="2026-07-06 19:25:03.053896213 +0000 UTC m=+94.427424903" Jul 06 19:25:03.054579 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.054093 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww"] Jul 06 19:25:03.056914 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.056894 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:03.059373 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.059340 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 19:25:03.059488 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.059403 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dq74h\"" Jul 06 19:25:03.060376 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.060358 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:25:03.060459 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.060400 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 19:25:03.072921 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.072902 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww"] Jul 06 19:25:03.175098 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.175073 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc"] Jul 06 19:25:03.176085 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.176045 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-w5hww\" (UID: \"5d99ba77-f06e-4fba-947b-a17a564317ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:03.176490 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.176085 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtdnk\" (UniqueName: \"kubernetes.io/projected/5d99ba77-f06e-4fba-947b-a17a564317ad-kube-api-access-mtdnk\") pod \"cluster-samples-operator-56fcf86bf-w5hww\" (UID: \"5d99ba77-f06e-4fba-947b-a17a564317ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:03.177308 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.177289 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-k8f45"] Jul 06 19:25:03.177587 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.177411 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" Jul 06 19:25:03.179714 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.179691 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5947498495-gc2hh"] Jul 06 19:25:03.179818 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.179800 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.181191 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.181173 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tn876\"" Jul 06 19:25:03.181419 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.181402 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 19:25:03.181500 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.181447 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:25:03.181500 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.181464 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.181883 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.181864 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 19:25:03.185670 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.185652 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 19:25:03.185778 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.185755 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 19:25:03.186204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.185971 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 19:25:03.186204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.186016 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:25:03.186204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.186028 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 19:25:03.186204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.186017 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 19:25:03.186204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.186054 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 19:25:03.186204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.186066 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:25:03.186204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.186102 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wn7pb\"" Jul 06 19:25:03.186204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.186021 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 19:25:03.186204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.185978 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 19:25:03.186204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.186168 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:25:03.187046 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.187029 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hh8vg\"" Jul 06 19:25:03.191883 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.191863 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc"] Jul 06 19:25:03.194074 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.194056 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 19:25:03.201203 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.201187 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-k8f45"] Jul 06 19:25:03.202269 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.202251 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5947498495-gc2hh"] Jul 06 19:25:03.277430 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.277406 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b749bfc-a221-4940-b866-fc835b02e562-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bcfdc\" (UID: \"6b749bfc-a221-4940-b866-fc835b02e562\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" Jul 06 19:25:03.277520 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.277434 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwmwh\" (UniqueName: \"kubernetes.io/projected/6b749bfc-a221-4940-b866-fc835b02e562-kube-api-access-gwmwh\") pod \"kube-storage-version-migrator-operator-846bf668f7-bcfdc\" (UID: \"6b749bfc-a221-4940-b866-fc835b02e562\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" Jul 06 19:25:03.277520 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.277460 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/086c7937-63b2-4201-9f1e-fba3d640fb91-config\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.277520 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.277500 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/086c7937-63b2-4201-9f1e-fba3d640fb91-trusted-ca\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.277616 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.277524 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlvfc\" (UniqueName: \"kubernetes.io/projected/086c7937-63b2-4201-9f1e-fba3d640fb91-kube-api-access-rlvfc\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.277616 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.277555 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-w5hww\" (UID: \"5d99ba77-f06e-4fba-947b-a17a564317ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:03.277717 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:03.277647 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:25:03.277717 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.277665 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtdnk\" (UniqueName: \"kubernetes.io/projected/5d99ba77-f06e-4fba-947b-a17a564317ad-kube-api-access-mtdnk\") pod \"cluster-samples-operator-56fcf86bf-w5hww\" (UID: \"5d99ba77-f06e-4fba-947b-a17a564317ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:03.277717 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:03.277699 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls podName:5d99ba77-f06e-4fba-947b-a17a564317ad nodeName:}" failed. No retries permitted until 2026-07-06 19:25:03.777684142 +0000 UTC m=+95.151212810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-w5hww" (UID: "5d99ba77-f06e-4fba-947b-a17a564317ad") : secret "samples-operator-tls" not found Jul 06 19:25:03.277815 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.277726 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/086c7937-63b2-4201-9f1e-fba3d640fb91-serving-cert\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.277815 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.277763 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b749bfc-a221-4940-b866-fc835b02e562-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bcfdc\" (UID: \"6b749bfc-a221-4940-b866-fc835b02e562\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" Jul 06 19:25:03.292135 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.292117 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtdnk\" (UniqueName: \"kubernetes.io/projected/5d99ba77-f06e-4fba-947b-a17a564317ad-kube-api-access-mtdnk\") pod \"cluster-samples-operator-56fcf86bf-w5hww\" (UID: \"5d99ba77-f06e-4fba-947b-a17a564317ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:03.378359 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378303 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/086c7937-63b2-4201-9f1e-fba3d640fb91-serving-cert\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.378359 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378335 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.378359 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378355 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b749bfc-a221-4940-b866-fc835b02e562-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bcfdc\" (UID: \"6b749bfc-a221-4940-b866-fc835b02e562\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" Jul 06 19:25:03.378508 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378372 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8622c\" (UniqueName: \"kubernetes.io/projected/d9096032-bd93-4923-b366-814e541ce48e-kube-api-access-8622c\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.378508 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378445 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b749bfc-a221-4940-b866-fc835b02e562-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bcfdc\" (UID: \"6b749bfc-a221-4940-b866-fc835b02e562\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" Jul 06 19:25:03.378508 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378483 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwmwh\" (UniqueName: \"kubernetes.io/projected/6b749bfc-a221-4940-b866-fc835b02e562-kube-api-access-gwmwh\") pod \"kube-storage-version-migrator-operator-846bf668f7-bcfdc\" (UID: \"6b749bfc-a221-4940-b866-fc835b02e562\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" Jul 06 19:25:03.378611 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378522 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.378611 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378562 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-default-certificate\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.378611 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378588 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/086c7937-63b2-4201-9f1e-fba3d640fb91-config\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.378780 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378653 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/086c7937-63b2-4201-9f1e-fba3d640fb91-trusted-ca\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.378780 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378693 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlvfc\" (UniqueName: \"kubernetes.io/projected/086c7937-63b2-4201-9f1e-fba3d640fb91-kube-api-access-rlvfc\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.378780 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378725 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-stats-auth\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.378945 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.378925 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b749bfc-a221-4940-b866-fc835b02e562-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bcfdc\" (UID: \"6b749bfc-a221-4940-b866-fc835b02e562\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" Jul 06 19:25:03.379286 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.379266 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/086c7937-63b2-4201-9f1e-fba3d640fb91-config\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.379689 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.379673 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/086c7937-63b2-4201-9f1e-fba3d640fb91-trusted-ca\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.380576 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.380550 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b749bfc-a221-4940-b866-fc835b02e562-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bcfdc\" (UID: \"6b749bfc-a221-4940-b866-fc835b02e562\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" Jul 06 19:25:03.380688 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.380550 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/086c7937-63b2-4201-9f1e-fba3d640fb91-serving-cert\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.398226 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.398199 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlvfc\" (UniqueName: \"kubernetes.io/projected/086c7937-63b2-4201-9f1e-fba3d640fb91-kube-api-access-rlvfc\") pod \"console-operator-68b757fb67-k8f45\" (UID: \"086c7937-63b2-4201-9f1e-fba3d640fb91\") " pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.398494 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.398473 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwmwh\" (UniqueName: \"kubernetes.io/projected/6b749bfc-a221-4940-b866-fc835b02e562-kube-api-access-gwmwh\") pod \"kube-storage-version-migrator-operator-846bf668f7-bcfdc\" (UID: \"6b749bfc-a221-4940-b866-fc835b02e562\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" Jul 06 19:25:03.479589 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.479553 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8622c\" (UniqueName: \"kubernetes.io/projected/d9096032-bd93-4923-b366-814e541ce48e-kube-api-access-8622c\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.479720 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.479628 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.479720 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.479686 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-default-certificate\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.479720 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.479713 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-stats-auth\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.479874 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.479774 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.479874 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:03.479789 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:25:03.479874 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:03.479857 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:03.979837548 +0000 UTC m=+95.353366236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : secret "router-metrics-certs-default" not found Jul 06 19:25:03.480004 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:03.479911 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:03.979893938 +0000 UTC m=+95.353422630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : configmap references non-existent config key: service-ca.crt Jul 06 19:25:03.482003 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.481958 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-stats-auth\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.482081 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.481978 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-default-certificate\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.487754 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.487742 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" Jul 06 19:25:03.492914 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.492893 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8622c\" (UniqueName: \"kubernetes.io/projected/d9096032-bd93-4923-b366-814e541ce48e-kube-api-access-8622c\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.494544 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.494525 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:03.620872 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.620844 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc"] Jul 06 19:25:03.624331 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:03.624307 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b749bfc_a221_4940_b866_fc835b02e562.slice/crio-2cf5c0453dd05032188dce06ffadc676de72cead7f1669b106b887ebb693d634 WatchSource:0}: Error finding container 2cf5c0453dd05032188dce06ffadc676de72cead7f1669b106b887ebb693d634: Status 404 returned error can't find the container with id 2cf5c0453dd05032188dce06ffadc676de72cead7f1669b106b887ebb693d634 Jul 06 19:25:03.628215 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.628192 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" event={"ID":"6b749bfc-a221-4940-b866-fc835b02e562","Type":"ContainerStarted","Data":"2cf5c0453dd05032188dce06ffadc676de72cead7f1669b106b887ebb693d634"} Jul 06 19:25:03.645477 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.645459 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-k8f45"] Jul 06 19:25:03.647655 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:03.647619 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086c7937_63b2_4201_9f1e_fba3d640fb91.slice/crio-bf1eafd48de70242df3c2da8632736ce2b5a4eb426fe72571f70089b3c57f71d WatchSource:0}: Error finding container bf1eafd48de70242df3c2da8632736ce2b5a4eb426fe72571f70089b3c57f71d: Status 404 returned error can't find the container with id bf1eafd48de70242df3c2da8632736ce2b5a4eb426fe72571f70089b3c57f71d Jul 06 19:25:03.782494 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.782468 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-w5hww\" (UID: \"5d99ba77-f06e-4fba-947b-a17a564317ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:03.782599 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:03.782580 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:25:03.782691 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:03.782681 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls podName:5d99ba77-f06e-4fba-947b-a17a564317ad nodeName:}" failed. No retries permitted until 2026-07-06 19:25:04.782613322 +0000 UTC m=+96.156142006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-w5hww" (UID: "5d99ba77-f06e-4fba-947b-a17a564317ad") : secret "samples-operator-tls" not found Jul 06 19:25:03.983946 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.983874 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.983946 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:03.983931 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:03.984135 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:03.984012 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:25:03.984135 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:03.984056 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:04.984035967 +0000 UTC m=+96.357564634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : configmap references non-existent config key: service-ca.crt Jul 06 19:25:03.984135 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:03.984079 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:04.984070579 +0000 UTC m=+96.357599252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : secret "router-metrics-certs-default" not found Jul 06 19:25:04.632944 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:04.632909 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" event={"ID":"086c7937-63b2-4201-9f1e-fba3d640fb91","Type":"ContainerStarted","Data":"bf1eafd48de70242df3c2da8632736ce2b5a4eb426fe72571f70089b3c57f71d"} Jul 06 19:25:04.788008 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:04.787969 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-w5hww\" (UID: \"5d99ba77-f06e-4fba-947b-a17a564317ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:04.788201 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:04.788137 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:25:04.788201 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:04.788202 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls podName:5d99ba77-f06e-4fba-947b-a17a564317ad nodeName:}" failed. No retries permitted until 2026-07-06 19:25:06.78818258 +0000 UTC m=+98.161711266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-w5hww" (UID: "5d99ba77-f06e-4fba-947b-a17a564317ad") : secret "samples-operator-tls" not found Jul 06 19:25:04.989617 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:04.989544 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:04.989790 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:04.989717 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:04.989790 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:04.989727 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:06.989708694 +0000 UTC m=+98.363237362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : configmap references non-existent config key: service-ca.crt Jul 06 19:25:04.989906 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:04.989836 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:25:04.989906 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:04.989882 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:06.989870718 +0000 UTC m=+98.363399393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : secret "router-metrics-certs-default" not found Jul 06 19:25:06.514685 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.514592 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bqkn9"] Jul 06 19:25:06.516812 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.516786 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.522112 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.522090 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:25:06.522231 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.522101 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4gc24\"" Jul 06 19:25:06.523025 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.522834 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:25:06.523025 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.522908 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:25:06.524172 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.524157 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:25:06.556949 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.556923 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bqkn9"] Jul 06 19:25:06.600773 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.600739 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87cb2b2a-f22d-4810-908e-5dde5f336f24-crio-socket\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.600938 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.600782 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.600938 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.600815 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.600938 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.600859 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmbp\" (UniqueName: \"kubernetes.io/projected/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-api-access-whmbp\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.601052 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.600947 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87cb2b2a-f22d-4810-908e-5dde5f336f24-data-volume\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.640290 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.640260 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" event={"ID":"6b749bfc-a221-4940-b866-fc835b02e562","Type":"ContainerStarted","Data":"a152bdc45a0cfb247985bab6e60974cadee755a124e9a4d7c8579621712cd07f"} Jul 06 19:25:06.641765 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.641749 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/0.log" Jul 06 19:25:06.641839 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.641780 2584 generic.go:356] "Generic (PLEG): container finished" podID="086c7937-63b2-4201-9f1e-fba3d640fb91" containerID="b46c28b3228f99064421dfbb07c9e2e87b503b930166fb03e30904de4df81841" exitCode=255 Jul 06 19:25:06.641839 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.641827 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" event={"ID":"086c7937-63b2-4201-9f1e-fba3d640fb91","Type":"ContainerDied","Data":"b46c28b3228f99064421dfbb07c9e2e87b503b930166fb03e30904de4df81841"} Jul 06 19:25:06.642016 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.642005 2584 scope.go:117] "RemoveContainer" containerID="b46c28b3228f99064421dfbb07c9e2e87b503b930166fb03e30904de4df81841" Jul 06 19:25:06.688082 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.688025 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" podStartSLOduration=1.135801354 podStartE2EDuration="3.688003396s" totalImagesPullingTime="2.552202042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:06.687360392 +0000 UTC m=+98.060889082" watchObservedRunningTime="2026-07-06 19:25:06.688003396 +0000 UTC m=+98.061532087" Jul 06 19:25:06.701753 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.701727 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87cb2b2a-f22d-4810-908e-5dde5f336f24-crio-socket\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.701848 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.701760 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.701924 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:06.701895 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:06.701977 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:06.701958 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls podName:87cb2b2a-f22d-4810-908e-5dde5f336f24 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:07.201940327 +0000 UTC m=+98.575468999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqkn9" (UID: "87cb2b2a-f22d-4810-908e-5dde5f336f24") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:06.702036 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.702024 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87cb2b2a-f22d-4810-908e-5dde5f336f24-crio-socket\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.702083 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.702062 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.702133 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.702089 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whmbp\" (UniqueName: \"kubernetes.io/projected/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-api-access-whmbp\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.702279 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.702260 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87cb2b2a-f22d-4810-908e-5dde5f336f24-data-volume\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.702903 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:06.702552 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:25:06.702993 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:06.702952 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm podName:87cb2b2a-f22d-4810-908e-5dde5f336f24 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:07.202925885 +0000 UTC m=+98.576454572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqkn9" (UID: "87cb2b2a-f22d-4810-908e-5dde5f336f24") : configmap "kube-rbac-proxy" not found Jul 06 19:25:06.702993 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.702959 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87cb2b2a-f22d-4810-908e-5dde5f336f24-data-volume\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.715051 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.715024 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmbp\" (UniqueName: \"kubernetes.io/projected/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-api-access-whmbp\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:06.804184 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:06.804157 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-w5hww\" (UID: \"5d99ba77-f06e-4fba-947b-a17a564317ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:06.804342 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:06.804265 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:25:06.804342 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:06.804315 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls podName:5d99ba77-f06e-4fba-947b-a17a564317ad nodeName:}" failed. No retries permitted until 2026-07-06 19:25:10.804302265 +0000 UTC m=+102.177830933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-w5hww" (UID: "5d99ba77-f06e-4fba-947b-a17a564317ad") : secret "samples-operator-tls" not found Jul 06 19:25:07.006611 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:07.006570 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:07.006813 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:07.006699 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:07.006886 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:07.006851 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:25:07.006940 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:07.006931 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:11.006910022 +0000 UTC m=+102.380438694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : secret "router-metrics-certs-default" not found Jul 06 19:25:07.009542 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:07.007473 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:11.007449952 +0000 UTC m=+102.380978623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : configmap references non-existent config key: service-ca.crt Jul 06 19:25:07.208051 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:07.208011 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:07.208235 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:07.208059 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:07.208235 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:07.208152 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:25:07.208235 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:07.208195 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:07.208332 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:07.208202 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm podName:87cb2b2a-f22d-4810-908e-5dde5f336f24 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:08.208188624 +0000 UTC m=+99.581717293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqkn9" (UID: "87cb2b2a-f22d-4810-908e-5dde5f336f24") : configmap "kube-rbac-proxy" not found Jul 06 19:25:07.208332 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:07.208271 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls podName:87cb2b2a-f22d-4810-908e-5dde5f336f24 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:08.208251686 +0000 UTC m=+99.581780359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqkn9" (UID: "87cb2b2a-f22d-4810-908e-5dde5f336f24") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:07.647365 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:07.647333 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/1.log" Jul 06 19:25:07.647776 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:07.647762 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/0.log" Jul 06 19:25:07.647829 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:07.647796 2584 generic.go:356] "Generic (PLEG): container finished" podID="086c7937-63b2-4201-9f1e-fba3d640fb91" containerID="a869541d2d8ddbbba55fc6dc6d68d3c56dbac398e71a918124d772904f175fdb" exitCode=255 Jul 06 19:25:07.647861 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:07.647825 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" event={"ID":"086c7937-63b2-4201-9f1e-fba3d640fb91","Type":"ContainerDied","Data":"a869541d2d8ddbbba55fc6dc6d68d3c56dbac398e71a918124d772904f175fdb"} Jul 06 19:25:07.647897 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:07.647882 2584 scope.go:117] "RemoveContainer" containerID="b46c28b3228f99064421dfbb07c9e2e87b503b930166fb03e30904de4df81841" Jul 06 19:25:07.648233 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:07.648214 2584 scope.go:117] "RemoveContainer" containerID="a869541d2d8ddbbba55fc6dc6d68d3c56dbac398e71a918124d772904f175fdb" Jul 06 19:25:07.648411 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:07.648383 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-k8f45_openshift-console-operator(086c7937-63b2-4201-9f1e-fba3d640fb91)\"" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" podUID="086c7937-63b2-4201-9f1e-fba3d640fb91" Jul 06 19:25:08.215772 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:08.215737 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:08.215945 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:08.215777 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:08.215945 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:08.215871 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:25:08.215945 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:08.215899 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:08.216049 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:08.215944 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:25:08.216049 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:08.215961 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:25:08.216049 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:08.215965 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls podName:87cb2b2a-f22d-4810-908e-5dde5f336f24 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:10.215946145 +0000 UTC m=+101.589474829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqkn9" (UID: "87cb2b2a-f22d-4810-908e-5dde5f336f24") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:08.216049 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:08.216001 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls podName:f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d nodeName:}" failed. No retries permitted until 2026-07-06 19:26:12.215991217 +0000 UTC m=+163.589519889 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls") pod "dns-default-gmtjr" (UID: "f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d") : secret "dns-default-metrics-tls" not found Jul 06 19:25:08.216049 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:08.216014 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm podName:87cb2b2a-f22d-4810-908e-5dde5f336f24 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:10.216006308 +0000 UTC m=+101.589534975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqkn9" (UID: "87cb2b2a-f22d-4810-908e-5dde5f336f24") : configmap "kube-rbac-proxy" not found Jul 06 19:25:08.284536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:08.284509 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4s9gs_917c318d-6192-4c07-8749-b33d3098f63e/dns-node-resolver/0.log" Jul 06 19:25:08.651644 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:08.651617 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/1.log" Jul 06 19:25:08.652009 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:08.651971 2584 scope.go:117] "RemoveContainer" containerID="a869541d2d8ddbbba55fc6dc6d68d3c56dbac398e71a918124d772904f175fdb" Jul 06 19:25:08.652145 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:08.652127 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-k8f45_openshift-console-operator(086c7937-63b2-4201-9f1e-fba3d640fb91)\"" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" podUID="086c7937-63b2-4201-9f1e-fba3d640fb91" Jul 06 19:25:09.269684 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:09.269651 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lnlbz_f9a93664-b666-4d6e-8f0f-cc972bcd6442/node-ca/0.log" Jul 06 19:25:10.230211 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.230173 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:10.230211 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.230215 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:10.230604 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:10.230329 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:10.230604 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:10.230403 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls podName:87cb2b2a-f22d-4810-908e-5dde5f336f24 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:14.23038922 +0000 UTC m=+105.603917893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqkn9" (UID: "87cb2b2a-f22d-4810-908e-5dde5f336f24") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:10.230604 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:10.230329 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:25:10.230604 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:10.230452 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm podName:87cb2b2a-f22d-4810-908e-5dde5f336f24 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:14.230444081 +0000 UTC m=+105.603972763 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqkn9" (UID: "87cb2b2a-f22d-4810-908e-5dde5f336f24") : configmap "kube-rbac-proxy" not found Jul 06 19:25:10.465248 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.465222 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s58cm_789a3b43-97bc-4ff2-bde6-4b105225a257/serve-healthcheck-canary/0.log" Jul 06 19:25:10.786055 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.786018 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-p6j4n"] Jul 06 19:25:10.818714 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.818686 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-p6j4n"] Jul 06 19:25:10.818862 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.818790 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-p6j4n" Jul 06 19:25:10.821751 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.821727 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 19:25:10.822714 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.822698 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 19:25:10.822814 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.822731 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 19:25:10.824022 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.823999 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pxkpx\"" Jul 06 19:25:10.832104 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.832089 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 19:25:10.834472 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.834451 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-w5hww\" (UID: \"5d99ba77-f06e-4fba-947b-a17a564317ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:10.834561 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.834482 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bts7\" (UniqueName: \"kubernetes.io/projected/61c17cd6-39e2-4733-bc4e-da2bd6a7f672-kube-api-access-9bts7\") pod \"service-ca-758f599c5-p6j4n\" (UID: \"61c17cd6-39e2-4733-bc4e-da2bd6a7f672\") " pod="openshift-service-ca/service-ca-758f599c5-p6j4n" Jul 06 19:25:10.834561 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.834521 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/61c17cd6-39e2-4733-bc4e-da2bd6a7f672-signing-key\") pod \"service-ca-758f599c5-p6j4n\" (UID: \"61c17cd6-39e2-4733-bc4e-da2bd6a7f672\") " pod="openshift-service-ca/service-ca-758f599c5-p6j4n" Jul 06 19:25:10.834648 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:10.834583 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:25:10.834648 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.834585 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/61c17cd6-39e2-4733-bc4e-da2bd6a7f672-signing-cabundle\") pod \"service-ca-758f599c5-p6j4n\" (UID: \"61c17cd6-39e2-4733-bc4e-da2bd6a7f672\") " pod="openshift-service-ca/service-ca-758f599c5-p6j4n" Jul 06 19:25:10.834648 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:10.834644 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls podName:5d99ba77-f06e-4fba-947b-a17a564317ad nodeName:}" failed. No retries permitted until 2026-07-06 19:25:18.834616034 +0000 UTC m=+110.208144702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-w5hww" (UID: "5d99ba77-f06e-4fba-947b-a17a564317ad") : secret "samples-operator-tls" not found Jul 06 19:25:10.935664 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.935617 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/61c17cd6-39e2-4733-bc4e-da2bd6a7f672-signing-key\") pod \"service-ca-758f599c5-p6j4n\" (UID: \"61c17cd6-39e2-4733-bc4e-da2bd6a7f672\") " pod="openshift-service-ca/service-ca-758f599c5-p6j4n" Jul 06 19:25:10.935820 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.935675 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/61c17cd6-39e2-4733-bc4e-da2bd6a7f672-signing-cabundle\") pod \"service-ca-758f599c5-p6j4n\" (UID: \"61c17cd6-39e2-4733-bc4e-da2bd6a7f672\") " pod="openshift-service-ca/service-ca-758f599c5-p6j4n" Jul 06 19:25:10.935820 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.935741 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bts7\" (UniqueName: \"kubernetes.io/projected/61c17cd6-39e2-4733-bc4e-da2bd6a7f672-kube-api-access-9bts7\") pod \"service-ca-758f599c5-p6j4n\" (UID: \"61c17cd6-39e2-4733-bc4e-da2bd6a7f672\") " pod="openshift-service-ca/service-ca-758f599c5-p6j4n" Jul 06 19:25:10.936379 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.936360 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/61c17cd6-39e2-4733-bc4e-da2bd6a7f672-signing-cabundle\") pod \"service-ca-758f599c5-p6j4n\" (UID: \"61c17cd6-39e2-4733-bc4e-da2bd6a7f672\") " pod="openshift-service-ca/service-ca-758f599c5-p6j4n" Jul 06 19:25:10.938169 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.938145 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/61c17cd6-39e2-4733-bc4e-da2bd6a7f672-signing-key\") pod \"service-ca-758f599c5-p6j4n\" (UID: \"61c17cd6-39e2-4733-bc4e-da2bd6a7f672\") " pod="openshift-service-ca/service-ca-758f599c5-p6j4n" Jul 06 19:25:10.945196 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:10.945174 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bts7\" (UniqueName: \"kubernetes.io/projected/61c17cd6-39e2-4733-bc4e-da2bd6a7f672-kube-api-access-9bts7\") pod \"service-ca-758f599c5-p6j4n\" (UID: \"61c17cd6-39e2-4733-bc4e-da2bd6a7f672\") " pod="openshift-service-ca/service-ca-758f599c5-p6j4n" Jul 06 19:25:11.036955 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:11.036866 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:11.036955 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:11.036916 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:11.037144 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:11.037049 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:19.037027936 +0000 UTC m=+110.410556617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : configmap references non-existent config key: service-ca.crt Jul 06 19:25:11.037144 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:11.037079 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:25:11.037144 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:11.037140 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:19.037128666 +0000 UTC m=+110.410657334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : secret "router-metrics-certs-default" not found Jul 06 19:25:11.127815 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:11.127785 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-p6j4n" Jul 06 19:25:11.280244 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:11.280208 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-p6j4n"] Jul 06 19:25:11.283606 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:11.283585 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c17cd6_39e2_4733_bc4e_da2bd6a7f672.slice/crio-a676ca45dd1c5fe8373e6800363cb3529b7c5176485c3ce635feacfe40aeceaf WatchSource:0}: Error finding container a676ca45dd1c5fe8373e6800363cb3529b7c5176485c3ce635feacfe40aeceaf: Status 404 returned error can't find the container with id a676ca45dd1c5fe8373e6800363cb3529b7c5176485c3ce635feacfe40aeceaf Jul 06 19:25:11.577368 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:11.577297 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jnw4q" Jul 06 19:25:11.659988 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:11.659955 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-p6j4n" event={"ID":"61c17cd6-39e2-4733-bc4e-da2bd6a7f672","Type":"ContainerStarted","Data":"a676ca45dd1c5fe8373e6800363cb3529b7c5176485c3ce635feacfe40aeceaf"} Jul 06 19:25:13.495442 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:13.495404 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:13.495884 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:13.495466 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:13.495884 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:13.495870 2584 scope.go:117] "RemoveContainer" containerID="a869541d2d8ddbbba55fc6dc6d68d3c56dbac398e71a918124d772904f175fdb" Jul 06 19:25:13.496059 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:13.496039 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-k8f45_openshift-console-operator(086c7937-63b2-4201-9f1e-fba3d640fb91)\"" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" podUID="086c7937-63b2-4201-9f1e-fba3d640fb91" Jul 06 19:25:14.261657 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:14.261542 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:14.261657 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:14.261597 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:14.261927 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:14.261707 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:25:14.261927 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:14.261717 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:14.261927 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:14.261765 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm podName:87cb2b2a-f22d-4810-908e-5dde5f336f24 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:22.261747463 +0000 UTC m=+113.635276145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqkn9" (UID: "87cb2b2a-f22d-4810-908e-5dde5f336f24") : configmap "kube-rbac-proxy" not found Jul 06 19:25:14.261927 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:14.261784 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls podName:87cb2b2a-f22d-4810-908e-5dde5f336f24 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:22.261774194 +0000 UTC m=+113.635302865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqkn9" (UID: "87cb2b2a-f22d-4810-908e-5dde5f336f24") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:14.669997 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:14.669955 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-p6j4n" event={"ID":"61c17cd6-39e2-4733-bc4e-da2bd6a7f672","Type":"ContainerStarted","Data":"e66725e1b7873d9caf7bdf1b0e8838aa58953ace994d0a1f751c48391f1197d1"} Jul 06 19:25:14.702202 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:14.702151 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-p6j4n" podStartSLOduration=2.020141261 podStartE2EDuration="4.702134338s" totalImagesPullingTime="2.681993077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:14.69921442 +0000 UTC m=+106.072743110" watchObservedRunningTime="2026-07-06 19:25:14.702134338 +0000 UTC m=+106.075663027" Jul 06 19:25:18.899871 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:18.899810 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-w5hww\" (UID: \"5d99ba77-f06e-4fba-947b-a17a564317ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:18.902205 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:18.902184 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d99ba77-f06e-4fba-947b-a17a564317ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-w5hww\" (UID: \"5d99ba77-f06e-4fba-947b-a17a564317ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:18.965245 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:18.965217 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" Jul 06 19:25:19.091207 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:19.091183 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww"] Jul 06 19:25:19.101617 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:19.101590 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:19.101759 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:19.101627 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:19.101811 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:19.101763 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:25:19.101811 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:19.101794 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:35.101771502 +0000 UTC m=+126.475300173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : configmap references non-existent config key: service-ca.crt Jul 06 19:25:19.101895 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:19.101821 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs podName:d9096032-bd93-4923-b366-814e541ce48e nodeName:}" failed. No retries permitted until 2026-07-06 19:25:35.101809527 +0000 UTC m=+126.475338200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs") pod "router-default-5947498495-gc2hh" (UID: "d9096032-bd93-4923-b366-814e541ce48e") : secret "router-metrics-certs-default" not found Jul 06 19:25:19.687160 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:19.687116 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" event={"ID":"5d99ba77-f06e-4fba-947b-a17a564317ad","Type":"ContainerStarted","Data":"5efa04ab8c0812feeba51347b23b7f0890be161f48bd8c71b8a15c920bd5bdbc"} Jul 06 19:25:21.694515 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:21.694480 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" event={"ID":"5d99ba77-f06e-4fba-947b-a17a564317ad","Type":"ContainerStarted","Data":"98c76bc92ef0ff3bee7ef14c22424d811aca426073717be0c19e280da0ebb1de"} Jul 06 19:25:21.694926 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:21.694542 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" event={"ID":"5d99ba77-f06e-4fba-947b-a17a564317ad","Type":"ContainerStarted","Data":"1fa074b595468dc4c0a6a8f5a33fb3ade23bf3d77b0d1ff5d154d7ed37ecf881"} Jul 06 19:25:21.722304 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:21.722250 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-w5hww" podStartSLOduration=16.751923404 podStartE2EDuration="18.722229585s" totalImagesPullingTime="1.970306181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:21.721139354 +0000 UTC m=+113.094668044" watchObservedRunningTime="2026-07-06 19:25:21.722229585 +0000 UTC m=+113.095758274" Jul 06 19:25:22.325865 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:22.325828 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:22.326032 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:22.325878 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:22.326032 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:22.325983 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:22.326107 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:22.326054 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls podName:87cb2b2a-f22d-4810-908e-5dde5f336f24 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:38.326036515 +0000 UTC m=+129.699565195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqkn9" (UID: "87cb2b2a-f22d-4810-908e-5dde5f336f24") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:22.326461 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:22.326443 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87cb2b2a-f22d-4810-908e-5dde5f336f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:28.249426 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:28.249390 2584 scope.go:117] "RemoveContainer" containerID="a869541d2d8ddbbba55fc6dc6d68d3c56dbac398e71a918124d772904f175fdb" Jul 06 19:25:28.717279 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:28.717247 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:25:28.717624 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:28.717610 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/1.log" Jul 06 19:25:28.717703 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:28.717669 2584 generic.go:356] "Generic (PLEG): container finished" podID="086c7937-63b2-4201-9f1e-fba3d640fb91" containerID="8fb0e3e7abc6efff4af5c96e326eb24e30a1a0eda8e111619972af476eb44af2" exitCode=255 Jul 06 19:25:28.717740 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:28.717731 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" event={"ID":"086c7937-63b2-4201-9f1e-fba3d640fb91","Type":"ContainerDied","Data":"8fb0e3e7abc6efff4af5c96e326eb24e30a1a0eda8e111619972af476eb44af2"} Jul 06 19:25:28.717788 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:28.717778 2584 scope.go:117] "RemoveContainer" containerID="a869541d2d8ddbbba55fc6dc6d68d3c56dbac398e71a918124d772904f175fdb" Jul 06 19:25:28.718114 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:28.718098 2584 scope.go:117] "RemoveContainer" containerID="8fb0e3e7abc6efff4af5c96e326eb24e30a1a0eda8e111619972af476eb44af2" Jul 06 19:25:28.718293 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:28.718268 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-k8f45_openshift-console-operator(086c7937-63b2-4201-9f1e-fba3d640fb91)\"" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" podUID="086c7937-63b2-4201-9f1e-fba3d640fb91" Jul 06 19:25:29.722145 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:29.722116 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:25:31.973408 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:31.973374 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld"] Jul 06 19:25:31.976425 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:31.976402 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:31.980220 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:31.980196 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 19:25:31.980351 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:31.980268 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 19:25:31.980514 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:31.980499 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 19:25:31.981801 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:31.981785 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 19:25:32.004175 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.004147 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld"] Jul 06 19:25:32.103290 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.103254 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j77jx\" (UniqueName: \"kubernetes.io/projected/e5b93e32-61a6-42f7-9b23-a325e9f588c3-kube-api-access-j77jx\") pod \"klusterlet-addon-workmgr-787c687cd-6skld\" (UID: \"e5b93e32-61a6-42f7-9b23-a325e9f588c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:32.103433 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.103333 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5b93e32-61a6-42f7-9b23-a325e9f588c3-klusterlet-config\") pod \"klusterlet-addon-workmgr-787c687cd-6skld\" (UID: \"e5b93e32-61a6-42f7-9b23-a325e9f588c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:32.103433 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.103366 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5b93e32-61a6-42f7-9b23-a325e9f588c3-tmp\") pod \"klusterlet-addon-workmgr-787c687cd-6skld\" (UID: \"e5b93e32-61a6-42f7-9b23-a325e9f588c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:32.204536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.204502 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5b93e32-61a6-42f7-9b23-a325e9f588c3-klusterlet-config\") pod \"klusterlet-addon-workmgr-787c687cd-6skld\" (UID: \"e5b93e32-61a6-42f7-9b23-a325e9f588c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:32.204749 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.204552 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5b93e32-61a6-42f7-9b23-a325e9f588c3-tmp\") pod \"klusterlet-addon-workmgr-787c687cd-6skld\" (UID: \"e5b93e32-61a6-42f7-9b23-a325e9f588c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:32.204749 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.204628 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j77jx\" (UniqueName: \"kubernetes.io/projected/e5b93e32-61a6-42f7-9b23-a325e9f588c3-kube-api-access-j77jx\") pod \"klusterlet-addon-workmgr-787c687cd-6skld\" (UID: \"e5b93e32-61a6-42f7-9b23-a325e9f588c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:32.204995 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.204967 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5b93e32-61a6-42f7-9b23-a325e9f588c3-tmp\") pod \"klusterlet-addon-workmgr-787c687cd-6skld\" (UID: \"e5b93e32-61a6-42f7-9b23-a325e9f588c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:32.206920 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.206900 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5b93e32-61a6-42f7-9b23-a325e9f588c3-klusterlet-config\") pod \"klusterlet-addon-workmgr-787c687cd-6skld\" (UID: \"e5b93e32-61a6-42f7-9b23-a325e9f588c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:32.219739 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.219711 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j77jx\" (UniqueName: \"kubernetes.io/projected/e5b93e32-61a6-42f7-9b23-a325e9f588c3-kube-api-access-j77jx\") pod \"klusterlet-addon-workmgr-787c687cd-6skld\" (UID: \"e5b93e32-61a6-42f7-9b23-a325e9f588c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:32.285368 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.285338 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:32.417026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.416930 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld"] Jul 06 19:25:32.420369 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:32.420340 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b93e32_61a6_42f7_9b23_a325e9f588c3.slice/crio-fb1fdb5e7f4019a0f01437e31d70eff731f76d353b563cdd5c2b42d44e6ba803 WatchSource:0}: Error finding container fb1fdb5e7f4019a0f01437e31d70eff731f76d353b563cdd5c2b42d44e6ba803: Status 404 returned error can't find the container with id fb1fdb5e7f4019a0f01437e31d70eff731f76d353b563cdd5c2b42d44e6ba803 Jul 06 19:25:32.732067 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:32.731980 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" event={"ID":"e5b93e32-61a6-42f7-9b23-a325e9f588c3","Type":"ContainerStarted","Data":"fb1fdb5e7f4019a0f01437e31d70eff731f76d353b563cdd5c2b42d44e6ba803"} Jul 06 19:25:33.495492 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:33.495447 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:33.496031 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:33.495518 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:25:33.496031 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:33.495909 2584 scope.go:117] "RemoveContainer" containerID="8fb0e3e7abc6efff4af5c96e326eb24e30a1a0eda8e111619972af476eb44af2" Jul 06 19:25:33.496173 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:33.496096 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-k8f45_openshift-console-operator(086c7937-63b2-4201-9f1e-fba3d640fb91)\"" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" podUID="086c7937-63b2-4201-9f1e-fba3d640fb91" Jul 06 19:25:35.128895 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:35.128857 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:35.129380 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:35.128907 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:35.129606 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:35.129581 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9096032-bd93-4923-b366-814e541ce48e-service-ca-bundle\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:35.131384 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:35.131359 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9096032-bd93-4923-b366-814e541ce48e-metrics-certs\") pod \"router-default-5947498495-gc2hh\" (UID: \"d9096032-bd93-4923-b366-814e541ce48e\") " pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:35.303692 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:35.303659 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hh8vg\"" Jul 06 19:25:35.310278 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:35.310206 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:36.363160 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:36.363131 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5947498495-gc2hh"] Jul 06 19:25:36.368924 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:36.368891 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9096032_bd93_4923_b366_814e541ce48e.slice/crio-6b0399a5c9b8a077f721a15b15828ae02560d4a3191b85f128c08f7960f5dfbf WatchSource:0}: Error finding container 6b0399a5c9b8a077f721a15b15828ae02560d4a3191b85f128c08f7960f5dfbf: Status 404 returned error can't find the container with id 6b0399a5c9b8a077f721a15b15828ae02560d4a3191b85f128c08f7960f5dfbf Jul 06 19:25:36.747792 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:36.747755 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5947498495-gc2hh" event={"ID":"d9096032-bd93-4923-b366-814e541ce48e","Type":"ContainerStarted","Data":"2b085afaa09bfb0b1908f34de252689cf8f98279593e73adfebec80a788404c8"} Jul 06 19:25:36.747988 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:36.747803 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5947498495-gc2hh" event={"ID":"d9096032-bd93-4923-b366-814e541ce48e","Type":"ContainerStarted","Data":"6b0399a5c9b8a077f721a15b15828ae02560d4a3191b85f128c08f7960f5dfbf"} Jul 06 19:25:36.748996 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:36.748972 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" event={"ID":"e5b93e32-61a6-42f7-9b23-a325e9f588c3","Type":"ContainerStarted","Data":"8e3facf028e26b075a3a54e0e65ab20c74c5d3b88ae52fb71938eb42661fbcec"} Jul 06 19:25:36.749238 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:36.749224 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:36.750806 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:36.750791 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" Jul 06 19:25:36.857139 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:36.857091 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5947498495-gc2hh" podStartSLOduration=33.857076668 podStartE2EDuration="33.857076668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:36.790441199 +0000 UTC m=+128.163969899" watchObservedRunningTime="2026-07-06 19:25:36.857076668 +0000 UTC m=+128.230605364" Jul 06 19:25:36.857667 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:36.857644 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c687cd-6skld" podStartSLOduration=2.00955344 podStartE2EDuration="5.857619256s" totalImagesPullingTime="3.848065816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:36.856111295 +0000 UTC m=+128.229639984" watchObservedRunningTime="2026-07-06 19:25:36.857619256 +0000 UTC m=+128.231147987" Jul 06 19:25:37.310870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:37.310835 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:37.313223 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:37.313200 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:37.752298 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:37.752217 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:37.753506 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:37.753485 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5947498495-gc2hh" Jul 06 19:25:38.355154 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:38.355113 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:38.357293 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:38.357274 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87cb2b2a-f22d-4810-908e-5dde5f336f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqkn9\" (UID: \"87cb2b2a-f22d-4810-908e-5dde5f336f24\") " pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:38.628279 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:38.628198 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4gc24\"" Jul 06 19:25:38.636434 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:38.636420 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bqkn9" Jul 06 19:25:38.782147 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:38.782070 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bqkn9"] Jul 06 19:25:38.784576 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:38.784550 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cb2b2a_f22d_4810_908e_5dde5f336f24.slice/crio-82f0effd72fc6ee087873e79c9d3807613f99ba2097b537c5621ffbc95c40a74 WatchSource:0}: Error finding container 82f0effd72fc6ee087873e79c9d3807613f99ba2097b537c5621ffbc95c40a74: Status 404 returned error can't find the container with id 82f0effd72fc6ee087873e79c9d3807613f99ba2097b537c5621ffbc95c40a74 Jul 06 19:25:39.105474 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.105441 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh"] Jul 06 19:25:39.108150 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.108135 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh" Jul 06 19:25:39.111358 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.111338 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 19:25:39.111622 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.111605 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ck5gr\"" Jul 06 19:25:39.160338 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.160307 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:25:39.162548 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.162525 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c02955a-69f5-44b2-8f38-566209f69065-metrics-certs\") pod \"network-metrics-daemon-xn49t\" (UID: \"3c02955a-69f5-44b2-8f38-566209f69065\") " pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:25:39.192825 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.192799 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh"] Jul 06 19:25:39.261591 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.261560 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2ebe7053-1af7-4e5d-8548-453e74faab21-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-94rxh\" (UID: \"2ebe7053-1af7-4e5d-8548-453e74faab21\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh" Jul 06 19:25:39.264211 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.264192 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9fn8h\"" Jul 06 19:25:39.271679 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.271659 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xn49t" Jul 06 19:25:39.366015 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.364615 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2ebe7053-1af7-4e5d-8548-453e74faab21-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-94rxh\" (UID: \"2ebe7053-1af7-4e5d-8548-453e74faab21\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh" Jul 06 19:25:39.377313 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.377283 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2ebe7053-1af7-4e5d-8548-453e74faab21-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-94rxh\" (UID: \"2ebe7053-1af7-4e5d-8548-453e74faab21\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh" Jul 06 19:25:39.417851 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.417816 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh" Jul 06 19:25:39.435590 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.435492 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xn49t"] Jul 06 19:25:39.442758 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:39.442726 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c02955a_69f5_44b2_8f38_566209f69065.slice/crio-e68ad417e38ad6e25beb891900302634b8280cb484f1786e47776ae6f1db8908 WatchSource:0}: Error finding container e68ad417e38ad6e25beb891900302634b8280cb484f1786e47776ae6f1db8908: Status 404 returned error can't find the container with id e68ad417e38ad6e25beb891900302634b8280cb484f1786e47776ae6f1db8908 Jul 06 19:25:39.599842 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.599752 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh"] Jul 06 19:25:39.604852 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:39.604814 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ebe7053_1af7_4e5d_8548_453e74faab21.slice/crio-d4a4ccd8984bc394ef0e30d4d3f73bbd679b78ab61e9cf05b94ad4e8b8d0ffc4 WatchSource:0}: Error finding container d4a4ccd8984bc394ef0e30d4d3f73bbd679b78ab61e9cf05b94ad4e8b8d0ffc4: Status 404 returned error can't find the container with id d4a4ccd8984bc394ef0e30d4d3f73bbd679b78ab61e9cf05b94ad4e8b8d0ffc4 Jul 06 19:25:39.761696 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.761530 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xn49t" event={"ID":"3c02955a-69f5-44b2-8f38-566209f69065","Type":"ContainerStarted","Data":"e68ad417e38ad6e25beb891900302634b8280cb484f1786e47776ae6f1db8908"} Jul 06 19:25:39.763204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.763174 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh" event={"ID":"2ebe7053-1af7-4e5d-8548-453e74faab21","Type":"ContainerStarted","Data":"d4a4ccd8984bc394ef0e30d4d3f73bbd679b78ab61e9cf05b94ad4e8b8d0ffc4"} Jul 06 19:25:39.764532 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:39.764504 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqkn9" event={"ID":"87cb2b2a-f22d-4810-908e-5dde5f336f24","Type":"ContainerStarted","Data":"82f0effd72fc6ee087873e79c9d3807613f99ba2097b537c5621ffbc95c40a74"} Jul 06 19:25:43.779564 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:43.779527 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xn49t" event={"ID":"3c02955a-69f5-44b2-8f38-566209f69065","Type":"ContainerStarted","Data":"6040883d756891cb8d2c24391b9d846dc96c80bdfb850b7b6ad153b916c4ffd1"} Jul 06 19:25:43.779954 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:43.779617 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xn49t" event={"ID":"3c02955a-69f5-44b2-8f38-566209f69065","Type":"ContainerStarted","Data":"de2e5fcee29ef7aff1b6bbc05d52e4ee8b3550a5e53df6b17387521d3e6469d6"} Jul 06 19:25:43.781075 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:43.781052 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh" event={"ID":"2ebe7053-1af7-4e5d-8548-453e74faab21","Type":"ContainerStarted","Data":"65f1277cd12bdfd6f6294f809a778649f7f7a98212e80433f4589a7eab791c27"} Jul 06 19:25:43.781219 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:43.781204 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh" Jul 06 19:25:43.782820 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:43.782793 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqkn9" event={"ID":"87cb2b2a-f22d-4810-908e-5dde5f336f24","Type":"ContainerStarted","Data":"7f2ace1b32e07219af19b9e20d4c63ed47707a3dd3312ef5a1d63401194f21ee"} Jul 06 19:25:43.782893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:43.782850 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqkn9" event={"ID":"87cb2b2a-f22d-4810-908e-5dde5f336f24","Type":"ContainerStarted","Data":"a219ad17d510a525b0ac17d8419827b396c8812e33f0c515c3b8afe3374b645c"} Jul 06 19:25:43.786193 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:43.786175 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh" Jul 06 19:25:43.806749 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:43.806703 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xn49t" podStartSLOduration=130.265441566 podStartE2EDuration="2m13.806690337s" totalImagesPullingTime="3.541248771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:43.804459721 +0000 UTC m=+135.177988412" watchObservedRunningTime="2026-07-06 19:25:43.806690337 +0000 UTC m=+135.180219027" Jul 06 19:25:43.824936 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:43.824898 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-94rxh" podStartSLOduration=1.4433201900000001 podStartE2EDuration="4.824886408s" totalImagesPullingTime="3.381566218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:43.824656504 +0000 UTC m=+135.198185193" watchObservedRunningTime="2026-07-06 19:25:43.824886408 +0000 UTC m=+135.198415077" Jul 06 19:25:46.797213 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:46.797183 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqkn9" event={"ID":"87cb2b2a-f22d-4810-908e-5dde5f336f24","Type":"ContainerStarted","Data":"3b7ed924557c21ae7c326f2d9f3ab271a515f4e4a4260cc0f03952a699e7bf4d"} Jul 06 19:25:46.831937 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:46.831893 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bqkn9" podStartSLOduration=33.543937983 podStartE2EDuration="40.831872988s" totalImagesPullingTime="7.287935005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:46.830268456 +0000 UTC m=+138.203797159" watchObservedRunningTime="2026-07-06 19:25:46.831872988 +0000 UTC m=+138.205401677" Jul 06 19:25:48.250029 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:48.250000 2584 scope.go:117] "RemoveContainer" containerID="8fb0e3e7abc6efff4af5c96e326eb24e30a1a0eda8e111619972af476eb44af2" Jul 06 19:25:48.250400 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:25:48.250159 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-k8f45_openshift-console-operator(086c7937-63b2-4201-9f1e-fba3d640fb91)\"" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" podUID="086c7937-63b2-4201-9f1e-fba3d640fb91" Jul 06 19:25:49.720750 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.720709 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx"] Jul 06 19:25:49.723845 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.723830 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.737473 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.737453 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:25:49.738646 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.738618 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:25:49.742706 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.742678 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 19:25:49.742833 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.742689 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 19:25:49.742833 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.742765 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9vfjp\"" Jul 06 19:25:49.742833 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.742815 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:25:49.758352 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.758327 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx"] Jul 06 19:25:49.805994 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.805964 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k295w"] Jul 06 19:25:49.809411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.809391 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:49.837907 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.837881 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:25:49.838059 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.837883 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:25:49.843397 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.843377 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca9d451c-aedb-451d-85cf-51159fefeb60-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.843506 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.843414 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca9d451c-aedb-451d-85cf-51159fefeb60-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.843506 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.843455 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gj85\" (UniqueName: \"kubernetes.io/projected/ca9d451c-aedb-451d-85cf-51159fefeb60-kube-api-access-9gj85\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.843506 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.843496 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca9d451c-aedb-451d-85cf-51159fefeb60-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.851231 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.851211 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c5qsj\"" Jul 06 19:25:49.851368 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.851351 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:25:49.944461 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.944430 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca9d451c-aedb-451d-85cf-51159fefeb60-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.944658 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.944467 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-tls\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:49.944658 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.944498 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltxsr\" (UniqueName: \"kubernetes.io/projected/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-kube-api-access-ltxsr\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:49.944658 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.944526 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca9d451c-aedb-451d-85cf-51159fefeb60-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.944658 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.944586 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-sys\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:49.944809 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.944673 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-root\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:49.944809 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.944709 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-wtmp\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:49.944809 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.944783 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gj85\" (UniqueName: \"kubernetes.io/projected/ca9d451c-aedb-451d-85cf-51159fefeb60-kube-api-access-9gj85\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.944942 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.944814 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:49.944942 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.944851 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca9d451c-aedb-451d-85cf-51159fefeb60-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.945044 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.945003 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-metrics-client-ca\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:49.945099 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.945050 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:49.945099 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.945084 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-textfile\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:49.945275 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.945259 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca9d451c-aedb-451d-85cf-51159fefeb60-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.947645 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.947607 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca9d451c-aedb-451d-85cf-51159fefeb60-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.947737 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.947681 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca9d451c-aedb-451d-85cf-51159fefeb60-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:49.992274 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:49.992211 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gj85\" (UniqueName: \"kubernetes.io/projected/ca9d451c-aedb-451d-85cf-51159fefeb60-kube-api-access-9gj85\") pod \"openshift-state-metrics-54cf96dfcf-r6hfx\" (UID: \"ca9d451c-aedb-451d-85cf-51159fefeb60\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:50.031994 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.031966 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" Jul 06 19:25:50.046139 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046120 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-metrics-client-ca\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046260 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046145 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046260 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046164 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-textfile\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046369 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046296 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-tls\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046369 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046346 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxsr\" (UniqueName: \"kubernetes.io/projected/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-kube-api-access-ltxsr\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046476 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046382 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-sys\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046476 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046414 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-root\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046476 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046445 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-wtmp\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046476 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046466 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-textfile\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046703 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046475 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046703 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046531 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-sys\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046703 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046618 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-root\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046857 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046750 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-wtmp\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046857 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046779 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.046857 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.046835 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-metrics-client-ca\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.048751 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.048726 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-tls\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.048918 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.048899 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.075605 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.075557 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltxsr\" (UniqueName: \"kubernetes.io/projected/2fe0196a-27f7-4465-a7cb-3880bcf8abd9-kube-api-access-ltxsr\") pod \"node-exporter-k295w\" (UID: \"2fe0196a-27f7-4465-a7cb-3880bcf8abd9\") " pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.119783 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.119754 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k295w" Jul 06 19:25:50.132929 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:50.132904 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe0196a_27f7_4465_a7cb_3880bcf8abd9.slice/crio-f04e11fdf928b15f3f5d46f454ea52566b355a01a85ffe8183bd1c5bae98b830 WatchSource:0}: Error finding container f04e11fdf928b15f3f5d46f454ea52566b355a01a85ffe8183bd1c5bae98b830: Status 404 returned error can't find the container with id f04e11fdf928b15f3f5d46f454ea52566b355a01a85ffe8183bd1c5bae98b830 Jul 06 19:25:50.167521 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.167495 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx"] Jul 06 19:25:50.170098 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:50.170077 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9d451c_aedb_451d_85cf_51159fefeb60.slice/crio-a5dd73721c3a6eb5f554a40079023433ff3c6b79ff6138c560f141f4d553aef2 WatchSource:0}: Error finding container a5dd73721c3a6eb5f554a40079023433ff3c6b79ff6138c560f141f4d553aef2: Status 404 returned error can't find the container with id a5dd73721c3a6eb5f554a40079023433ff3c6b79ff6138c560f141f4d553aef2 Jul 06 19:25:50.763308 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.763273 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:25:50.767349 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.767317 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.776927 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.776772 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:25:50.776927 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.776793 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:25:50.776927 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.776817 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:25:50.777132 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.777040 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:25:50.777181 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.777155 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:25:50.777427 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.777400 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:25:50.777503 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.777434 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qfn9s\"" Jul 06 19:25:50.777901 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.777761 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:25:50.777901 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.777816 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:25:50.777901 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.777878 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:25:50.798160 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.798139 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:25:50.816559 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.816528 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" event={"ID":"ca9d451c-aedb-451d-85cf-51159fefeb60","Type":"ContainerStarted","Data":"2aab71f1f0a32890f64b4c9c46f781f03a2e7475690d5ecf388bd371a22b53b3"} Jul 06 19:25:50.816723 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.816608 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" event={"ID":"ca9d451c-aedb-451d-85cf-51159fefeb60","Type":"ContainerStarted","Data":"8f373d9bdcf217d03ca7d5a9fd81293571d68c565158d98a5e4b71fbd8ad4279"} Jul 06 19:25:50.816723 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.816658 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" event={"ID":"ca9d451c-aedb-451d-85cf-51159fefeb60","Type":"ContainerStarted","Data":"a5dd73721c3a6eb5f554a40079023433ff3c6b79ff6138c560f141f4d553aef2"} Jul 06 19:25:50.817850 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.817823 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k295w" event={"ID":"2fe0196a-27f7-4465-a7cb-3880bcf8abd9","Type":"ContainerStarted","Data":"f04e11fdf928b15f3f5d46f454ea52566b355a01a85ffe8183bd1c5bae98b830"} Jul 06 19:25:50.954405 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954363 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.954571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954418 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-config-volume\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.954571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954450 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.954571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954475 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.954571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954504 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-web-config\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.954571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954534 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.954571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954562 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.954889 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954595 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.954889 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954661 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-config-out\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.954889 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954730 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.954889 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954823 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.954889 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954851 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6l5c\" (UniqueName: \"kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-kube-api-access-r6l5c\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:50.955089 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:50.954897 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056094 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056047 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056286 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056126 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056286 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056161 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-config-volume\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056286 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056286 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056214 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056286 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056239 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-web-config\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056286 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056268 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056589 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056310 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056589 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056338 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056589 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056364 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-config-out\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056589 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056397 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056589 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056448 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056589 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056479 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6l5c\" (UniqueName: \"kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-kube-api-access-r6l5c\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.056589 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.056493 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.057432 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.057142 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.060902 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.059620 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-web-config\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.060902 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.060576 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.060902 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.060862 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.061146 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.061122 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.061422 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.061397 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.061557 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.061514 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-config-out\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.062129 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.061973 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.062129 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.062089 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.063354 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.063283 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-config-volume\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.063750 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.063713 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.070713 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.070679 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6l5c\" (UniqueName: \"kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-kube-api-access-r6l5c\") pod \"alertmanager-main-0\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.078475 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.078457 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:25:51.316438 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.316410 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:25:51.479493 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:51.479459 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb157ec82_aa0a_4709_8a69_a078471ec03c.slice/crio-17ae4965227203bd8c67f1ae717722ee840787fe4ff0b474836e426539176f15 WatchSource:0}: Error finding container 17ae4965227203bd8c67f1ae717722ee840787fe4ff0b474836e426539176f15: Status 404 returned error can't find the container with id 17ae4965227203bd8c67f1ae717722ee840787fe4ff0b474836e426539176f15 Jul 06 19:25:51.825988 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.825910 2584 generic.go:356] "Generic (PLEG): container finished" podID="2fe0196a-27f7-4465-a7cb-3880bcf8abd9" containerID="5c564feb82208962df7cd17cf6e28ff3758cbb7c3b3f5a7225b3fe14206e1090" exitCode=0 Jul 06 19:25:51.826381 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.826000 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k295w" event={"ID":"2fe0196a-27f7-4465-a7cb-3880bcf8abd9","Type":"ContainerDied","Data":"5c564feb82208962df7cd17cf6e28ff3758cbb7c3b3f5a7225b3fe14206e1090"} Jul 06 19:25:51.828068 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.828046 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" event={"ID":"ca9d451c-aedb-451d-85cf-51159fefeb60","Type":"ContainerStarted","Data":"b9a2e8c3bb36e0d7db60078e112c7be3dfdd69b2d0b77baa465326d6b4d8ce0c"} Jul 06 19:25:51.829222 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:51.829199 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerStarted","Data":"17ae4965227203bd8c67f1ae717722ee840787fe4ff0b474836e426539176f15"} Jul 06 19:25:52.834996 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:52.834971 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k295w" event={"ID":"2fe0196a-27f7-4465-a7cb-3880bcf8abd9","Type":"ContainerStarted","Data":"cde366da1e8dd3f8cf25e9ef45c944319fe09e1c3799691e953262e7c1bffec4"} Jul 06 19:25:52.835367 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:52.835022 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k295w" event={"ID":"2fe0196a-27f7-4465-a7cb-3880bcf8abd9","Type":"ContainerStarted","Data":"5fa4b1bfa2c16fcbfa76a7d12c30985c65a91fccbcb3be88df1ac0583b7a3a43"} Jul 06 19:25:52.836550 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:52.836526 2584 generic.go:356] "Generic (PLEG): container finished" podID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerID="d978e6e05761aad53c0a918f065c4ac0696c234f053c7d300e12d3c4492b9324" exitCode=0 Jul 06 19:25:52.836675 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:52.836603 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerDied","Data":"d978e6e05761aad53c0a918f065c4ac0696c234f053c7d300e12d3c4492b9324"} Jul 06 19:25:52.891996 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:52.891940 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r6hfx" podStartSLOduration=2.6443055859999998 podStartE2EDuration="3.891921778s" totalImagesPullingTime="1.247616192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:51.889986392 +0000 UTC m=+143.263515095" watchObservedRunningTime="2026-07-06 19:25:52.891921778 +0000 UTC m=+144.265450470" Jul 06 19:25:52.892106 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:52.892062 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k295w" podStartSLOduration=2.7585483 podStartE2EDuration="3.892054484s" totalImagesPullingTime="1.064095639s" totalInitContainerRuntime="69.410545ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:52.891860047 +0000 UTC m=+144.265388738" watchObservedRunningTime="2026-07-06 19:25:52.892054484 +0000 UTC m=+144.265583174" Jul 06 19:25:54.356304 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.356268 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6876d8589b-8tt6d"] Jul 06 19:25:54.360854 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.360834 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.364891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.364715 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zjpzg\"" Jul 06 19:25:54.364891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.364738 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 19:25:54.364891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.364771 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 19:25:54.364891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.364720 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 19:25:54.364891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.364771 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 19:25:54.364891 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.364720 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b6sgjc1dmf00b\"" Jul 06 19:25:54.373317 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.373293 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6876d8589b-8tt6d"] Jul 06 19:25:54.387795 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.387777 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2dns\" (UniqueName: \"kubernetes.io/projected/c2d8f152-3233-4880-8ba2-3709c1e59408-kube-api-access-x2dns\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.387887 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.387814 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d8f152-3233-4880-8ba2-3709c1e59408-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.387887 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.387858 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c2d8f152-3233-4880-8ba2-3709c1e59408-audit-log\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.387982 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.387903 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c2d8f152-3233-4880-8ba2-3709c1e59408-secret-metrics-server-tls\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.387982 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.387943 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2d8f152-3233-4880-8ba2-3709c1e59408-client-ca-bundle\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.387982 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.387975 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c2d8f152-3233-4880-8ba2-3709c1e59408-secret-metrics-server-client-certs\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.388069 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.388054 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c2d8f152-3233-4880-8ba2-3709c1e59408-metrics-server-audit-profiles\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.488425 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.488389 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2d8f152-3233-4880-8ba2-3709c1e59408-client-ca-bundle\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.488425 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.488430 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c2d8f152-3233-4880-8ba2-3709c1e59408-secret-metrics-server-client-certs\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.488671 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.488466 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c2d8f152-3233-4880-8ba2-3709c1e59408-metrics-server-audit-profiles\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.488671 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.488497 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2dns\" (UniqueName: \"kubernetes.io/projected/c2d8f152-3233-4880-8ba2-3709c1e59408-kube-api-access-x2dns\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.488671 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.488521 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d8f152-3233-4880-8ba2-3709c1e59408-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.489265 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.488883 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c2d8f152-3233-4880-8ba2-3709c1e59408-audit-log\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.489265 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.488953 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c2d8f152-3233-4880-8ba2-3709c1e59408-secret-metrics-server-tls\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.489265 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.489222 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c2d8f152-3233-4880-8ba2-3709c1e59408-audit-log\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.489465 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.489265 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d8f152-3233-4880-8ba2-3709c1e59408-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.489528 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.489497 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c2d8f152-3233-4880-8ba2-3709c1e59408-metrics-server-audit-profiles\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.491008 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.490988 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c2d8f152-3233-4880-8ba2-3709c1e59408-secret-metrics-server-client-certs\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.491400 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.491379 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c2d8f152-3233-4880-8ba2-3709c1e59408-secret-metrics-server-tls\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.491464 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.491397 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2d8f152-3233-4880-8ba2-3709c1e59408-client-ca-bundle\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.502031 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.502011 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2dns\" (UniqueName: \"kubernetes.io/projected/c2d8f152-3233-4880-8ba2-3709c1e59408-kube-api-access-x2dns\") pod \"metrics-server-6876d8589b-8tt6d\" (UID: \"c2d8f152-3233-4880-8ba2-3709c1e59408\") " pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.672174 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.672144 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:25:54.827290 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.827270 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6876d8589b-8tt6d"] Jul 06 19:25:54.829116 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:54.829091 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d8f152_3233_4880_8ba2_3709c1e59408.slice/crio-0e86ffe39f4b789b172838505e15a7cba98d583eb5b0f9bcd0a3a25af10fe8a2 WatchSource:0}: Error finding container 0e86ffe39f4b789b172838505e15a7cba98d583eb5b0f9bcd0a3a25af10fe8a2: Status 404 returned error can't find the container with id 0e86ffe39f4b789b172838505e15a7cba98d583eb5b0f9bcd0a3a25af10fe8a2 Jul 06 19:25:54.847016 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.846995 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerStarted","Data":"8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3"} Jul 06 19:25:54.847109 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.847060 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerStarted","Data":"b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951"} Jul 06 19:25:54.847109 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.847094 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerStarted","Data":"6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323"} Jul 06 19:25:54.847212 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.847128 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerStarted","Data":"42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3"} Jul 06 19:25:54.847212 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.847153 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerStarted","Data":"93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a"} Jul 06 19:25:54.848063 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:54.848040 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" event={"ID":"c2d8f152-3233-4880-8ba2-3709c1e59408","Type":"ContainerStarted","Data":"0e86ffe39f4b789b172838505e15a7cba98d583eb5b0f9bcd0a3a25af10fe8a2"} Jul 06 19:25:55.855708 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:55.855672 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerStarted","Data":"beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb"} Jul 06 19:25:55.908134 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:55.908039 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.147420673 podStartE2EDuration="5.908024953s" totalImagesPullingTime="3.74411281s" totalInitContainerRuntime="16.49147ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:55.907308929 +0000 UTC m=+147.280837620" watchObservedRunningTime="2026-07-06 19:25:55.908024953 +0000 UTC m=+147.281553643" Jul 06 19:25:56.102963 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.102928 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:25:56.107315 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.107292 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.116927 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.116904 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 19:25:56.117192 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.117175 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 19:25:56.117344 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.117322 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 19:25:56.117424 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.117365 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 19:25:56.117424 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.117390 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zcq5r\"" Jul 06 19:25:56.117599 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.117580 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 19:25:56.117872 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.117733 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 19:25:56.117872 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.117739 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 19:25:56.118010 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.117928 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 19:25:56.118010 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.117954 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 19:25:56.118221 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.118190 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 19:25:56.118315 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.118300 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 19:25:56.118382 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.118316 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-if1ipidh40lh\"" Jul 06 19:25:56.118382 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.118319 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 19:25:56.119241 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.119222 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 19:25:56.126135 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.126113 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 19:25:56.128035 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.128006 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:25:56.202914 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.202841 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.202914 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.202880 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.202914 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.202908 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203129 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.202965 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203129 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.202991 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203129 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203030 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203129 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203057 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203129 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203075 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203129 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203093 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203388 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203148 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203388 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203174 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203388 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203200 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203388 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203216 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203388 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203243 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203388 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203267 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203388 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203302 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-config\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203388 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203319 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8qml\" (UniqueName: \"kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-kube-api-access-c8qml\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203388 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203364 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203672 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203419 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.203672 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.203436 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.303924 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.303902 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304012 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.303935 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304012 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.303960 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304094 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304074 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304132 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304118 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304183 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304154 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304237 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304180 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304237 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304210 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304334 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304239 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304334 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304275 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304334 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304304 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304493 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304334 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304493 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304363 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304493 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304392 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304493 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304424 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304493 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304451 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-config\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304493 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304473 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8qml\" (UniqueName: \"kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-kube-api-access-c8qml\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304789 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304502 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304789 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304571 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304789 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304597 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.304942 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.304910 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.306615 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.305902 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.306615 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.305998 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.306615 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.306499 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.308425 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.307117 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.308425 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.307204 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.308425 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.307400 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.308425 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.307782 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.308425 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.308133 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.308425 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.308369 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.308832 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.308718 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.309507 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.309460 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.310219 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.310193 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.310424 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.310400 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.310711 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.310692 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-config\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.310929 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.310909 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.311387 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.311360 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.311478 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.311458 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.311527 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.311518 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.320727 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.320702 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8qml\" (UniqueName: \"kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-kube-api-access-c8qml\") pod \"prometheus-k8s-0\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.417907 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.417872 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:25:56.565776 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.565751 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:25:56.568259 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:25:56.568236 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba30e43e_598a_47d1_a850_6896dadde2ce.slice/crio-a69fbd38896ef7e3f51986864882d70071beafded5858f41503c9285e6112e7a WatchSource:0}: Error finding container a69fbd38896ef7e3f51986864882d70071beafded5858f41503c9285e6112e7a: Status 404 returned error can't find the container with id a69fbd38896ef7e3f51986864882d70071beafded5858f41503c9285e6112e7a Jul 06 19:25:56.860950 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.860918 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" event={"ID":"c2d8f152-3233-4880-8ba2-3709c1e59408","Type":"ContainerStarted","Data":"0f15f782f30cebd831a78a6f7ef7d3df2c7f55868112be00b8bf53b25b57dc85"} Jul 06 19:25:56.862444 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.862422 2584 generic.go:356] "Generic (PLEG): container finished" podID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerID="4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285" exitCode=0 Jul 06 19:25:56.862557 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.862510 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerDied","Data":"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285"} Jul 06 19:25:56.862616 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.862580 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerStarted","Data":"a69fbd38896ef7e3f51986864882d70071beafded5858f41503c9285e6112e7a"} Jul 06 19:25:56.889561 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:56.889049 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" podStartSLOduration=1.480389696 podStartE2EDuration="2.889031389s" totalImagesPullingTime="1.408641693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:56.888442383 +0000 UTC m=+148.261971075" watchObservedRunningTime="2026-07-06 19:25:56.889031389 +0000 UTC m=+148.262560081" Jul 06 19:25:59.252871 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:25:59.252838 2584 scope.go:117] "RemoveContainer" containerID="8fb0e3e7abc6efff4af5c96e326eb24e30a1a0eda8e111619972af476eb44af2" Jul 06 19:26:00.883705 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:00.883671 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:26:00.884345 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:00.883794 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" event={"ID":"086c7937-63b2-4201-9f1e-fba3d640fb91","Type":"ContainerStarted","Data":"628e80548d34cc951d3b84688b95b5357e3553192af2b415a9ae339629b709ba"} Jul 06 19:26:00.884345 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:00.884274 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:26:00.886955 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:00.886930 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerStarted","Data":"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09"} Jul 06 19:26:00.887078 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:00.886997 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerStarted","Data":"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4"} Jul 06 19:26:00.908164 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:00.908110 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" podStartSLOduration=55.381094153 podStartE2EDuration="57.908094544s" totalImagesPullingTime="2.527000391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:00.905491358 +0000 UTC m=+152.279020050" watchObservedRunningTime="2026-07-06 19:26:00.908094544 +0000 UTC m=+152.281623235" Jul 06 19:26:01.166426 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:01.166338 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-k8f45" Jul 06 19:26:02.898334 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:02.898299 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerStarted","Data":"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee"} Jul 06 19:26:02.898714 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:02.898384 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerStarted","Data":"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab"} Jul 06 19:26:02.898714 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:02.898413 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerStarted","Data":"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f"} Jul 06 19:26:02.898714 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:02.898439 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerStarted","Data":"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc"} Jul 06 19:26:06.418806 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:06.418769 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:26:07.389484 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:26:07.389448 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gmtjr" podUID="f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d" Jul 06 19:26:07.920488 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:07.920457 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gmtjr" Jul 06 19:26:12.245855 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:12.245823 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:26:12.248179 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:12.248156 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d-metrics-tls\") pod \"dns-default-gmtjr\" (UID: \"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d\") " pod="openshift-dns/dns-default-gmtjr" Jul 06 19:26:12.423823 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:12.423793 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9s652\"" Jul 06 19:26:12.431363 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:12.431343 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gmtjr" Jul 06 19:26:12.577058 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:12.576999 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=11.688712101 podStartE2EDuration="16.576976626s" totalImagesPullingTime="4.870407166s" totalInitContainerRuntime="17.857359ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:02.969984711 +0000 UTC m=+154.343513401" watchObservedRunningTime="2026-07-06 19:26:12.576976626 +0000 UTC m=+163.950505318" Jul 06 19:26:12.577478 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:12.577461 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gmtjr"] Jul 06 19:26:12.579920 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:26:12.579887 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53f24c4_2baf_44a1_90e0_1ccb2dcfb87d.slice/crio-5943530b707c004b899c0b1fc2624dfc187e0e113395aed0d72b0177e423bc64 WatchSource:0}: Error finding container 5943530b707c004b899c0b1fc2624dfc187e0e113395aed0d72b0177e423bc64: Status 404 returned error can't find the container with id 5943530b707c004b899c0b1fc2624dfc187e0e113395aed0d72b0177e423bc64 Jul 06 19:26:12.944168 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:12.944132 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gmtjr" event={"ID":"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d","Type":"ContainerStarted","Data":"5943530b707c004b899c0b1fc2624dfc187e0e113395aed0d72b0177e423bc64"} Jul 06 19:26:14.672944 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:14.672911 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:26:14.673369 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:14.673001 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:26:14.954408 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:14.954330 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gmtjr" event={"ID":"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d","Type":"ContainerStarted","Data":"0a111422bd30709a2c07b7f82390e6faade115d6478269ba2d436e73f13eb7d8"} Jul 06 19:26:14.954408 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:14.954385 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gmtjr" event={"ID":"f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d","Type":"ContainerStarted","Data":"80371b39ff717dbaa2b4db0283a012d825d04394ef917060b2dc5987811a2b45"} Jul 06 19:26:15.958065 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:15.958038 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gmtjr" Jul 06 19:26:25.963761 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:25.963686 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gmtjr" Jul 06 19:26:25.999542 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:25.999499 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gmtjr" podStartSLOduration=140.493606884 podStartE2EDuration="2m21.999482903s" totalImagesPullingTime="1.505876019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:15.075067215 +0000 UTC m=+166.448595904" watchObservedRunningTime="2026-07-06 19:26:25.999482903 +0000 UTC m=+177.373011598" Jul 06 19:26:34.677643 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:34.677601 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:26:34.681397 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:34.681375 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6876d8589b-8tt6d" Jul 06 19:26:43.065475 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:43.065444 2584 generic.go:356] "Generic (PLEG): container finished" podID="6b749bfc-a221-4940-b866-fc835b02e562" containerID="a152bdc45a0cfb247985bab6e60974cadee755a124e9a4d7c8579621712cd07f" exitCode=0 Jul 06 19:26:43.065915 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:43.065491 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" event={"ID":"6b749bfc-a221-4940-b866-fc835b02e562","Type":"ContainerDied","Data":"a152bdc45a0cfb247985bab6e60974cadee755a124e9a4d7c8579621712cd07f"} Jul 06 19:26:43.065915 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:43.065806 2584 scope.go:117] "RemoveContainer" containerID="a152bdc45a0cfb247985bab6e60974cadee755a124e9a4d7c8579621712cd07f" Jul 06 19:26:44.072071 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:44.072038 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bcfdc" event={"ID":"6b749bfc-a221-4940-b866-fc835b02e562","Type":"ContainerStarted","Data":"36ac55ce3dc49c25e9e76da85a5e292a9e1613dc0b6ea1f34e196b88cde5fc0e"} Jul 06 19:26:56.418816 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:56.418772 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:26:56.434133 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:56.434112 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:26:57.159060 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:26:57.159033 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:10.308285 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:10.308253 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:27:10.308796 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:10.308659 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="alertmanager" containerID="cri-o://93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a" gracePeriod=120 Jul 06 19:27:10.308865 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:10.308708 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy-metric" containerID="cri-o://8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3" gracePeriod=120 Jul 06 19:27:10.308865 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:10.308806 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy" containerID="cri-o://b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951" gracePeriod=120 Jul 06 19:27:10.308865 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:10.308795 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="config-reloader" containerID="cri-o://42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3" gracePeriod=120 Jul 06 19:27:10.309002 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:10.308964 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="prom-label-proxy" containerID="cri-o://beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb" gracePeriod=120 Jul 06 19:27:10.309056 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:10.308990 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy-web" containerID="cri-o://6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323" gracePeriod=120 Jul 06 19:27:11.201848 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.201813 2584 generic.go:356] "Generic (PLEG): container finished" podID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerID="beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb" exitCode=0 Jul 06 19:27:11.201848 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.201842 2584 generic.go:356] "Generic (PLEG): container finished" podID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerID="b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951" exitCode=0 Jul 06 19:27:11.201848 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.201848 2584 generic.go:356] "Generic (PLEG): container finished" podID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerID="6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323" exitCode=0 Jul 06 19:27:11.201848 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.201854 2584 generic.go:356] "Generic (PLEG): container finished" podID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerID="42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3" exitCode=0 Jul 06 19:27:11.202107 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.201862 2584 generic.go:356] "Generic (PLEG): container finished" podID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerID="93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a" exitCode=0 Jul 06 19:27:11.202107 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.201875 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerDied","Data":"beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb"} Jul 06 19:27:11.202107 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.201941 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerDied","Data":"b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951"} Jul 06 19:27:11.202107 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.201968 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerDied","Data":"6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323"} Jul 06 19:27:11.202107 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.201994 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerDied","Data":"42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3"} Jul 06 19:27:11.202107 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.202018 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerDied","Data":"93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a"} Jul 06 19:27:11.562346 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.562322 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:11.641536 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641505 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-config-volume\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.641715 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641544 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-config-out\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.641715 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641588 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.641715 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641627 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-trusted-ca-bundle\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.641715 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641691 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-web\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.641938 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641724 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-web-config\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.641938 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641761 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6l5c\" (UniqueName: \"kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-kube-api-access-r6l5c\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.641938 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641793 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-main-db\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.641938 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641825 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-main-tls\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.641938 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641874 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-tls-assets\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.641938 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641912 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-metrics-client-ca\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.642233 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641943 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.642233 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.641969 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-cluster-tls-config\") pod \"b157ec82-aa0a-4709-8a69-a078471ec03c\" (UID: \"b157ec82-aa0a-4709-8a69-a078471ec03c\") " Jul 06 19:27:11.642468 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.642437 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:27:11.642983 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.642954 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:11.643162 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.643136 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:11.644804 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.644458 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:11.644916 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.644852 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-config-out" (OuterVolumeSpecName: "config-out") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:27:11.644916 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.644875 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-config-volume" (OuterVolumeSpecName: "config-volume") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:11.645538 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.645479 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-kube-api-access-r6l5c" (OuterVolumeSpecName: "kube-api-access-r6l5c") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "kube-api-access-r6l5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:27:11.645538 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.645499 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:27:11.646008 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.645970 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:11.646463 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.646426 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:11.646606 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.646582 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:11.649781 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.649754 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:11.656560 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.656541 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-web-config" (OuterVolumeSpecName: "web-config") pod "b157ec82-aa0a-4709-8a69-a078471ec03c" (UID: "b157ec82-aa0a-4709-8a69-a078471ec03c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:11.743152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743080 2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-metrics-client-ca\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743105 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743115 2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-cluster-tls-config\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743123 2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-config-volume\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743132 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-config-out\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743140 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743149 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743158 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743477 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743166 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-web-config\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743477 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743174 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6l5c\" (UniqueName: \"kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-kube-api-access-r6l5c\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743477 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743183 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b157ec82-aa0a-4709-8a69-a078471ec03c-alertmanager-main-db\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743477 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743191 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b157ec82-aa0a-4709-8a69-a078471ec03c-secret-alertmanager-main-tls\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:11.743477 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:11.743199 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b157ec82-aa0a-4709-8a69-a078471ec03c-tls-assets\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:12.209440 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.209405 2584 generic.go:356] "Generic (PLEG): container finished" podID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerID="8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3" exitCode=0 Jul 06 19:27:12.209663 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.209470 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerDied","Data":"8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3"} Jul 06 19:27:12.209663 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.209481 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.209663 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.209546 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157ec82-aa0a-4709-8a69-a078471ec03c","Type":"ContainerDied","Data":"17ae4965227203bd8c67f1ae717722ee840787fe4ff0b474836e426539176f15"} Jul 06 19:27:12.209663 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.209591 2584 scope.go:117] "RemoveContainer" containerID="beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb" Jul 06 19:27:12.221831 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.221547 2584 scope.go:117] "RemoveContainer" containerID="8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3" Jul 06 19:27:12.229864 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.229848 2584 scope.go:117] "RemoveContainer" containerID="b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951" Jul 06 19:27:12.236522 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.236500 2584 scope.go:117] "RemoveContainer" containerID="6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323" Jul 06 19:27:12.242489 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.242468 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:27:12.243801 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.243782 2584 scope.go:117] "RemoveContainer" containerID="42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3" Jul 06 19:27:12.250968 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.250947 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:27:12.251579 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.251565 2584 scope.go:117] "RemoveContainer" containerID="93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a" Jul 06 19:27:12.258031 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.258017 2584 scope.go:117] "RemoveContainer" containerID="d978e6e05761aad53c0a918f065c4ac0696c234f053c7d300e12d3c4492b9324" Jul 06 19:27:12.264470 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.264454 2584 scope.go:117] "RemoveContainer" containerID="beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb" Jul 06 19:27:12.264713 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:12.264693 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb\": container with ID starting with beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb not found: ID does not exist" containerID="beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb" Jul 06 19:27:12.264769 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.264717 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb"} err="failed to get container status \"beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb\": rpc error: code = NotFound desc = could not find container \"beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb\": container with ID starting with beb8bcf6a4fe7ef35512ea2f0b2688383a1f77e451f5f42932ea028e4569cbeb not found: ID does not exist" Jul 06 19:27:12.264769 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.264760 2584 scope.go:117] "RemoveContainer" containerID="8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3" Jul 06 19:27:12.264986 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:12.264969 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3\": container with ID starting with 8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3 not found: ID does not exist" containerID="8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3" Jul 06 19:27:12.265030 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.264991 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3"} err="failed to get container status \"8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3\": rpc error: code = NotFound desc = could not find container \"8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3\": container with ID starting with 8c4db43579bc603496f604277f9cd1492a49be75263d3206687c5a496738e7c3 not found: ID does not exist" Jul 06 19:27:12.265030 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.265007 2584 scope.go:117] "RemoveContainer" containerID="b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951" Jul 06 19:27:12.265221 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:12.265206 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951\": container with ID starting with b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951 not found: ID does not exist" containerID="b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951" Jul 06 19:27:12.265265 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.265223 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951"} err="failed to get container status \"b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951\": rpc error: code = NotFound desc = could not find container \"b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951\": container with ID starting with b993e1b04d644b40b0468fc2708db2d1e16bf374c71812eb820a6da400216951 not found: ID does not exist" Jul 06 19:27:12.265265 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.265235 2584 scope.go:117] "RemoveContainer" containerID="6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323" Jul 06 19:27:12.265446 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:12.265428 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323\": container with ID starting with 6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323 not found: ID does not exist" containerID="6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323" Jul 06 19:27:12.265484 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.265450 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323"} err="failed to get container status \"6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323\": rpc error: code = NotFound desc = could not find container \"6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323\": container with ID starting with 6a8509120e5e670491082d8a973072f866419a29adf1a62ec6524caddbfe6323 not found: ID does not exist" Jul 06 19:27:12.265484 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.265463 2584 scope.go:117] "RemoveContainer" containerID="42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3" Jul 06 19:27:12.265714 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:12.265683 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3\": container with ID starting with 42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3 not found: ID does not exist" containerID="42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3" Jul 06 19:27:12.265768 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.265721 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3"} err="failed to get container status \"42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3\": rpc error: code = NotFound desc = could not find container \"42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3\": container with ID starting with 42697621e078abc1c3b951c079b74c8c17e8318e8d1b4151254aaa6969175fe3 not found: ID does not exist" Jul 06 19:27:12.265768 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.265736 2584 scope.go:117] "RemoveContainer" containerID="93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a" Jul 06 19:27:12.265970 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:12.265955 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a\": container with ID starting with 93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a not found: ID does not exist" containerID="93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a" Jul 06 19:27:12.266011 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.265973 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a"} err="failed to get container status \"93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a\": rpc error: code = NotFound desc = could not find container \"93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a\": container with ID starting with 93f811ad7a1b0a78452ab54e3683ad8ec3fe08a96cd6e224eea22efad8d5fb9a not found: ID does not exist" Jul 06 19:27:12.266011 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.265986 2584 scope.go:117] "RemoveContainer" containerID="d978e6e05761aad53c0a918f065c4ac0696c234f053c7d300e12d3c4492b9324" Jul 06 19:27:12.266204 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:12.266189 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d978e6e05761aad53c0a918f065c4ac0696c234f053c7d300e12d3c4492b9324\": container with ID starting with d978e6e05761aad53c0a918f065c4ac0696c234f053c7d300e12d3c4492b9324 not found: ID does not exist" containerID="d978e6e05761aad53c0a918f065c4ac0696c234f053c7d300e12d3c4492b9324" Jul 06 19:27:12.266250 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.266205 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d978e6e05761aad53c0a918f065c4ac0696c234f053c7d300e12d3c4492b9324"} err="failed to get container status \"d978e6e05761aad53c0a918f065c4ac0696c234f053c7d300e12d3c4492b9324\": rpc error: code = NotFound desc = could not find container \"d978e6e05761aad53c0a918f065c4ac0696c234f053c7d300e12d3c4492b9324\": container with ID starting with d978e6e05761aad53c0a918f065c4ac0696c234f053c7d300e12d3c4492b9324 not found: ID does not exist" Jul 06 19:27:12.292364 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292340 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:27:12.292706 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292690 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="config-reloader" Jul 06 19:27:12.292787 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292709 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="config-reloader" Jul 06 19:27:12.292787 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292728 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="init-config-reloader" Jul 06 19:27:12.292787 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292736 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="init-config-reloader" Jul 06 19:27:12.292787 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292755 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy-web" Jul 06 19:27:12.292787 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292764 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy-web" Jul 06 19:27:12.292787 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292778 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="alertmanager" Jul 06 19:27:12.292787 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292787 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="alertmanager" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292801 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292809 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292823 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy-metric" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292831 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy-metric" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292840 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="prom-label-proxy" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292848 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="prom-label-proxy" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292931 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy-metric" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292944 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="config-reloader" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292954 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="prom-label-proxy" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292962 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy-web" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292970 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="alertmanager" Jul 06 19:27:12.293118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.292977 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" containerName="kube-rbac-proxy" Jul 06 19:27:12.297923 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.297907 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.300718 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.300697 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:27:12.300787 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.300704 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qfn9s\"" Jul 06 19:27:12.300832 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.300782 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:27:12.300920 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.300902 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:27:12.301069 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.301052 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:27:12.301143 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.301126 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:27:12.301203 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.301128 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:27:12.301255 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.301234 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:27:12.301455 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.301440 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:27:12.314638 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.314616 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:27:12.316242 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.316219 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:27:12.348008 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.347984 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w759\" (UniqueName: \"kubernetes.io/projected/1b5620af-e789-44ab-8b54-6881e32c1bc5-kube-api-access-7w759\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348082 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348015 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b5620af-e789-44ab-8b54-6881e32c1bc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348082 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348040 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348158 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348114 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b5620af-e789-44ab-8b54-6881e32c1bc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348158 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348144 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348220 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348180 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348220 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348200 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b5620af-e789-44ab-8b54-6881e32c1bc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348284 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348253 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1b5620af-e789-44ab-8b54-6881e32c1bc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348284 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348277 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348381 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348297 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348381 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348313 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348381 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348332 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.348381 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.348349 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b5620af-e789-44ab-8b54-6881e32c1bc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449190 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449153 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b5620af-e789-44ab-8b54-6881e32c1bc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449190 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449196 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449339 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449227 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449339 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449247 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b5620af-e789-44ab-8b54-6881e32c1bc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449339 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449270 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1b5620af-e789-44ab-8b54-6881e32c1bc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449339 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449287 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449339 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449307 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449339 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449324 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449612 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449353 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449612 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449380 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b5620af-e789-44ab-8b54-6881e32c1bc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449612 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449407 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w759\" (UniqueName: \"kubernetes.io/projected/1b5620af-e789-44ab-8b54-6881e32c1bc5-kube-api-access-7w759\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449612 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449430 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b5620af-e789-44ab-8b54-6881e32c1bc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449612 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449465 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.449899 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.449766 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1b5620af-e789-44ab-8b54-6881e32c1bc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.450052 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.450029 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b5620af-e789-44ab-8b54-6881e32c1bc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.450854 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.450827 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b5620af-e789-44ab-8b54-6881e32c1bc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.452332 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.452308 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.452435 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.452400 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.453010 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.452772 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b5620af-e789-44ab-8b54-6881e32c1bc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.453010 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.452970 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.453131 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.453013 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.453131 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.453093 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.453131 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.453112 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.453285 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.453266 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1b5620af-e789-44ab-8b54-6881e32c1bc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.454444 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.454428 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b5620af-e789-44ab-8b54-6881e32c1bc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.461949 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.461901 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w759\" (UniqueName: \"kubernetes.io/projected/1b5620af-e789-44ab-8b54-6881e32c1bc5-kube-api-access-7w759\") pod \"alertmanager-main-0\" (UID: \"1b5620af-e789-44ab-8b54-6881e32c1bc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.607364 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.607332 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:27:12.744193 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:12.744171 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:27:12.745893 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:27:12.745861 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5620af_e789_44ab_8b54_6881e32c1bc5.slice/crio-0297dc8ebe8508181f41ea72c10b79e91a16bcce83e3532ec92e393aca5f8812 WatchSource:0}: Error finding container 0297dc8ebe8508181f41ea72c10b79e91a16bcce83e3532ec92e393aca5f8812: Status 404 returned error can't find the container with id 0297dc8ebe8508181f41ea72c10b79e91a16bcce83e3532ec92e393aca5f8812 Jul 06 19:27:13.215347 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:13.215317 2584 generic.go:356] "Generic (PLEG): container finished" podID="1b5620af-e789-44ab-8b54-6881e32c1bc5" containerID="8b9750145ae0fe69a9e4e5ffc994c825b6e2355d09b2674866ed98c00306286f" exitCode=0 Jul 06 19:27:13.215656 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:13.215377 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1b5620af-e789-44ab-8b54-6881e32c1bc5","Type":"ContainerDied","Data":"8b9750145ae0fe69a9e4e5ffc994c825b6e2355d09b2674866ed98c00306286f"} Jul 06 19:27:13.215656 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:13.215434 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1b5620af-e789-44ab-8b54-6881e32c1bc5","Type":"ContainerStarted","Data":"0297dc8ebe8508181f41ea72c10b79e91a16bcce83e3532ec92e393aca5f8812"} Jul 06 19:27:13.254072 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:13.254049 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b157ec82-aa0a-4709-8a69-a078471ec03c" path="/var/lib/kubelet/pods/b157ec82-aa0a-4709-8a69-a078471ec03c/volumes" Jul 06 19:27:14.222857 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.222824 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1b5620af-e789-44ab-8b54-6881e32c1bc5","Type":"ContainerStarted","Data":"9be6eaf3078fc8e14d60dbd1f4aac191cefe2076e573ad1de74f961723c62f06"} Jul 06 19:27:14.223229 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.222887 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1b5620af-e789-44ab-8b54-6881e32c1bc5","Type":"ContainerStarted","Data":"ed7e402344a2f8a86d7150860eef47f758c2ec35461a4e705aeab923a8af9fbb"} Jul 06 19:27:14.223229 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.222913 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1b5620af-e789-44ab-8b54-6881e32c1bc5","Type":"ContainerStarted","Data":"0e8ca00dba1c9d8a338aa9e06d6c652132a1fe571e1f2641bd8f0a68cf8f0b12"} Jul 06 19:27:14.223229 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.222937 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1b5620af-e789-44ab-8b54-6881e32c1bc5","Type":"ContainerStarted","Data":"ed277083dc175905087a7d01a582f4dd6b481e1bde20b2165191acd46c418e3b"} Jul 06 19:27:14.223229 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.222959 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1b5620af-e789-44ab-8b54-6881e32c1bc5","Type":"ContainerStarted","Data":"cd8d78fe82bd715e17401881dc7a62e8be446892f5e4481048ed84876bf32477"} Jul 06 19:27:14.223229 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.222985 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1b5620af-e789-44ab-8b54-6881e32c1bc5","Type":"ContainerStarted","Data":"87d3301756e806a0fabd0da5b83f6549fa405f530ed4380fb8f787d3506d2131"} Jul 06 19:27:14.263571 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.263512 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.245746927 podStartE2EDuration="2.263495544s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.748617ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:14.261323509 +0000 UTC m=+225.634852221" watchObservedRunningTime="2026-07-06 19:27:14.263495544 +0000 UTC m=+225.637024234" Jul 06 19:27:14.800165 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.800129 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:27:14.800440 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.800409 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="prometheus" containerID="cri-o://656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4" gracePeriod=600 Jul 06 19:27:14.800600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.800432 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy" containerID="cri-o://d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab" gracePeriod=600 Jul 06 19:27:14.800600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.800464 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy-web" containerID="cri-o://389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f" gracePeriod=600 Jul 06 19:27:14.800600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.800456 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="thanos-sidecar" containerID="cri-o://a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc" gracePeriod=600 Jul 06 19:27:14.800600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.800487 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy-thanos" containerID="cri-o://80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee" gracePeriod=600 Jul 06 19:27:14.800600 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:14.800519 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="config-reloader" containerID="cri-o://55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09" gracePeriod=600 Jul 06 19:27:15.060488 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.060464 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.173848 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.173816 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-config-out\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.173848 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.173850 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-kubelet-serving-ca-bundle\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174058 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.173875 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174058 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.173927 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-grpc-tls\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174058 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.173945 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-trusted-ca-bundle\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174058 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.173976 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-tls-assets\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174058 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.173997 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-config\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174058 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174022 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8qml\" (UniqueName: \"kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-kube-api-access-c8qml\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174058 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174056 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-serving-certs-ca-bundle\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174406 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174082 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-1\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174406 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174205 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:15.174406 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174354 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-kube-rbac-proxy\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174562 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174421 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174562 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174440 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:15.174562 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174452 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-db\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174562 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174482 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-metrics-client-ca\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174562 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174514 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-0\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174562 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174544 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-thanos-prometheus-http-client-file\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174880 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174569 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-metrics-client-certs\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174880 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174592 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-web-config\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174880 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174622 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-2\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174880 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174646 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:15.174880 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174667 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-tls\") pod \"ba30e43e-598a-47d1-a850-6896dadde2ce\" (UID: \"ba30e43e-598a-47d1-a850-6896dadde2ce\") " Jul 06 19:27:15.174880 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.174799 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:15.175177 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.175006 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.175177 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.175027 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.175177 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.175042 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.175454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.175430 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:15.176543 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.176512 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-config-out" (OuterVolumeSpecName: "config-out") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:27:15.176543 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.176521 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:27:15.176742 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.176568 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-kube-api-access-c8qml" (OuterVolumeSpecName: "kube-api-access-c8qml") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "kube-api-access-c8qml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:27:15.177034 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.177005 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:15.177217 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.177191 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:15.177293 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.177258 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:15.177528 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.177498 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:15.177818 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.177761 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:15.177818 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.177785 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-config" (OuterVolumeSpecName: "config") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:15.178019 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.177999 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:15.178546 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.178523 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:27:15.178719 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.178701 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:15.178782 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.178724 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:15.179201 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.179177 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:15.188567 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.188548 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-web-config" (OuterVolumeSpecName: "web-config") pod "ba30e43e-598a-47d1-a850-6896dadde2ce" (UID: "ba30e43e-598a-47d1-a850-6896dadde2ce"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:15.229937 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.229909 2584 generic.go:356] "Generic (PLEG): container finished" podID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerID="80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee" exitCode=0 Jul 06 19:27:15.229937 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.229937 2584 generic.go:356] "Generic (PLEG): container finished" podID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerID="d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab" exitCode=0 Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.229946 2584 generic.go:356] "Generic (PLEG): container finished" podID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerID="389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f" exitCode=0 Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.229954 2584 generic.go:356] "Generic (PLEG): container finished" podID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerID="a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc" exitCode=0 Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.229962 2584 generic.go:356] "Generic (PLEG): container finished" podID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerID="55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09" exitCode=0 Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.229971 2584 generic.go:356] "Generic (PLEG): container finished" podID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerID="656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4" exitCode=0 Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.229983 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerDied","Data":"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee"} Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.230021 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.230048 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerDied","Data":"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab"} Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.230079 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerDied","Data":"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f"} Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.230104 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerDied","Data":"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc"} Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.230121 2584 scope.go:117] "RemoveContainer" containerID="80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee" Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.230128 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerDied","Data":"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09"} Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.230273 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerDied","Data":"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4"} Jul 06 19:27:15.230324 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.230316 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba30e43e-598a-47d1-a850-6896dadde2ce","Type":"ContainerDied","Data":"a69fbd38896ef7e3f51986864882d70071beafded5858f41503c9285e6112e7a"} Jul 06 19:27:15.238227 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.238213 2584 scope.go:117] "RemoveContainer" containerID="d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab" Jul 06 19:27:15.245478 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.245463 2584 scope.go:117] "RemoveContainer" containerID="389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f" Jul 06 19:27:15.251601 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.251588 2584 scope.go:117] "RemoveContainer" containerID="a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc" Jul 06 19:27:15.258104 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.258087 2584 scope.go:117] "RemoveContainer" containerID="55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09" Jul 06 19:27:15.264620 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.264603 2584 scope.go:117] "RemoveContainer" containerID="656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4" Jul 06 19:27:15.265388 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.265374 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:27:15.269716 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.269691 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:27:15.271928 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.271914 2584 scope.go:117] "RemoveContainer" containerID="4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285" Jul 06 19:27:15.276532 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276513 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276665 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276596 2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-grpc-tls\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276665 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276612 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-tls-assets\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276665 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276620 2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-config\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276665 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276641 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8qml\" (UniqueName: \"kubernetes.io/projected/ba30e43e-598a-47d1-a850-6896dadde2ce-kube-api-access-c8qml\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276665 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276656 2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-kube-rbac-proxy\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276665 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276665 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276674 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-db\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276683 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-metrics-client-ca\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276692 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276700 2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276708 2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-metrics-client-certs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276716 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-web-config\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276724 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276732 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba30e43e-598a-47d1-a850-6896dadde2ce-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276740 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba30e43e-598a-47d1-a850-6896dadde2ce-config-out\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.276875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.276748 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba30e43e-598a-47d1-a850-6896dadde2ce-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:27:15.278308 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.278287 2584 scope.go:117] "RemoveContainer" containerID="80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee" Jul 06 19:27:15.278528 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:15.278512 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": container with ID starting with 80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee not found: ID does not exist" containerID="80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee" Jul 06 19:27:15.278568 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.278535 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee"} err="failed to get container status \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": rpc error: code = NotFound desc = could not find container \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": container with ID starting with 80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee not found: ID does not exist" Jul 06 19:27:15.278568 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.278550 2584 scope.go:117] "RemoveContainer" containerID="d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab" Jul 06 19:27:15.278771 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:15.278757 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": container with ID starting with d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab not found: ID does not exist" containerID="d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab" Jul 06 19:27:15.278815 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.278775 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab"} err="failed to get container status \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": rpc error: code = NotFound desc = could not find container \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": container with ID starting with d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab not found: ID does not exist" Jul 06 19:27:15.278815 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.278788 2584 scope.go:117] "RemoveContainer" containerID="389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f" Jul 06 19:27:15.279002 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:15.278989 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": container with ID starting with 389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f not found: ID does not exist" containerID="389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f" Jul 06 19:27:15.279042 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.279004 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f"} err="failed to get container status \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": rpc error: code = NotFound desc = could not find container \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": container with ID starting with 389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f not found: ID does not exist" Jul 06 19:27:15.279042 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.279016 2584 scope.go:117] "RemoveContainer" containerID="a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc" Jul 06 19:27:15.279191 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:15.279178 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": container with ID starting with a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc not found: ID does not exist" containerID="a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc" Jul 06 19:27:15.279229 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.279193 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc"} err="failed to get container status \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": rpc error: code = NotFound desc = could not find container \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": container with ID starting with a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc not found: ID does not exist" Jul 06 19:27:15.279229 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.279205 2584 scope.go:117] "RemoveContainer" containerID="55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09" Jul 06 19:27:15.279379 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:15.279364 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": container with ID starting with 55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09 not found: ID does not exist" containerID="55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09" Jul 06 19:27:15.279419 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.279382 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09"} err="failed to get container status \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": rpc error: code = NotFound desc = could not find container \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": container with ID starting with 55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09 not found: ID does not exist" Jul 06 19:27:15.279419 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.279393 2584 scope.go:117] "RemoveContainer" containerID="656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4" Jul 06 19:27:15.279621 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:15.279604 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": container with ID starting with 656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4 not found: ID does not exist" containerID="656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4" Jul 06 19:27:15.279704 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.279625 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4"} err="failed to get container status \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": rpc error: code = NotFound desc = could not find container \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": container with ID starting with 656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4 not found: ID does not exist" Jul 06 19:27:15.279704 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.279688 2584 scope.go:117] "RemoveContainer" containerID="4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285" Jul 06 19:27:15.279929 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:27:15.279913 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": container with ID starting with 4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285 not found: ID does not exist" containerID="4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285" Jul 06 19:27:15.279982 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.279931 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285"} err="failed to get container status \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": rpc error: code = NotFound desc = could not find container \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": container with ID starting with 4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285 not found: ID does not exist" Jul 06 19:27:15.279982 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.279943 2584 scope.go:117] "RemoveContainer" containerID="80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee" Jul 06 19:27:15.280165 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.280133 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee"} err="failed to get container status \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": rpc error: code = NotFound desc = could not find container \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": container with ID starting with 80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee not found: ID does not exist" Jul 06 19:27:15.280165 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.280159 2584 scope.go:117] "RemoveContainer" containerID="d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab" Jul 06 19:27:15.280390 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.280375 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab"} err="failed to get container status \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": rpc error: code = NotFound desc = could not find container \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": container with ID starting with d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab not found: ID does not exist" Jul 06 19:27:15.280450 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.280393 2584 scope.go:117] "RemoveContainer" containerID="389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f" Jul 06 19:27:15.280611 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.280596 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f"} err="failed to get container status \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": rpc error: code = NotFound desc = could not find container \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": container with ID starting with 389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f not found: ID does not exist" Jul 06 19:27:15.280700 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.280612 2584 scope.go:117] "RemoveContainer" containerID="a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc" Jul 06 19:27:15.280834 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.280817 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc"} err="failed to get container status \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": rpc error: code = NotFound desc = could not find container \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": container with ID starting with a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc not found: ID does not exist" Jul 06 19:27:15.280875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.280834 2584 scope.go:117] "RemoveContainer" containerID="55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09" Jul 06 19:27:15.281032 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.281018 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09"} err="failed to get container status \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": rpc error: code = NotFound desc = could not find container \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": container with ID starting with 55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09 not found: ID does not exist" Jul 06 19:27:15.281077 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.281032 2584 scope.go:117] "RemoveContainer" containerID="656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4" Jul 06 19:27:15.281226 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.281211 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4"} err="failed to get container status \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": rpc error: code = NotFound desc = could not find container \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": container with ID starting with 656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4 not found: ID does not exist" Jul 06 19:27:15.281269 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.281227 2584 scope.go:117] "RemoveContainer" containerID="4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285" Jul 06 19:27:15.281417 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.281400 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285"} err="failed to get container status \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": rpc error: code = NotFound desc = could not find container \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": container with ID starting with 4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285 not found: ID does not exist" Jul 06 19:27:15.281458 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.281417 2584 scope.go:117] "RemoveContainer" containerID="80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee" Jul 06 19:27:15.281601 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.281584 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee"} err="failed to get container status \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": rpc error: code = NotFound desc = could not find container \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": container with ID starting with 80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee not found: ID does not exist" Jul 06 19:27:15.281666 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.281601 2584 scope.go:117] "RemoveContainer" containerID="d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab" Jul 06 19:27:15.281831 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.281813 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab"} err="failed to get container status \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": rpc error: code = NotFound desc = could not find container \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": container with ID starting with d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab not found: ID does not exist" Jul 06 19:27:15.281872 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.281831 2584 scope.go:117] "RemoveContainer" containerID="389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f" Jul 06 19:27:15.282017 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.282002 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f"} err="failed to get container status \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": rpc error: code = NotFound desc = could not find container \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": container with ID starting with 389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f not found: ID does not exist" Jul 06 19:27:15.282051 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.282017 2584 scope.go:117] "RemoveContainer" containerID="a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc" Jul 06 19:27:15.282215 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.282201 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc"} err="failed to get container status \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": rpc error: code = NotFound desc = could not find container \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": container with ID starting with a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc not found: ID does not exist" Jul 06 19:27:15.282262 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.282215 2584 scope.go:117] "RemoveContainer" containerID="55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09" Jul 06 19:27:15.282416 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.282400 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09"} err="failed to get container status \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": rpc error: code = NotFound desc = could not find container \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": container with ID starting with 55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09 not found: ID does not exist" Jul 06 19:27:15.282461 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.282415 2584 scope.go:117] "RemoveContainer" containerID="656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4" Jul 06 19:27:15.282624 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.282607 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4"} err="failed to get container status \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": rpc error: code = NotFound desc = could not find container \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": container with ID starting with 656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4 not found: ID does not exist" Jul 06 19:27:15.282693 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.282625 2584 scope.go:117] "RemoveContainer" containerID="4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285" Jul 06 19:27:15.282821 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.282802 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285"} err="failed to get container status \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": rpc error: code = NotFound desc = could not find container \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": container with ID starting with 4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285 not found: ID does not exist" Jul 06 19:27:15.282870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.282821 2584 scope.go:117] "RemoveContainer" containerID="80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee" Jul 06 19:27:15.283021 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283005 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee"} err="failed to get container status \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": rpc error: code = NotFound desc = could not find container \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": container with ID starting with 80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee not found: ID does not exist" Jul 06 19:27:15.283066 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283021 2584 scope.go:117] "RemoveContainer" containerID="d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab" Jul 06 19:27:15.283212 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283198 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab"} err="failed to get container status \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": rpc error: code = NotFound desc = could not find container \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": container with ID starting with d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab not found: ID does not exist" Jul 06 19:27:15.283212 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283211 2584 scope.go:117] "RemoveContainer" containerID="389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f" Jul 06 19:27:15.283374 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283358 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f"} err="failed to get container status \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": rpc error: code = NotFound desc = could not find container \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": container with ID starting with 389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f not found: ID does not exist" Jul 06 19:27:15.283411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283374 2584 scope.go:117] "RemoveContainer" containerID="a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc" Jul 06 19:27:15.283561 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283547 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc"} err="failed to get container status \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": rpc error: code = NotFound desc = could not find container \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": container with ID starting with a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc not found: ID does not exist" Jul 06 19:27:15.283561 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283560 2584 scope.go:117] "RemoveContainer" containerID="55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09" Jul 06 19:27:15.283760 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283745 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09"} err="failed to get container status \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": rpc error: code = NotFound desc = could not find container \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": container with ID starting with 55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09 not found: ID does not exist" Jul 06 19:27:15.283808 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283760 2584 scope.go:117] "RemoveContainer" containerID="656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4" Jul 06 19:27:15.283930 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283913 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4"} err="failed to get container status \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": rpc error: code = NotFound desc = could not find container \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": container with ID starting with 656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4 not found: ID does not exist" Jul 06 19:27:15.283980 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.283931 2584 scope.go:117] "RemoveContainer" containerID="4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285" Jul 06 19:27:15.284121 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284107 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285"} err="failed to get container status \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": rpc error: code = NotFound desc = could not find container \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": container with ID starting with 4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285 not found: ID does not exist" Jul 06 19:27:15.284161 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284122 2584 scope.go:117] "RemoveContainer" containerID="80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee" Jul 06 19:27:15.284277 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284263 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee"} err="failed to get container status \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": rpc error: code = NotFound desc = could not find container \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": container with ID starting with 80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee not found: ID does not exist" Jul 06 19:27:15.284317 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284278 2584 scope.go:117] "RemoveContainer" containerID="d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab" Jul 06 19:27:15.284473 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284458 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab"} err="failed to get container status \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": rpc error: code = NotFound desc = could not find container \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": container with ID starting with d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab not found: ID does not exist" Jul 06 19:27:15.284518 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284474 2584 scope.go:117] "RemoveContainer" containerID="389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f" Jul 06 19:27:15.284655 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284625 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f"} err="failed to get container status \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": rpc error: code = NotFound desc = could not find container \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": container with ID starting with 389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f not found: ID does not exist" Jul 06 19:27:15.284711 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284655 2584 scope.go:117] "RemoveContainer" containerID="a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc" Jul 06 19:27:15.284820 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284803 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc"} err="failed to get container status \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": rpc error: code = NotFound desc = could not find container \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": container with ID starting with a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc not found: ID does not exist" Jul 06 19:27:15.284863 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284820 2584 scope.go:117] "RemoveContainer" containerID="55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09" Jul 06 19:27:15.284999 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284985 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09"} err="failed to get container status \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": rpc error: code = NotFound desc = could not find container \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": container with ID starting with 55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09 not found: ID does not exist" Jul 06 19:27:15.284999 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.284998 2584 scope.go:117] "RemoveContainer" containerID="656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4" Jul 06 19:27:15.285194 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.285179 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4"} err="failed to get container status \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": rpc error: code = NotFound desc = could not find container \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": container with ID starting with 656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4 not found: ID does not exist" Jul 06 19:27:15.285194 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.285194 2584 scope.go:117] "RemoveContainer" containerID="4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285" Jul 06 19:27:15.285364 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.285349 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285"} err="failed to get container status \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": rpc error: code = NotFound desc = could not find container \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": container with ID starting with 4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285 not found: ID does not exist" Jul 06 19:27:15.285400 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.285364 2584 scope.go:117] "RemoveContainer" containerID="80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee" Jul 06 19:27:15.285560 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.285545 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee"} err="failed to get container status \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": rpc error: code = NotFound desc = could not find container \"80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee\": container with ID starting with 80cc40555fe37b28ca3ec92bd96cc4926c217d5e2d2c8df1dce845115082d7ee not found: ID does not exist" Jul 06 19:27:15.285598 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.285560 2584 scope.go:117] "RemoveContainer" containerID="d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab" Jul 06 19:27:15.285796 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.285778 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab"} err="failed to get container status \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": rpc error: code = NotFound desc = could not find container \"d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab\": container with ID starting with d1f1595d0f60fcaaa8c469a043dc4591b29520c57390fd38d9c020e213378cab not found: ID does not exist" Jul 06 19:27:15.285855 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.285797 2584 scope.go:117] "RemoveContainer" containerID="389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f" Jul 06 19:27:15.286013 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.285997 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f"} err="failed to get container status \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": rpc error: code = NotFound desc = could not find container \"389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f\": container with ID starting with 389f8d299f9b7ca2e8451a5db373e47754d9ec205432d1b6b5f30ec30af7bd6f not found: ID does not exist" Jul 06 19:27:15.286065 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.286013 2584 scope.go:117] "RemoveContainer" containerID="a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc" Jul 06 19:27:15.286233 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.286217 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc"} err="failed to get container status \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": rpc error: code = NotFound desc = could not find container \"a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc\": container with ID starting with a91461e2f520076123f819533a4759feb5f7dfcb9432aacdacf6a43c7d0183cc not found: ID does not exist" Jul 06 19:27:15.286276 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.286233 2584 scope.go:117] "RemoveContainer" containerID="55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09" Jul 06 19:27:15.286395 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.286378 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09"} err="failed to get container status \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": rpc error: code = NotFound desc = could not find container \"55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09\": container with ID starting with 55dd488116ac4d25bf710cf18c580872b5fca9cd5c752635413621e528eacf09 not found: ID does not exist" Jul 06 19:27:15.286453 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.286395 2584 scope.go:117] "RemoveContainer" containerID="656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4" Jul 06 19:27:15.286602 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.286582 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4"} err="failed to get container status \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": rpc error: code = NotFound desc = could not find container \"656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4\": container with ID starting with 656ebe4739c59c22f06acc30d206df891ccfd463c94eaefa6eb9d56d33ed36a4 not found: ID does not exist" Jul 06 19:27:15.286655 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.286604 2584 scope.go:117] "RemoveContainer" containerID="4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285" Jul 06 19:27:15.286845 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.286827 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285"} err="failed to get container status \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": rpc error: code = NotFound desc = could not find container \"4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285\": container with ID starting with 4c746587d47027c70acc245dda085d6d4a4c5b00b3a8c5634e15e6f9451df285 not found: ID does not exist" Jul 06 19:27:15.311533 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311485 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:27:15.311801 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311785 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy" Jul 06 19:27:15.311870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311805 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy" Jul 06 19:27:15.311870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311816 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="init-config-reloader" Jul 06 19:27:15.311870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311822 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="init-config-reloader" Jul 06 19:27:15.311870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311827 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="prometheus" Jul 06 19:27:15.311870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311832 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="prometheus" Jul 06 19:27:15.311870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311840 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy-web" Jul 06 19:27:15.311870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311845 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy-web" Jul 06 19:27:15.311870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311852 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy-thanos" Jul 06 19:27:15.311870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311856 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy-thanos" Jul 06 19:27:15.311870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311869 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="thanos-sidecar" Jul 06 19:27:15.311870 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311874 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="thanos-sidecar" Jul 06 19:27:15.312171 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311885 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="config-reloader" Jul 06 19:27:15.312171 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311890 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="config-reloader" Jul 06 19:27:15.312171 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311945 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="thanos-sidecar" Jul 06 19:27:15.312171 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311975 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="prometheus" Jul 06 19:27:15.312171 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311981 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="config-reloader" Jul 06 19:27:15.312171 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311988 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy" Jul 06 19:27:15.312171 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.311995 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy-web" Jul 06 19:27:15.312171 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.312000 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" containerName="kube-rbac-proxy-thanos" Jul 06 19:27:15.317066 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.317051 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.323160 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.323141 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 19:27:15.323252 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.323164 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 19:27:15.323252 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.323140 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 19:27:15.323844 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.323692 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 19:27:15.323844 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.323739 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 19:27:15.324597 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.324103 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 19:27:15.324597 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.324116 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 19:27:15.324597 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.324106 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 19:27:15.324597 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.324432 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 19:27:15.324597 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.324432 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-if1ipidh40lh\"" Jul 06 19:27:15.324597 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.324482 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zcq5r\"" Jul 06 19:27:15.324597 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.324494 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 19:27:15.324597 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.324569 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 19:27:15.325061 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.324745 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 19:27:15.326918 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.326899 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 19:27:15.336061 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.336043 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 19:27:15.339125 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.339106 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:27:15.377650 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.377612 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.377792 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.377667 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.377792 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.377730 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.377869 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.377790 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-config\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.377869 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.377826 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.377869 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.377853 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378011 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.377880 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378011 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.377910 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378011 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.377977 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378163 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.378032 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378163 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.378076 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378163 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.378105 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378163 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.378127 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7vng\" (UniqueName: \"kubernetes.io/projected/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-kube-api-access-z7vng\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378163 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.378154 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378358 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.378204 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378358 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.378228 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378358 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.378251 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378358 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.378277 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378358 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.378332 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.378358 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.378350 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.478625 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.478597 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.478625 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.478625 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.478818 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.478654 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7vng\" (UniqueName: \"kubernetes.io/projected/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-kube-api-access-z7vng\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.478818 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.478677 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.478818 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.478703 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.478818 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.478726 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.478818 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.478750 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.478992 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.478838 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.478992 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.478901 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.478992 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.478930 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.478992 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.478975 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.479183 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.479009 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.479183 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.479037 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.479183 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.479061 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-config\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.479183 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.479086 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.479183 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.479112 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.479183 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.479143 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.479183 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.479152 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.479183 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.479170 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.479619 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.479198 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.479619 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.479228 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.479936 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.479911 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.481819 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.481787 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.481959 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.481941 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.482024 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.481986 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.482096 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.482073 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.482163 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.482079 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.482489 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.482466 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-config\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.482584 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.482508 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.482669 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.482595 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.482736 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.482665 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.483331 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.483142 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.483331 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.483220 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.483331 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.483294 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.483522 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.483446 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.484238 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.484213 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.484313 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.484264 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.484545 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.484530 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.484965 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.484950 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.488183 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.488165 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7vng\" (UniqueName: \"kubernetes.io/projected/b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca-kube-api-access-z7vng\") pod \"prometheus-k8s-0\" (UID: \"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.626576 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.626493 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:27:15.771751 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:15.771721 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:27:15.774436 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:27:15.774414 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f91b43_81a3_4c4f_885f_c5eb9e8a46ca.slice/crio-61614e2956031ae62a428b430ff39e732f77e12f0d8f9446286418932671006d WatchSource:0}: Error finding container 61614e2956031ae62a428b430ff39e732f77e12f0d8f9446286418932671006d: Status 404 returned error can't find the container with id 61614e2956031ae62a428b430ff39e732f77e12f0d8f9446286418932671006d Jul 06 19:27:16.236015 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:16.235928 2584 generic.go:356] "Generic (PLEG): container finished" podID="b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca" containerID="c97bb2bfb3f2aa8d28ec5cb26979a9cc1b335a9d1c38fbbcd153390341273ae5" exitCode=0 Jul 06 19:27:16.236400 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:16.236015 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca","Type":"ContainerDied","Data":"c97bb2bfb3f2aa8d28ec5cb26979a9cc1b335a9d1c38fbbcd153390341273ae5"} Jul 06 19:27:16.236400 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:16.236097 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca","Type":"ContainerStarted","Data":"61614e2956031ae62a428b430ff39e732f77e12f0d8f9446286418932671006d"} Jul 06 19:27:17.244379 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:17.244347 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca","Type":"ContainerStarted","Data":"fceeb723b1c7f571aa1e63ab6ae2ad4a52071211b0ef29afea25273725017da2"} Jul 06 19:27:17.244777 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:17.244411 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca","Type":"ContainerStarted","Data":"a2e8c5e793a6960c7fe2f1698ca8d5873294ec3915375e2825cfb5a182c83dd0"} Jul 06 19:27:17.244777 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:17.244437 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca","Type":"ContainerStarted","Data":"49af04e8d55ab43c15f0c45a17c2f01db2157d9aad44325742992d9e8b822a37"} Jul 06 19:27:17.244777 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:17.244465 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca","Type":"ContainerStarted","Data":"426fccff0d64798dd3f45985ca7bddd15cfb3e3f235a1edc90d51503532021af"} Jul 06 19:27:17.244777 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:17.244488 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca","Type":"ContainerStarted","Data":"5561c08cdbcc069307d9aa44758baba8c86b32f14484a1da270a4eabebf70b7a"} Jul 06 19:27:17.244777 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:17.244519 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca","Type":"ContainerStarted","Data":"3fc29440fe61156abfbf6db6f7c9465ba64feed8223cbfdf37dd006b76d48acc"} Jul 06 19:27:17.255483 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:17.255457 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba30e43e-598a-47d1-a850-6896dadde2ce" path="/var/lib/kubelet/pods/ba30e43e-598a-47d1-a850-6896dadde2ce/volumes" Jul 06 19:27:17.289588 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:17.289535 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.276602345 podStartE2EDuration="2.289514427s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.912082ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:17.286992105 +0000 UTC m=+228.660520792" watchObservedRunningTime="2026-07-06 19:27:17.289514427 +0000 UTC m=+228.663043119" Jul 06 19:27:20.627087 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:27:20.627039 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:28:15.627414 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:28:15.627374 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:28:15.642909 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:28:15.642883 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:28:16.488281 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:28:16.488256 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:28:29.061501 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:28:29.061470 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:28:29.063770 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:28:29.063747 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:28:29.073153 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:28:29.073131 2584 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:30:30.637271 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.637238 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n"] Jul 06 19:30:30.645064 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.645039 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.648950 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.648904 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:30:30.648950 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.648951 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qpsz2\"" Jul 06 19:30:30.649192 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.649177 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 19:30:30.649260 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.649198 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:30:30.649260 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.649207 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:30:30.757588 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.757555 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n"] Jul 06 19:30:30.782347 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.782318 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19c32208-f6ac-4330-9d70-b5dc45e892e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.782347 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.782351 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19c32208-f6ac-4330-9d70-b5dc45e892e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.782528 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.782391 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhjr9\" (UniqueName: \"kubernetes.io/projected/19c32208-f6ac-4330-9d70-b5dc45e892e6-kube-api-access-qhjr9\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.782528 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.782483 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19c32208-f6ac-4330-9d70-b5dc45e892e6-manifests\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.782528 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.782511 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19c32208-f6ac-4330-9d70-b5dc45e892e6-tmp\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.883150 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.883119 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19c32208-f6ac-4330-9d70-b5dc45e892e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.883306 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.883158 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19c32208-f6ac-4330-9d70-b5dc45e892e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.883306 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.883204 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjr9\" (UniqueName: \"kubernetes.io/projected/19c32208-f6ac-4330-9d70-b5dc45e892e6-kube-api-access-qhjr9\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.883380 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.883308 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19c32208-f6ac-4330-9d70-b5dc45e892e6-manifests\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.883380 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.883345 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19c32208-f6ac-4330-9d70-b5dc45e892e6-tmp\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.883718 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.883689 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19c32208-f6ac-4330-9d70-b5dc45e892e6-manifests\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.885551 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.885527 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19c32208-f6ac-4330-9d70-b5dc45e892e6-tmp\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.885725 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.885700 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19c32208-f6ac-4330-9d70-b5dc45e892e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.885821 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.885806 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19c32208-f6ac-4330-9d70-b5dc45e892e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.899410 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.899364 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhjr9\" (UniqueName: \"kubernetes.io/projected/19c32208-f6ac-4330-9d70-b5dc45e892e6-kube-api-access-qhjr9\") pod \"opendatahub-operator-controller-manager-b84dcb6b7-m8w8n\" (UID: \"19c32208-f6ac-4330-9d70-b5dc45e892e6\") " pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:30.955222 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:30.955197 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:31.090042 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:31.090015 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n"] Jul 06 19:30:31.092461 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:30:31.092437 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c32208_f6ac_4330_9d70_b5dc45e892e6.slice/crio-223a4480d94db3b1a24b8645b3f6b0122c2fac0e3ce56d9dd07e724a42d4411b WatchSource:0}: Error finding container 223a4480d94db3b1a24b8645b3f6b0122c2fac0e3ce56d9dd07e724a42d4411b: Status 404 returned error can't find the container with id 223a4480d94db3b1a24b8645b3f6b0122c2fac0e3ce56d9dd07e724a42d4411b Jul 06 19:30:31.094226 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:31.094213 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:30:31.992236 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:31.992193 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" event={"ID":"19c32208-f6ac-4330-9d70-b5dc45e892e6","Type":"ContainerStarted","Data":"223a4480d94db3b1a24b8645b3f6b0122c2fac0e3ce56d9dd07e724a42d4411b"} Jul 06 19:30:35.007699 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:35.007664 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" event={"ID":"19c32208-f6ac-4330-9d70-b5dc45e892e6","Type":"ContainerStarted","Data":"138ca868019e3c7c59a9c151195cff98811aac1d8362b8a53cc313a77f7b0120"} Jul 06 19:30:36.013682 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:36.013627 2584 generic.go:356] "Generic (PLEG): container finished" podID="19c32208-f6ac-4330-9d70-b5dc45e892e6" containerID="138ca868019e3c7c59a9c151195cff98811aac1d8362b8a53cc313a77f7b0120" exitCode=0 Jul 06 19:30:36.014067 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:36.013735 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" event={"ID":"19c32208-f6ac-4330-9d70-b5dc45e892e6","Type":"ContainerDied","Data":"138ca868019e3c7c59a9c151195cff98811aac1d8362b8a53cc313a77f7b0120"} Jul 06 19:30:37.019885 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:37.019846 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" event={"ID":"19c32208-f6ac-4330-9d70-b5dc45e892e6","Type":"ContainerStarted","Data":"b78dd3a6af10add4dcebfe67781d8668b57d5e401d1dc6e2e98784087227f1f4"} Jul 06 19:30:37.020267 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:37.019949 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:37.052658 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:37.052600 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" podStartSLOduration=2.804150893 podStartE2EDuration="7.052583489s" totalImagesPullingTime="3.228447304s" totalInitContainerRuntime="1.019985292s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:37.04890815 +0000 UTC m=+428.422436838" watchObservedRunningTime="2026-07-06 19:30:37.052583489 +0000 UTC m=+428.426112179" Jul 06 19:30:48.025963 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:48.025936 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b84dcb6b7-m8w8n" Jul 06 19:30:59.697646 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.697600 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2"] Jul 06 19:30:59.701032 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.701014 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.703591 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.703573 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 19:30:59.703905 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.703888 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:30:59.705194 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.705165 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 19:30:59.705299 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.705216 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 19:30:59.705299 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.705225 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z26vd\"" Jul 06 19:30:59.705299 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.705253 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 19:30:59.719126 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.719104 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2"] Jul 06 19:30:59.811419 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.811391 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a63d654-3d68-4c83-a12a-c51c6c689fbd-metrics-cert\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.811580 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.811433 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3a63d654-3d68-4c83-a12a-c51c6c689fbd-manager-config\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.811580 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.811452 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a63d654-3d68-4c83-a12a-c51c6c689fbd-cert\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.811580 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.811494 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bx4k\" (UniqueName: \"kubernetes.io/projected/3a63d654-3d68-4c83-a12a-c51c6c689fbd-kube-api-access-2bx4k\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.912789 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.912757 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a63d654-3d68-4c83-a12a-c51c6c689fbd-metrics-cert\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.912959 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.912809 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3a63d654-3d68-4c83-a12a-c51c6c689fbd-manager-config\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.912959 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.912827 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a63d654-3d68-4c83-a12a-c51c6c689fbd-cert\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.912959 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.912843 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bx4k\" (UniqueName: \"kubernetes.io/projected/3a63d654-3d68-4c83-a12a-c51c6c689fbd-kube-api-access-2bx4k\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.913425 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.913400 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3a63d654-3d68-4c83-a12a-c51c6c689fbd-manager-config\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.915373 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.915349 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a63d654-3d68-4c83-a12a-c51c6c689fbd-metrics-cert\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.915477 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.915399 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a63d654-3d68-4c83-a12a-c51c6c689fbd-cert\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:30:59.932942 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:30:59.932919 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bx4k\" (UniqueName: \"kubernetes.io/projected/3a63d654-3d68-4c83-a12a-c51c6c689fbd-kube-api-access-2bx4k\") pod \"lws-controller-manager-767ffd794c-8njk2\" (UID: \"3a63d654-3d68-4c83-a12a-c51c6c689fbd\") " pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:31:00.010118 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:00.010065 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:31:00.151581 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:00.151550 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2"] Jul 06 19:31:00.172976 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:31:00.172955 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a63d654_3d68_4c83_a12a_c51c6c689fbd.slice/crio-f1ca866230062ace74a16b516a59c8a6e3bd25b54af3721528a8c4e334a7b2e1 WatchSource:0}: Error finding container f1ca866230062ace74a16b516a59c8a6e3bd25b54af3721528a8c4e334a7b2e1: Status 404 returned error can't find the container with id f1ca866230062ace74a16b516a59c8a6e3bd25b54af3721528a8c4e334a7b2e1 Jul 06 19:31:01.124743 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:01.124702 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" event={"ID":"3a63d654-3d68-4c83-a12a-c51c6c689fbd","Type":"ContainerStarted","Data":"f1ca866230062ace74a16b516a59c8a6e3bd25b54af3721528a8c4e334a7b2e1"} Jul 06 19:31:02.102051 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.102018 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr"] Jul 06 19:31:02.105772 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.105749 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" Jul 06 19:31:02.118713 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.118692 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 19:31:02.119704 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.119684 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7qzgv\"" Jul 06 19:31:02.119795 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.119707 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 19:31:02.156467 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.156425 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr"] Jul 06 19:31:02.232106 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.232070 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6626cdfd-c707-452d-a073-8ed0ca02ae4b-tls-certs\") pod \"kube-auth-proxy-7fb5b84c75-d98rr\" (UID: \"6626cdfd-c707-452d-a073-8ed0ca02ae4b\") " pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" Jul 06 19:31:02.232297 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.232144 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm6v5\" (UniqueName: \"kubernetes.io/projected/6626cdfd-c707-452d-a073-8ed0ca02ae4b-kube-api-access-jm6v5\") pod \"kube-auth-proxy-7fb5b84c75-d98rr\" (UID: \"6626cdfd-c707-452d-a073-8ed0ca02ae4b\") " pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" Jul 06 19:31:02.232297 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.232184 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6626cdfd-c707-452d-a073-8ed0ca02ae4b-tmp\") pod \"kube-auth-proxy-7fb5b84c75-d98rr\" (UID: \"6626cdfd-c707-452d-a073-8ed0ca02ae4b\") " pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" Jul 06 19:31:02.332905 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.332872 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm6v5\" (UniqueName: \"kubernetes.io/projected/6626cdfd-c707-452d-a073-8ed0ca02ae4b-kube-api-access-jm6v5\") pod \"kube-auth-proxy-7fb5b84c75-d98rr\" (UID: \"6626cdfd-c707-452d-a073-8ed0ca02ae4b\") " pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" Jul 06 19:31:02.333097 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.332922 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6626cdfd-c707-452d-a073-8ed0ca02ae4b-tmp\") pod \"kube-auth-proxy-7fb5b84c75-d98rr\" (UID: \"6626cdfd-c707-452d-a073-8ed0ca02ae4b\") " pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" Jul 06 19:31:02.333097 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.332963 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6626cdfd-c707-452d-a073-8ed0ca02ae4b-tls-certs\") pod \"kube-auth-proxy-7fb5b84c75-d98rr\" (UID: \"6626cdfd-c707-452d-a073-8ed0ca02ae4b\") " pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" Jul 06 19:31:02.335238 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.335214 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6626cdfd-c707-452d-a073-8ed0ca02ae4b-tmp\") pod \"kube-auth-proxy-7fb5b84c75-d98rr\" (UID: \"6626cdfd-c707-452d-a073-8ed0ca02ae4b\") " pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" Jul 06 19:31:02.335383 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.335309 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6626cdfd-c707-452d-a073-8ed0ca02ae4b-tls-certs\") pod \"kube-auth-proxy-7fb5b84c75-d98rr\" (UID: \"6626cdfd-c707-452d-a073-8ed0ca02ae4b\") " pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" Jul 06 19:31:02.343940 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.343917 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm6v5\" (UniqueName: \"kubernetes.io/projected/6626cdfd-c707-452d-a073-8ed0ca02ae4b-kube-api-access-jm6v5\") pod \"kube-auth-proxy-7fb5b84c75-d98rr\" (UID: \"6626cdfd-c707-452d-a073-8ed0ca02ae4b\") " pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" Jul 06 19:31:02.417579 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.417552 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" Jul 06 19:31:02.656008 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:02.655938 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr"] Jul 06 19:31:02.658868 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:31:02.658841 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6626cdfd_c707_452d_a073_8ed0ca02ae4b.slice/crio-0ad0ff980ecd5cb793f402bff7771ad492b75da5e43cdebee8b59aa6590f9a9d WatchSource:0}: Error finding container 0ad0ff980ecd5cb793f402bff7771ad492b75da5e43cdebee8b59aa6590f9a9d: Status 404 returned error can't find the container with id 0ad0ff980ecd5cb793f402bff7771ad492b75da5e43cdebee8b59aa6590f9a9d Jul 06 19:31:03.136883 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:03.136847 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" event={"ID":"6626cdfd-c707-452d-a073-8ed0ca02ae4b","Type":"ContainerStarted","Data":"0ad0ff980ecd5cb793f402bff7771ad492b75da5e43cdebee8b59aa6590f9a9d"} Jul 06 19:31:03.138400 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:03.138372 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" event={"ID":"3a63d654-3d68-4c83-a12a-c51c6c689fbd","Type":"ContainerStarted","Data":"b80603835faa20d00a4e6cb7ab22d464b42ce9d3e667cab0e7cf677c809be0ce"} Jul 06 19:31:03.138538 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:03.138504 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:31:03.171495 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:03.171451 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" podStartSLOduration=1.971716379 podStartE2EDuration="4.171438824s" totalImagesPullingTime="2.199722445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:03.170357757 +0000 UTC m=+454.543886449" watchObservedRunningTime="2026-07-06 19:31:03.171438824 +0000 UTC m=+454.544967513" Jul 06 19:31:06.152395 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:06.152357 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" event={"ID":"6626cdfd-c707-452d-a073-8ed0ca02ae4b","Type":"ContainerStarted","Data":"8a78b7a25b8f5679b845f9fd30f71857d1264f6117d7c65096ad74203515f6eb"} Jul 06 19:31:06.184573 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:06.184520 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7fb5b84c75-d98rr" podStartSLOduration=1.500208722 podStartE2EDuration="4.184505373s" totalImagesPullingTime="2.684296651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:06.184110805 +0000 UTC m=+457.557639496" watchObservedRunningTime="2026-07-06 19:31:06.184505373 +0000 UTC m=+457.558034062" Jul 06 19:31:14.143773 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:31:14.143736 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-767ffd794c-8njk2" Jul 06 19:32:39.792753 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.792668 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg"] Jul 06 19:32:39.795607 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.795591 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:39.798242 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.798212 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 06 19:32:39.798357 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.798272 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:32:39.798357 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.798272 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:32:39.799488 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.799467 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 06 19:32:39.799488 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.799483 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l8t46\"" Jul 06 19:32:39.806948 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.806929 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg"] Jul 06 19:32:39.878865 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.878837 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2888\" (UniqueName: \"kubernetes.io/projected/990bcd7c-d99d-4878-8061-47620888778f-kube-api-access-s2888\") pod \"kuadrant-console-plugin-66b5774985-tqwlg\" (UID: \"990bcd7c-d99d-4878-8061-47620888778f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:39.878973 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.878874 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/990bcd7c-d99d-4878-8061-47620888778f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tqwlg\" (UID: \"990bcd7c-d99d-4878-8061-47620888778f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:39.879031 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.878966 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/990bcd7c-d99d-4878-8061-47620888778f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tqwlg\" (UID: \"990bcd7c-d99d-4878-8061-47620888778f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:39.980063 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.980034 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2888\" (UniqueName: \"kubernetes.io/projected/990bcd7c-d99d-4878-8061-47620888778f-kube-api-access-s2888\") pod \"kuadrant-console-plugin-66b5774985-tqwlg\" (UID: \"990bcd7c-d99d-4878-8061-47620888778f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:39.980193 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.980069 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/990bcd7c-d99d-4878-8061-47620888778f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tqwlg\" (UID: \"990bcd7c-d99d-4878-8061-47620888778f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:39.980336 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.980316 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/990bcd7c-d99d-4878-8061-47620888778f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tqwlg\" (UID: \"990bcd7c-d99d-4878-8061-47620888778f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:39.980458 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:32:39.980440 2584 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 06 19:32:39.980526 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:32:39.980506 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990bcd7c-d99d-4878-8061-47620888778f-plugin-serving-cert podName:990bcd7c-d99d-4878-8061-47620888778f nodeName:}" failed. No retries permitted until 2026-07-06 19:32:40.480491554 +0000 UTC m=+551.854020221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/990bcd7c-d99d-4878-8061-47620888778f-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-tqwlg" (UID: "990bcd7c-d99d-4878-8061-47620888778f") : secret "plugin-serving-cert" not found Jul 06 19:32:39.980775 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.980756 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/990bcd7c-d99d-4878-8061-47620888778f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tqwlg\" (UID: \"990bcd7c-d99d-4878-8061-47620888778f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:39.991217 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:39.991195 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2888\" (UniqueName: \"kubernetes.io/projected/990bcd7c-d99d-4878-8061-47620888778f-kube-api-access-s2888\") pod \"kuadrant-console-plugin-66b5774985-tqwlg\" (UID: \"990bcd7c-d99d-4878-8061-47620888778f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:40.485253 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:40.485220 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/990bcd7c-d99d-4878-8061-47620888778f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tqwlg\" (UID: \"990bcd7c-d99d-4878-8061-47620888778f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:40.487560 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:40.487541 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/990bcd7c-d99d-4878-8061-47620888778f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tqwlg\" (UID: \"990bcd7c-d99d-4878-8061-47620888778f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:40.718792 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:40.718762 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" Jul 06 19:32:40.849098 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:40.849075 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg"] Jul 06 19:32:40.851156 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:32:40.851130 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod990bcd7c_d99d_4878_8061_47620888778f.slice/crio-692b9ed3d1c8aa17447a85c8bfd93a478cbf0fc47091c62b33ef90a8001bf4f7 WatchSource:0}: Error finding container 692b9ed3d1c8aa17447a85c8bfd93a478cbf0fc47091c62b33ef90a8001bf4f7: Status 404 returned error can't find the container with id 692b9ed3d1c8aa17447a85c8bfd93a478cbf0fc47091c62b33ef90a8001bf4f7 Jul 06 19:32:41.570243 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:41.570208 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" event={"ID":"990bcd7c-d99d-4878-8061-47620888778f","Type":"ContainerStarted","Data":"692b9ed3d1c8aa17447a85c8bfd93a478cbf0fc47091c62b33ef90a8001bf4f7"} Jul 06 19:32:55.572181 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:55.572144 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn"] Jul 06 19:32:55.620036 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:55.619996 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn"] Jul 06 19:32:55.620193 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:55.620091 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:32:55.623724 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:55.623703 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r8g4j\"" Jul 06 19:32:55.727847 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:55.727807 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ljmzn\" (UID: \"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:32:55.728018 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:55.727948 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcdwv\" (UniqueName: \"kubernetes.io/projected/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-kube-api-access-pcdwv\") pod \"kuadrant-operator-controller-manager-86878c769f-ljmzn\" (UID: \"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:32:55.828783 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:55.828697 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ljmzn\" (UID: \"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:32:55.828940 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:55.828802 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcdwv\" (UniqueName: \"kubernetes.io/projected/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-kube-api-access-pcdwv\") pod \"kuadrant-operator-controller-manager-86878c769f-ljmzn\" (UID: \"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:32:55.829096 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:55.829076 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ljmzn\" (UID: \"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:32:55.861859 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:55.861825 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcdwv\" (UniqueName: \"kubernetes.io/projected/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-kube-api-access-pcdwv\") pod \"kuadrant-operator-controller-manager-86878c769f-ljmzn\" (UID: \"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:32:55.932591 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:32:55.932552 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:33:03.323033 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:03.322998 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn"] Jul 06 19:33:03.323684 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:33:03.323660 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb78b225_ed0a_4fd7_9ed2_4e6f56f5db78.slice/crio-9ba2368817b8f34b003c74738ece9942873bed51a1d821cbddbf1b28ab9e73d6 WatchSource:0}: Error finding container 9ba2368817b8f34b003c74738ece9942873bed51a1d821cbddbf1b28ab9e73d6: Status 404 returned error can't find the container with id 9ba2368817b8f34b003c74738ece9942873bed51a1d821cbddbf1b28ab9e73d6 Jul 06 19:33:03.681420 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:03.681385 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" event={"ID":"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78","Type":"ContainerStarted","Data":"9ba2368817b8f34b003c74738ece9942873bed51a1d821cbddbf1b28ab9e73d6"} Jul 06 19:33:03.682989 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:03.682959 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" event={"ID":"990bcd7c-d99d-4878-8061-47620888778f","Type":"ContainerStarted","Data":"f37fa3113ac4a10212a10fc301160ed6ec003ab24a3f14048b265fdf1bb9c7c6"} Jul 06 19:33:03.710355 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:03.710311 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tqwlg" podStartSLOduration=2.312117552 podStartE2EDuration="24.710296935s" totalImagesPullingTime="22.398179383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:03.708093437 +0000 UTC m=+575.081622129" watchObservedRunningTime="2026-07-06 19:33:03.710296935 +0000 UTC m=+575.083825624" Jul 06 19:33:08.709893 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:08.709856 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" event={"ID":"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78","Type":"ContainerStarted","Data":"a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768"} Jul 06 19:33:08.710251 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:08.709956 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:33:08.749546 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:08.749496 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" podStartSLOduration=8.549266358 podStartE2EDuration="13.749483428s" totalImagesPullingTime="5.20021707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:08.746599746 +0000 UTC m=+580.120128437" watchObservedRunningTime="2026-07-06 19:33:08.749483428 +0000 UTC m=+580.123012117" Jul 06 19:33:19.715863 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:19.715827 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:33:29.096046 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:29.096019 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:33:29.096697 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:29.096480 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:33:44.102143 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:44.102108 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2jssj"] Jul 06 19:33:44.132810 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:44.132779 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2jssj"] Jul 06 19:33:44.132983 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:44.132873 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2jssj" Jul 06 19:33:44.135911 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:44.135885 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qvwfw\"" Jul 06 19:33:44.248554 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:44.248518 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd9j8\" (UniqueName: \"kubernetes.io/projected/b116708f-e7ef-4a5c-af9f-bb98c3b37b54-kube-api-access-sd9j8\") pod \"authorino-75d556bd77-2jssj\" (UID: \"b116708f-e7ef-4a5c-af9f-bb98c3b37b54\") " pod="kuadrant-system/authorino-75d556bd77-2jssj" Jul 06 19:33:44.349496 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:44.349463 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd9j8\" (UniqueName: \"kubernetes.io/projected/b116708f-e7ef-4a5c-af9f-bb98c3b37b54-kube-api-access-sd9j8\") pod \"authorino-75d556bd77-2jssj\" (UID: \"b116708f-e7ef-4a5c-af9f-bb98c3b37b54\") " pod="kuadrant-system/authorino-75d556bd77-2jssj" Jul 06 19:33:44.364105 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:44.364051 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd9j8\" (UniqueName: \"kubernetes.io/projected/b116708f-e7ef-4a5c-af9f-bb98c3b37b54-kube-api-access-sd9j8\") pod \"authorino-75d556bd77-2jssj\" (UID: \"b116708f-e7ef-4a5c-af9f-bb98c3b37b54\") " pod="kuadrant-system/authorino-75d556bd77-2jssj" Jul 06 19:33:44.442736 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:44.442697 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2jssj" Jul 06 19:33:44.574938 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:44.574835 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2jssj"] Jul 06 19:33:44.578068 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:33:44.578038 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb116708f_e7ef_4a5c_af9f_bb98c3b37b54.slice/crio-efb40dca0c52db7c72222cf973a3ac3d3bc464947203ce23dab360d9283a0752 WatchSource:0}: Error finding container efb40dca0c52db7c72222cf973a3ac3d3bc464947203ce23dab360d9283a0752: Status 404 returned error can't find the container with id efb40dca0c52db7c72222cf973a3ac3d3bc464947203ce23dab360d9283a0752 Jul 06 19:33:44.869668 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:44.869616 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2jssj" event={"ID":"b116708f-e7ef-4a5c-af9f-bb98c3b37b54","Type":"ContainerStarted","Data":"efb40dca0c52db7c72222cf973a3ac3d3bc464947203ce23dab360d9283a0752"} Jul 06 19:33:47.887696 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:47.887665 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2jssj" event={"ID":"b116708f-e7ef-4a5c-af9f-bb98c3b37b54","Type":"ContainerStarted","Data":"55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71"} Jul 06 19:33:47.904832 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:33:47.904773 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2jssj" podStartSLOduration=0.660337567 podStartE2EDuration="3.904756862s" totalImagesPullingTime="3.244419295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:47.903669135 +0000 UTC m=+619.277197825" watchObservedRunningTime="2026-07-06 19:33:47.904756862 +0000 UTC m=+619.278285550" Jul 06 19:34:11.960485 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:11.960442 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78489f4f75-6nx5b"] Jul 06 19:34:11.962803 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:11.962786 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78489f4f75-6nx5b" Jul 06 19:34:11.972913 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:11.972888 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78489f4f75-6nx5b"] Jul 06 19:34:11.984627 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:11.984603 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2vrt\" (UniqueName: \"kubernetes.io/projected/3ff75fee-0be1-4868-a4c3-afecf287d03e-kube-api-access-f2vrt\") pod \"authorino-78489f4f75-6nx5b\" (UID: \"3ff75fee-0be1-4868-a4c3-afecf287d03e\") " pod="kuadrant-system/authorino-78489f4f75-6nx5b" Jul 06 19:34:12.066067 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:12.066034 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78489f4f75-6nx5b"] Jul 06 19:34:12.066312 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:34:12.066290 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-f2vrt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-78489f4f75-6nx5b" podUID="3ff75fee-0be1-4868-a4c3-afecf287d03e" Jul 06 19:34:12.085487 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:12.085461 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2vrt\" (UniqueName: \"kubernetes.io/projected/3ff75fee-0be1-4868-a4c3-afecf287d03e-kube-api-access-f2vrt\") pod \"authorino-78489f4f75-6nx5b\" (UID: \"3ff75fee-0be1-4868-a4c3-afecf287d03e\") " pod="kuadrant-system/authorino-78489f4f75-6nx5b" Jul 06 19:34:12.096230 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:12.096210 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2vrt\" (UniqueName: \"kubernetes.io/projected/3ff75fee-0be1-4868-a4c3-afecf287d03e-kube-api-access-f2vrt\") pod \"authorino-78489f4f75-6nx5b\" (UID: \"3ff75fee-0be1-4868-a4c3-afecf287d03e\") " pod="kuadrant-system/authorino-78489f4f75-6nx5b" Jul 06 19:34:12.999515 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:12.999485 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78489f4f75-6nx5b" Jul 06 19:34:13.005612 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:13.005591 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78489f4f75-6nx5b" Jul 06 19:34:13.092967 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:13.092942 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2vrt\" (UniqueName: \"kubernetes.io/projected/3ff75fee-0be1-4868-a4c3-afecf287d03e-kube-api-access-f2vrt\") pod \"3ff75fee-0be1-4868-a4c3-afecf287d03e\" (UID: \"3ff75fee-0be1-4868-a4c3-afecf287d03e\") " Jul 06 19:34:13.094982 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:13.094961 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ff75fee-0be1-4868-a4c3-afecf287d03e-kube-api-access-f2vrt" (OuterVolumeSpecName: "kube-api-access-f2vrt") pod "3ff75fee-0be1-4868-a4c3-afecf287d03e" (UID: "3ff75fee-0be1-4868-a4c3-afecf287d03e"). InnerVolumeSpecName "kube-api-access-f2vrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:34:13.193449 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:13.193418 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2vrt\" (UniqueName: \"kubernetes.io/projected/3ff75fee-0be1-4868-a4c3-afecf287d03e-kube-api-access-f2vrt\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:34:13.963648 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:13.963597 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2jssj"] Jul 06 19:34:13.963833 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:13.963790 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2jssj" podUID="b116708f-e7ef-4a5c-af9f-bb98c3b37b54" containerName="authorino" containerID="cri-o://55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71" gracePeriod=30 Jul 06 19:34:14.003260 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:14.003236 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78489f4f75-6nx5b" Jul 06 19:34:14.054568 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:14.054546 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78489f4f75-6nx5b"] Jul 06 19:34:14.058229 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:14.058205 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78489f4f75-6nx5b"] Jul 06 19:34:14.209572 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:14.209551 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2jssj" Jul 06 19:34:14.302242 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:14.302222 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd9j8\" (UniqueName: \"kubernetes.io/projected/b116708f-e7ef-4a5c-af9f-bb98c3b37b54-kube-api-access-sd9j8\") pod \"b116708f-e7ef-4a5c-af9f-bb98c3b37b54\" (UID: \"b116708f-e7ef-4a5c-af9f-bb98c3b37b54\") " Jul 06 19:34:14.304266 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:14.304243 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b116708f-e7ef-4a5c-af9f-bb98c3b37b54-kube-api-access-sd9j8" (OuterVolumeSpecName: "kube-api-access-sd9j8") pod "b116708f-e7ef-4a5c-af9f-bb98c3b37b54" (UID: "b116708f-e7ef-4a5c-af9f-bb98c3b37b54"). InnerVolumeSpecName "kube-api-access-sd9j8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:34:14.403464 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:14.403438 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd9j8\" (UniqueName: \"kubernetes.io/projected/b116708f-e7ef-4a5c-af9f-bb98c3b37b54-kube-api-access-sd9j8\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:34:15.008669 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:15.008615 2584 generic.go:356] "Generic (PLEG): container finished" podID="b116708f-e7ef-4a5c-af9f-bb98c3b37b54" containerID="55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71" exitCode=0 Jul 06 19:34:15.009154 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:15.008676 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2jssj" Jul 06 19:34:15.009154 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:15.008693 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2jssj" event={"ID":"b116708f-e7ef-4a5c-af9f-bb98c3b37b54","Type":"ContainerDied","Data":"55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71"} Jul 06 19:34:15.009154 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:15.008735 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2jssj" event={"ID":"b116708f-e7ef-4a5c-af9f-bb98c3b37b54","Type":"ContainerDied","Data":"efb40dca0c52db7c72222cf973a3ac3d3bc464947203ce23dab360d9283a0752"} Jul 06 19:34:15.009154 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:15.008752 2584 scope.go:117] "RemoveContainer" containerID="55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71" Jul 06 19:34:15.017251 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:15.017236 2584 scope.go:117] "RemoveContainer" containerID="55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71" Jul 06 19:34:15.017513 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:34:15.017492 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71\": container with ID starting with 55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71 not found: ID does not exist" containerID="55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71" Jul 06 19:34:15.017559 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:15.017523 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71"} err="failed to get container status \"55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71\": rpc error: code = NotFound desc = could not find container \"55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71\": container with ID starting with 55dc7721f05614df624586bd2cea06a7c1a8cefef235b841bcf769e89ae6da71 not found: ID does not exist" Jul 06 19:34:15.036672 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:15.036653 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2jssj"] Jul 06 19:34:15.042953 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:15.042936 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2jssj"] Jul 06 19:34:15.255414 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:15.255384 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ff75fee-0be1-4868-a4c3-afecf287d03e" path="/var/lib/kubelet/pods/3ff75fee-0be1-4868-a4c3-afecf287d03e/volumes" Jul 06 19:34:15.255599 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:34:15.255587 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b116708f-e7ef-4a5c-af9f-bb98c3b37b54" path="/var/lib/kubelet/pods/b116708f-e7ef-4a5c-af9f-bb98c3b37b54/volumes" Jul 06 19:35:45.918195 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.918110 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg"] Jul 06 19:35:45.918646 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.918497 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b116708f-e7ef-4a5c-af9f-bb98c3b37b54" containerName="authorino" Jul 06 19:35:45.918646 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.918511 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b116708f-e7ef-4a5c-af9f-bb98c3b37b54" containerName="authorino" Jul 06 19:35:45.918646 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.918561 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b116708f-e7ef-4a5c-af9f-bb98c3b37b54" containerName="authorino" Jul 06 19:35:45.920654 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.920618 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:45.925563 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.924192 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hflkh\"" Jul 06 19:35:45.925563 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.924513 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 19:35:45.925563 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.924770 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 19:35:45.925563 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.924994 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 19:35:45.934506 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.934481 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg"] Jul 06 19:35:45.992621 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.992585 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:45.992805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.992623 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qhtn\" (UniqueName: \"kubernetes.io/projected/54110ff6-b71b-4e99-b352-11f03fb7328a-kube-api-access-6qhtn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:45.992805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.992687 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:45.992805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.992722 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:45.992805 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.992783 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:45.992942 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:45.992814 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54110ff6-b71b-4e99-b352-11f03fb7328a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.093515 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.093481 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.093726 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.093524 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54110ff6-b71b-4e99-b352-11f03fb7328a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.093726 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.093603 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.093809 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.093743 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qhtn\" (UniqueName: \"kubernetes.io/projected/54110ff6-b71b-4e99-b352-11f03fb7328a-kube-api-access-6qhtn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.093809 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.093781 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.093880 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.093821 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.093948 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.093925 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.094156 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.094134 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.094295 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.094198 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.096043 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.096017 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54110ff6-b71b-4e99-b352-11f03fb7328a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.096144 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.096117 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54110ff6-b71b-4e99-b352-11f03fb7328a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.102968 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.102938 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qhtn\" (UniqueName: \"kubernetes.io/projected/54110ff6-b71b-4e99-b352-11f03fb7328a-kube-api-access-6qhtn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7l8hg\" (UID: \"54110ff6-b71b-4e99-b352-11f03fb7328a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.236532 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.236443 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:46.372942 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.372913 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg"] Jul 06 19:35:46.375719 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:35:46.375682 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54110ff6_b71b_4e99_b352_11f03fb7328a.slice/crio-20a5fff367986e9f86762fd81d264ff6fbef500710b0917b81af14d43420c762 WatchSource:0}: Error finding container 20a5fff367986e9f86762fd81d264ff6fbef500710b0917b81af14d43420c762: Status 404 returned error can't find the container with id 20a5fff367986e9f86762fd81d264ff6fbef500710b0917b81af14d43420c762 Jul 06 19:35:46.377233 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.377208 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:35:46.413273 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:46.413239 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" event={"ID":"54110ff6-b71b-4e99-b352-11f03fb7328a","Type":"ContainerStarted","Data":"20a5fff367986e9f86762fd81d264ff6fbef500710b0917b81af14d43420c762"} Jul 06 19:35:48.422903 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:48.422872 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" event={"ID":"54110ff6-b71b-4e99-b352-11f03fb7328a","Type":"ContainerStarted","Data":"112ea68652336b1d625b4eb07742e60e77e6e7a96f8a45d3f8e6e8c6b4af883f"} Jul 06 19:35:48.444939 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:48.444883 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" podStartSLOduration=2.446999718 podStartE2EDuration="3.444865745s" totalImagesPullingTime="997.866027ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:48.4432474 +0000 UTC m=+739.816776091" watchObservedRunningTime="2026-07-06 19:35:48.444865745 +0000 UTC m=+739.818394435" Jul 06 19:35:55.713394 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.713360 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6"] Jul 06 19:35:55.715777 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.715761 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.718572 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.718549 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 19:35:55.726755 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.726727 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6"] Jul 06 19:35:55.779348 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.779317 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.779479 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.779355 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.779479 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.779377 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81fb0da2-8563-4189-b98f-00318ab681f1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.779479 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.779396 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt24w\" (UniqueName: \"kubernetes.io/projected/81fb0da2-8563-4189-b98f-00318ab681f1-kube-api-access-lt24w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.779479 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.779447 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.779479 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.779469 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.880649 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.880603 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.880820 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.880672 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.880820 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.880697 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81fb0da2-8563-4189-b98f-00318ab681f1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.880820 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.880725 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt24w\" (UniqueName: \"kubernetes.io/projected/81fb0da2-8563-4189-b98f-00318ab681f1-kube-api-access-lt24w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.880820 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.880759 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.880820 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.880796 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.881187 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.881036 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.881243 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.881199 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.881332 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.881310 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.883096 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.883073 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81fb0da2-8563-4189-b98f-00318ab681f1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.883322 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.883304 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81fb0da2-8563-4189-b98f-00318ab681f1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:55.892208 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:55.892186 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt24w\" (UniqueName: \"kubernetes.io/projected/81fb0da2-8563-4189-b98f-00318ab681f1-kube-api-access-lt24w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6\" (UID: \"81fb0da2-8563-4189-b98f-00318ab681f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:56.025814 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:56.025789 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:35:56.165626 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:56.165604 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6"] Jul 06 19:35:56.167878 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:35:56.167854 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fb0da2_8563_4189_b98f_00318ab681f1.slice/crio-b90eca047c90268fb8b6a0aa7531a2ea567327dd9220be0add3b873f9ef3bf43 WatchSource:0}: Error finding container b90eca047c90268fb8b6a0aa7531a2ea567327dd9220be0add3b873f9ef3bf43: Status 404 returned error can't find the container with id b90eca047c90268fb8b6a0aa7531a2ea567327dd9220be0add3b873f9ef3bf43 Jul 06 19:35:56.237430 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:56.237407 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:56.237561 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:56.237463 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:56.249856 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:56.249837 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:56.461411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:56.461375 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" event={"ID":"81fb0da2-8563-4189-b98f-00318ab681f1","Type":"ContainerStarted","Data":"4d2fe560ed31be5fddbe375d580ca963e1c409aafcb40af8173fb8dc5af2bd7f"} Jul 06 19:35:56.461570 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:56.461439 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" event={"ID":"81fb0da2-8563-4189-b98f-00318ab681f1","Type":"ContainerStarted","Data":"b90eca047c90268fb8b6a0aa7531a2ea567327dd9220be0add3b873f9ef3bf43"} Jul 06 19:35:56.472752 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:56.472731 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7l8hg" Jul 06 19:35:56.482512 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:35:56.482474 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" podStartSLOduration=1.3226650420000001 podStartE2EDuration="1.482459559s" totalImagesPullingTime="159.794517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:56.480071941 +0000 UTC m=+747.853600657" watchObservedRunningTime="2026-07-06 19:35:56.482459559 +0000 UTC m=+747.855988249" Jul 06 19:36:06.026099 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:36:06.026058 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:36:06.026580 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:36:06.026127 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:36:06.038530 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:36:06.038507 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:36:06.516207 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:36:06.516131 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6" Jul 06 19:38:29.130903 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:38:29.130823 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:38:29.133374 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:38:29.133349 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:43:29.159056 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:29.159023 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:43:29.162163 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:29.162140 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:43:33.099533 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:33.099497 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn"] Jul 06 19:43:33.099986 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:33.099691 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" podUID="bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78" containerName="manager" containerID="cri-o://a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768" gracePeriod=10 Jul 06 19:43:36.142511 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.142485 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:43:36.282959 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.282925 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-extensions-socket-volume\") pod \"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78\" (UID: \"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78\") " Jul 06 19:43:36.283148 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.283022 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcdwv\" (UniqueName: \"kubernetes.io/projected/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-kube-api-access-pcdwv\") pod \"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78\" (UID: \"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78\") " Jul 06 19:43:36.283364 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.283337 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78" (UID: "bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:43:36.285128 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.285108 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-kube-api-access-pcdwv" (OuterVolumeSpecName: "kube-api-access-pcdwv") pod "bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78" (UID: "bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78"). InnerVolumeSpecName "kube-api-access-pcdwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:43:36.385907 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.384026 2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-extensions-socket-volume\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:43:36.385907 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.384058 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcdwv\" (UniqueName: \"kubernetes.io/projected/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78-kube-api-access-pcdwv\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:43:36.528436 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.528401 2584 generic.go:356] "Generic (PLEG): container finished" podID="bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78" containerID="a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768" exitCode=0 Jul 06 19:43:36.528591 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.528446 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" Jul 06 19:43:36.528591 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.528459 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" event={"ID":"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78","Type":"ContainerDied","Data":"a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768"} Jul 06 19:43:36.528591 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.528510 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn" event={"ID":"bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78","Type":"ContainerDied","Data":"9ba2368817b8f34b003c74738ece9942873bed51a1d821cbddbf1b28ab9e73d6"} Jul 06 19:43:36.528591 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.528540 2584 scope.go:117] "RemoveContainer" containerID="a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768" Jul 06 19:43:36.538089 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.538069 2584 scope.go:117] "RemoveContainer" containerID="a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768" Jul 06 19:43:36.538358 ip-10-0-138-110 kubenswrapper[2584]: E0706 19:43:36.538340 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768\": container with ID starting with a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768 not found: ID does not exist" containerID="a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768" Jul 06 19:43:36.538408 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.538368 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768"} err="failed to get container status \"a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768\": rpc error: code = NotFound desc = could not find container \"a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768\": container with ID starting with a61bbfb9dc75f06f7c2b1c251edb26c8a4e1c1e18e91dc22e0958b185e8e9768 not found: ID does not exist" Jul 06 19:43:36.550777 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.550753 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn"] Jul 06 19:43:36.555695 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:36.555676 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljmzn"] Jul 06 19:43:37.255360 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:43:37.255329 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78" path="/var/lib/kubelet/pods/bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78/volumes" Jul 06 19:44:41.346266 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.346231 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k"] Jul 06 19:44:41.346753 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.346599 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78" containerName="manager" Jul 06 19:44:41.346753 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.346610 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78" containerName="manager" Jul 06 19:44:41.346753 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.346691 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb78b225-ed0a-4fd7-9ed2-4e6f56f5db78" containerName="manager" Jul 06 19:44:41.349991 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.349975 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:44:41.352719 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.352693 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r8g4j\"" Jul 06 19:44:41.360819 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.360795 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k"] Jul 06 19:44:41.512421 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.512386 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t78nm\" (UniqueName: \"kubernetes.io/projected/b8c21896-683d-4d7f-8c5b-80677fc8a45f-kube-api-access-t78nm\") pod \"kuadrant-operator-controller-manager-86878c769f-27z9k\" (UID: \"b8c21896-683d-4d7f-8c5b-80677fc8a45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:44:41.512598 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.512463 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8c21896-683d-4d7f-8c5b-80677fc8a45f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-27z9k\" (UID: \"b8c21896-683d-4d7f-8c5b-80677fc8a45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:44:41.613313 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.613236 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8c21896-683d-4d7f-8c5b-80677fc8a45f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-27z9k\" (UID: \"b8c21896-683d-4d7f-8c5b-80677fc8a45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:44:41.613313 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.613294 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t78nm\" (UniqueName: \"kubernetes.io/projected/b8c21896-683d-4d7f-8c5b-80677fc8a45f-kube-api-access-t78nm\") pod \"kuadrant-operator-controller-manager-86878c769f-27z9k\" (UID: \"b8c21896-683d-4d7f-8c5b-80677fc8a45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:44:41.613613 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.613594 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8c21896-683d-4d7f-8c5b-80677fc8a45f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-27z9k\" (UID: \"b8c21896-683d-4d7f-8c5b-80677fc8a45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:44:41.621427 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.621398 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t78nm\" (UniqueName: \"kubernetes.io/projected/b8c21896-683d-4d7f-8c5b-80677fc8a45f-kube-api-access-t78nm\") pod \"kuadrant-operator-controller-manager-86878c769f-27z9k\" (UID: \"b8c21896-683d-4d7f-8c5b-80677fc8a45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:44:41.660259 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.660232 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:44:41.798370 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.798344 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k"] Jul 06 19:44:41.799715 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:44:41.799688 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c21896_683d_4d7f_8c5b_80677fc8a45f.slice/crio-f65f4fbb752ae31eff20e9634e1ba7ec7ede7033b44a7a5b30031310303a50e5 WatchSource:0}: Error finding container f65f4fbb752ae31eff20e9634e1ba7ec7ede7033b44a7a5b30031310303a50e5: Status 404 returned error can't find the container with id f65f4fbb752ae31eff20e9634e1ba7ec7ede7033b44a7a5b30031310303a50e5 Jul 06 19:44:41.819599 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:41.819544 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" event={"ID":"b8c21896-683d-4d7f-8c5b-80677fc8a45f","Type":"ContainerStarted","Data":"f65f4fbb752ae31eff20e9634e1ba7ec7ede7033b44a7a5b30031310303a50e5"} Jul 06 19:44:42.826235 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:42.826204 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" event={"ID":"b8c21896-683d-4d7f-8c5b-80677fc8a45f","Type":"ContainerStarted","Data":"9f37934a2e92bb33b1d54d3b82c013ea8e3f4608cfc41b67ef968a4c651c110f"} Jul 06 19:44:42.826611 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:42.826319 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:44:42.855611 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:42.855561 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" podStartSLOduration=1.855545426 podStartE2EDuration="1.855545426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:44:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:44:42.854594961 +0000 UTC m=+1274.228123651" watchObservedRunningTime="2026-07-06 19:44:42.855545426 +0000 UTC m=+1274.229074116" Jul 06 19:44:53.832384 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:44:53.832353 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:45:00.150023 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:00.149990 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-z69j4"] Jul 06 19:45:00.153318 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:00.153297 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" Jul 06 19:45:00.156921 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:00.156894 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sxprk\"" Jul 06 19:45:00.164896 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:00.164874 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-z69j4"] Jul 06 19:45:00.279427 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:00.279397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ztvj\" (UniqueName: \"kubernetes.io/projected/29058e4e-4711-45e0-90c4-04141169e103-kube-api-access-7ztvj\") pod \"maas-api-key-cleanup-29722785-z69j4\" (UID: \"29058e4e-4711-45e0-90c4-04141169e103\") " pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" Jul 06 19:45:00.380435 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:00.380400 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztvj\" (UniqueName: \"kubernetes.io/projected/29058e4e-4711-45e0-90c4-04141169e103-kube-api-access-7ztvj\") pod \"maas-api-key-cleanup-29722785-z69j4\" (UID: \"29058e4e-4711-45e0-90c4-04141169e103\") " pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" Jul 06 19:45:00.389409 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:00.389375 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ztvj\" (UniqueName: \"kubernetes.io/projected/29058e4e-4711-45e0-90c4-04141169e103-kube-api-access-7ztvj\") pod \"maas-api-key-cleanup-29722785-z69j4\" (UID: \"29058e4e-4711-45e0-90c4-04141169e103\") " pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" Jul 06 19:45:00.463127 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:00.463045 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" Jul 06 19:45:00.592413 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:00.592383 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-z69j4"] Jul 06 19:45:00.594118 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:45:00.594092 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29058e4e_4711_45e0_90c4_04141169e103.slice/crio-caa65accc8b497975dc0cda05411d4d92fc51cad5106c601f0922c08bc1ffd3a WatchSource:0}: Error finding container caa65accc8b497975dc0cda05411d4d92fc51cad5106c601f0922c08bc1ffd3a: Status 404 returned error can't find the container with id caa65accc8b497975dc0cda05411d4d92fc51cad5106c601f0922c08bc1ffd3a Jul 06 19:45:00.596084 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:00.596066 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:45:00.916545 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:00.916513 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" event={"ID":"29058e4e-4711-45e0-90c4-04141169e103","Type":"ContainerStarted","Data":"caa65accc8b497975dc0cda05411d4d92fc51cad5106c601f0922c08bc1ffd3a"} Jul 06 19:45:03.932555 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:03.932507 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" event={"ID":"29058e4e-4711-45e0-90c4-04141169e103","Type":"ContainerStarted","Data":"694b23b5385f8ef11cc0992f0826994a617e96f9d427cc160b1e8585d800eb4c"} Jul 06 19:45:03.951707 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:03.951657 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" podStartSLOduration=1.522839262 podStartE2EDuration="3.951625462s" totalImagesPullingTime="2.4287862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:03.949220565 +0000 UTC m=+1295.322749265" watchObservedRunningTime="2026-07-06 19:45:03.951625462 +0000 UTC m=+1295.325154152" Jul 06 19:45:04.938399 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:04.938361 2584 generic.go:356] "Generic (PLEG): container finished" podID="29058e4e-4711-45e0-90c4-04141169e103" containerID="694b23b5385f8ef11cc0992f0826994a617e96f9d427cc160b1e8585d800eb4c" exitCode=0 Jul 06 19:45:04.938794 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:04.938447 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" event={"ID":"29058e4e-4711-45e0-90c4-04141169e103","Type":"ContainerDied","Data":"694b23b5385f8ef11cc0992f0826994a617e96f9d427cc160b1e8585d800eb4c"} Jul 06 19:45:06.076616 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:06.076591 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" Jul 06 19:45:06.134790 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:06.134761 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ztvj\" (UniqueName: \"kubernetes.io/projected/29058e4e-4711-45e0-90c4-04141169e103-kube-api-access-7ztvj\") pod \"29058e4e-4711-45e0-90c4-04141169e103\" (UID: \"29058e4e-4711-45e0-90c4-04141169e103\") " Jul 06 19:45:06.136916 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:06.136889 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29058e4e-4711-45e0-90c4-04141169e103-kube-api-access-7ztvj" (OuterVolumeSpecName: "kube-api-access-7ztvj") pod "29058e4e-4711-45e0-90c4-04141169e103" (UID: "29058e4e-4711-45e0-90c4-04141169e103"). InnerVolumeSpecName "kube-api-access-7ztvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:45:06.236268 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:06.236183 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ztvj\" (UniqueName: \"kubernetes.io/projected/29058e4e-4711-45e0-90c4-04141169e103-kube-api-access-7ztvj\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\"" Jul 06 19:45:06.949236 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:06.949199 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" event={"ID":"29058e4e-4711-45e0-90c4-04141169e103","Type":"ContainerDied","Data":"caa65accc8b497975dc0cda05411d4d92fc51cad5106c601f0922c08bc1ffd3a"} Jul 06 19:45:06.949236 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:06.949217 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-z69j4" Jul 06 19:45:06.949441 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:45:06.949274 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="caa65accc8b497975dc0cda05411d4d92fc51cad5106c601f0922c08bc1ffd3a" Jul 06 19:48:29.187840 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:48:29.187813 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:48:29.191382 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:48:29.191359 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:49:51.245925 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:49:51.245889 2584 generic.go:356] "Generic (PLEG): container finished" podID="b8c21896-683d-4d7f-8c5b-80677fc8a45f" containerID="9f37934a2e92bb33b1d54d3b82c013ea8e3f4608cfc41b67ef968a4c651c110f" exitCode=0 Jul 06 19:49:51.246330 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:49:51.245947 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" event={"ID":"b8c21896-683d-4d7f-8c5b-80677fc8a45f","Type":"ContainerDied","Data":"9f37934a2e92bb33b1d54d3b82c013ea8e3f4608cfc41b67ef968a4c651c110f"} Jul 06 19:49:51.246330 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:49:51.246299 2584 scope.go:117] "RemoveContainer" containerID="9f37934a2e92bb33b1d54d3b82c013ea8e3f4608cfc41b67ef968a4c651c110f" Jul 06 19:49:52.252353 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:49:52.252313 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" event={"ID":"b8c21896-683d-4d7f-8c5b-80677fc8a45f","Type":"ContainerStarted","Data":"16b3b87e484f65816e15f2d2b50adc5c0f39017ddf844ff2a147211e89e2ed32"} Jul 06 19:49:52.252851 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:49:52.252551 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:50:03.258731 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:03.258700 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-27z9k" Jul 06 19:50:04.563745 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:04.563713 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-z69j4_29058e4e-4711-45e0-90c4-04141169e103/cleanup/0.log" Jul 06 19:50:05.076230 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:05.076204 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b84dcb6b7-m8w8n_19c32208-f6ac-4330-9d70-b5dc45e892e6/copy-manifests/0.log" Jul 06 19:50:05.087875 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:05.087845 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b84dcb6b7-m8w8n_19c32208-f6ac-4330-9d70-b5dc45e892e6/manager/0.log" Jul 06 19:50:08.144121 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:08.144092 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tqwlg_990bcd7c-d99d-4878-8061-47620888778f/kuadrant-console-plugin/0.log" Jul 06 19:50:13.647699 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:13.647652 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-27z9k_b8c21896-683d-4d7f-8c5b-80677fc8a45f/manager/1.log" Jul 06 19:50:14.497411 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:14.497354 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fb5b84c75-d98rr_6626cdfd-c707-452d-a073-8ed0ca02ae4b/kube-auth-proxy/0.log" Jul 06 19:50:15.165562 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:15.165530 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5947498495-gc2hh_d9096032-bd93-4923-b366-814e541ce48e/router/0.log" Jul 06 19:50:15.789838 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:15.789796 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7l8hg_54110ff6-b71b-4e99-b352-11f03fb7328a/main/0.log" Jul 06 19:50:15.904141 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:15.904111 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2v2p6_81fb0da2-8563-4189-b98f-00318ab681f1/main/0.log" Jul 06 19:50:45.888712 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:45.888664 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2lm8v/must-gather-9nrtj"] Jul 06 19:50:45.889175 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:45.889025 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29058e4e-4711-45e0-90c4-04141169e103" containerName="cleanup" Jul 06 19:50:45.889175 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:45.889036 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="29058e4e-4711-45e0-90c4-04141169e103" containerName="cleanup" Jul 06 19:50:45.889175 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:45.889116 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="29058e4e-4711-45e0-90c4-04141169e103" containerName="cleanup" Jul 06 19:50:45.891255 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:45.891239 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2lm8v/must-gather-9nrtj" Jul 06 19:50:45.894958 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:45.894935 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2lm8v\"/\"kube-root-ca.crt\"" Jul 06 19:50:45.896429 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:45.896401 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2lm8v\"/\"default-dockercfg-klnzq\"" Jul 06 19:50:45.896547 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:45.896430 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2lm8v\"/\"openshift-service-ca.crt\"" Jul 06 19:50:45.924158 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:45.924133 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2lm8v/must-gather-9nrtj"] Jul 06 19:50:46.041970 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:46.041938 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpf2z\" (UniqueName: \"kubernetes.io/projected/222d2b76-0589-424f-adad-6b1fc6b30a39-kube-api-access-jpf2z\") pod \"must-gather-9nrtj\" (UID: \"222d2b76-0589-424f-adad-6b1fc6b30a39\") " pod="openshift-must-gather-2lm8v/must-gather-9nrtj" Jul 06 19:50:46.042160 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:46.042043 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/222d2b76-0589-424f-adad-6b1fc6b30a39-must-gather-output\") pod \"must-gather-9nrtj\" (UID: \"222d2b76-0589-424f-adad-6b1fc6b30a39\") " pod="openshift-must-gather-2lm8v/must-gather-9nrtj" Jul 06 19:50:46.142977 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:46.142887 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/222d2b76-0589-424f-adad-6b1fc6b30a39-must-gather-output\") pod \"must-gather-9nrtj\" (UID: \"222d2b76-0589-424f-adad-6b1fc6b30a39\") " pod="openshift-must-gather-2lm8v/must-gather-9nrtj" Jul 06 19:50:46.142977 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:46.142945 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpf2z\" (UniqueName: \"kubernetes.io/projected/222d2b76-0589-424f-adad-6b1fc6b30a39-kube-api-access-jpf2z\") pod \"must-gather-9nrtj\" (UID: \"222d2b76-0589-424f-adad-6b1fc6b30a39\") " pod="openshift-must-gather-2lm8v/must-gather-9nrtj" Jul 06 19:50:46.143307 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:46.143284 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/222d2b76-0589-424f-adad-6b1fc6b30a39-must-gather-output\") pod \"must-gather-9nrtj\" (UID: \"222d2b76-0589-424f-adad-6b1fc6b30a39\") " pod="openshift-must-gather-2lm8v/must-gather-9nrtj" Jul 06 19:50:46.161023 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:46.160994 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpf2z\" (UniqueName: \"kubernetes.io/projected/222d2b76-0589-424f-adad-6b1fc6b30a39-kube-api-access-jpf2z\") pod \"must-gather-9nrtj\" (UID: \"222d2b76-0589-424f-adad-6b1fc6b30a39\") " pod="openshift-must-gather-2lm8v/must-gather-9nrtj" Jul 06 19:50:46.199944 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:46.199921 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2lm8v/must-gather-9nrtj" Jul 06 19:50:46.350755 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:50:46.350728 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod222d2b76_0589_424f_adad_6b1fc6b30a39.slice/crio-3fcc0e39afab4f2eb98cbd7a9a3cc6d7662da688c03ffd3ef257b213cba5829b WatchSource:0}: Error finding container 3fcc0e39afab4f2eb98cbd7a9a3cc6d7662da688c03ffd3ef257b213cba5829b: Status 404 returned error can't find the container with id 3fcc0e39afab4f2eb98cbd7a9a3cc6d7662da688c03ffd3ef257b213cba5829b Jul 06 19:50:46.352543 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:46.352526 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:50:46.353311 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:46.353277 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2lm8v/must-gather-9nrtj"] Jul 06 19:50:46.509988 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:46.509891 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2lm8v/must-gather-9nrtj" event={"ID":"222d2b76-0589-424f-adad-6b1fc6b30a39","Type":"ContainerStarted","Data":"3fcc0e39afab4f2eb98cbd7a9a3cc6d7662da688c03ffd3ef257b213cba5829b"} Jul 06 19:50:47.516346 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:47.516233 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2lm8v/must-gather-9nrtj" event={"ID":"222d2b76-0589-424f-adad-6b1fc6b30a39","Type":"ContainerStarted","Data":"7b30c9fd09238dec985f0aa21aad79ff9b870067cc2b5c16b52ee5db96901d62"} Jul 06 19:50:47.516346 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:47.516273 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2lm8v/must-gather-9nrtj" event={"ID":"222d2b76-0589-424f-adad-6b1fc6b30a39","Type":"ContainerStarted","Data":"8c9807cf41fd84a3966704ea115eea91084db481dec39a3d7ef700f2792e8c26"} Jul 06 19:50:47.550687 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:47.550004 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2lm8v/must-gather-9nrtj" podStartSLOduration=1.657600172 podStartE2EDuration="2.549980704s" totalImagesPullingTime="892.380532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:47.548946496 +0000 UTC m=+1638.922475181" watchObservedRunningTime="2026-07-06 19:50:47.549980704 +0000 UTC m=+1638.923509395" Jul 06 19:50:50.398612 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:50.398586 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nr7zv_7637e55c-ea03-45d3-aeb8-db957eefe955/global-pull-secret-syncer/0.log" Jul 06 19:50:50.715714 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:50.715609 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jr677_93636edc-249a-4292-9002-099de6718579/konnectivity-agent/0.log" Jul 06 19:50:51.937026 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:51.936991 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-110.ec2.internal_7a82202aae61ad36a164e7de6fe394cc/haproxy/0.log" Jul 06 19:50:55.871519 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:55.871491 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tqwlg_990bcd7c-d99d-4878-8061-47620888778f/kuadrant-console-plugin/0.log" Jul 06 19:50:56.305794 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:56.305763 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-27z9k_b8c21896-683d-4d7f-8c5b-80677fc8a45f/manager/1.log" Jul 06 19:50:56.375047 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:56.374952 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-27z9k_b8c21896-683d-4d7f-8c5b-80677fc8a45f/manager/0.log" Jul 06 19:50:58.604405 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:58.604361 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1b5620af-e789-44ab-8b54-6881e32c1bc5/alertmanager/0.log" Jul 06 19:50:58.654439 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:58.654405 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1b5620af-e789-44ab-8b54-6881e32c1bc5/config-reloader/0.log" Jul 06 19:50:58.711850 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:58.711823 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1b5620af-e789-44ab-8b54-6881e32c1bc5/kube-rbac-proxy-web/0.log" Jul 06 19:50:58.781544 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:58.781518 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1b5620af-e789-44ab-8b54-6881e32c1bc5/kube-rbac-proxy/0.log" Jul 06 19:50:58.858881 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:58.858852 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1b5620af-e789-44ab-8b54-6881e32c1bc5/kube-rbac-proxy-metric/0.log" Jul 06 19:50:58.956427 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:58.956292 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1b5620af-e789-44ab-8b54-6881e32c1bc5/prom-label-proxy/0.log" Jul 06 19:50:59.035493 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.035406 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1b5620af-e789-44ab-8b54-6881e32c1bc5/init-config-reloader/0.log" Jul 06 19:50:59.300454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.300376 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6"] Jul 06 19:50:59.306061 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.306036 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.336701 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.336669 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6"] Jul 06 19:50:59.380454 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.380416 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2clh\" (UniqueName: \"kubernetes.io/projected/894f7ea8-0be7-4811-819c-14a870b28005-kube-api-access-p2clh\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.380684 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.380494 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-lib-modules\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.380684 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.380622 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-sys\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.380810 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.380684 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-podres\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.380810 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.380709 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-proc\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.481573 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.481542 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2clh\" (UniqueName: \"kubernetes.io/projected/894f7ea8-0be7-4811-819c-14a870b28005-kube-api-access-p2clh\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.481741 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.481610 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-lib-modules\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.481741 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.481705 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-sys\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.481741 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.481728 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-podres\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.481847 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.481750 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-proc\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.481847 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.481813 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-lib-modules\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.481912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.481864 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-proc\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.481912 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.481880 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-sys\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.481975 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.481952 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/894f7ea8-0be7-4811-819c-14a870b28005-podres\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.490382 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.490362 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6876d8589b-8tt6d_c2d8f152-3233-4880-8ba2-3709c1e59408/metrics-server/0.log" Jul 06 19:50:59.493918 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.493893 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2clh\" (UniqueName: \"kubernetes.io/projected/894f7ea8-0be7-4811-819c-14a870b28005-kube-api-access-p2clh\") pod \"perf-node-gather-daemonset-5l8j6\" (UID: \"894f7ea8-0be7-4811-819c-14a870b28005\") " pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.618898 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.618777 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:50:59.790198 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.790173 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6"] Jul 06 19:50:59.792056 ip-10-0-138-110 kubenswrapper[2584]: W0706 19:50:59.792025 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod894f7ea8_0be7_4811_819c_14a870b28005.slice/crio-b6a8037cd24588e088b040dfc849d64ac95730ed2a7df66a5c9a91cf6ea19592 WatchSource:0}: Error finding container b6a8037cd24588e088b040dfc849d64ac95730ed2a7df66a5c9a91cf6ea19592: Status 404 returned error can't find the container with id b6a8037cd24588e088b040dfc849d64ac95730ed2a7df66a5c9a91cf6ea19592 Jul 06 19:50:59.824737 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.824698 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k295w_2fe0196a-27f7-4465-a7cb-3880bcf8abd9/node-exporter/0.log" Jul 06 19:50:59.885364 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.885284 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k295w_2fe0196a-27f7-4465-a7cb-3880bcf8abd9/kube-rbac-proxy/0.log" Jul 06 19:50:59.944122 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:50:59.944099 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k295w_2fe0196a-27f7-4465-a7cb-3880bcf8abd9/init-textfile/0.log" Jul 06 19:51:00.200691 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.200610 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-r6hfx_ca9d451c-aedb-451d-85cf-51159fefeb60/kube-rbac-proxy-main/0.log" Jul 06 19:51:00.242625 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.242594 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-r6hfx_ca9d451c-aedb-451d-85cf-51159fefeb60/kube-rbac-proxy-self/0.log" Jul 06 19:51:00.300503 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.300465 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-r6hfx_ca9d451c-aedb-451d-85cf-51159fefeb60/openshift-state-metrics/0.log" Jul 06 19:51:00.385809 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.385784 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca/prometheus/0.log" Jul 06 19:51:00.420862 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.420840 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca/config-reloader/0.log" Jul 06 19:51:00.458951 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.458879 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca/thanos-sidecar/0.log" Jul 06 19:51:00.518204 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.518180 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca/kube-rbac-proxy-web/0.log" Jul 06 19:51:00.594474 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.594446 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca/kube-rbac-proxy/0.log" Jul 06 19:51:00.600765 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.600737 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" event={"ID":"894f7ea8-0be7-4811-819c-14a870b28005","Type":"ContainerStarted","Data":"106a6762144f2fa494623a61e4fe04593b71794554e4b35ebbf32d30a4191f07"} Jul 06 19:51:00.600918 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.600807 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" event={"ID":"894f7ea8-0be7-4811-819c-14a870b28005","Type":"ContainerStarted","Data":"b6a8037cd24588e088b040dfc849d64ac95730ed2a7df66a5c9a91cf6ea19592"} Jul 06 19:51:00.600918 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.600851 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:51:00.647533 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.647485 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" podStartSLOduration=1.647470279 podStartE2EDuration="1.647470279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:00.643562249 +0000 UTC m=+1652.017090940" watchObservedRunningTime="2026-07-06 19:51:00.647470279 +0000 UTC m=+1652.020998980" Jul 06 19:51:00.654340 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.654312 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca/kube-rbac-proxy-thanos/0.log" Jul 06 19:51:00.732152 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.732077 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2f91b43-81a3-4c4f-885f-c5eb9e8a46ca/init-config-reloader/0.log" Jul 06 19:51:00.954019 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:00.953966 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-94rxh_2ebe7053-1af7-4e5d-8548-453e74faab21/prometheus-operator-admission-webhook/0.log" Jul 06 19:51:03.232745 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:03.232709 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/2.log" Jul 06 19:51:03.237732 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:03.237707 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k8f45_086c7937-63b2-4201-9f1e-fba3d640fb91/console-operator/3.log" Jul 06 19:51:05.690381 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:05.690350 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gmtjr_f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d/dns/0.log" Jul 06 19:51:05.714247 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:05.714223 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gmtjr_f53f24c4-2baf-44a1-90e0-1ccb2dcfb87d/kube-rbac-proxy/0.log" Jul 06 19:51:05.842092 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:05.842060 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4s9gs_917c318d-6192-4c07-8749-b33d3098f63e/dns-node-resolver/0.log" Jul 06 19:51:06.481413 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:06.481388 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lnlbz_f9a93664-b666-4d6e-8f0f-cc972bcd6442/node-ca/0.log" Jul 06 19:51:06.620730 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:06.620695 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2lm8v/perf-node-gather-daemonset-5l8j6" Jul 06 19:51:07.637375 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:07.637345 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fb5b84c75-d98rr_6626cdfd-c707-452d-a073-8ed0ca02ae4b/kube-auth-proxy/0.log" Jul 06 19:51:07.870471 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:07.870448 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5947498495-gc2hh_d9096032-bd93-4923-b366-814e541ce48e/router/0.log" Jul 06 19:51:08.835372 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:08.835338 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s58cm_789a3b43-97bc-4ff2-bde6-4b105225a257/serve-healthcheck-canary/0.log" Jul 06 19:51:10.046622 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:10.046585 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqkn9_87cb2b2a-f22d-4810-908e-5dde5f336f24/kube-rbac-proxy/0.log" Jul 06 19:51:10.103728 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:10.103690 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqkn9_87cb2b2a-f22d-4810-908e-5dde5f336f24/exporter/0.log" Jul 06 19:51:10.170514 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:10.170487 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqkn9_87cb2b2a-f22d-4810-908e-5dde5f336f24/extractor/0.log" Jul 06 19:51:10.492867 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:10.492796 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fb5b84c75-d98rr_6626cdfd-c707-452d-a073-8ed0ca02ae4b/kube-auth-proxy/0.log" Jul 06 19:51:11.009687 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:11.009586 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5947498495-gc2hh_d9096032-bd93-4923-b366-814e541ce48e/router/0.log" Jul 06 19:51:12.496610 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:12.496579 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fb5b84c75-d98rr_6626cdfd-c707-452d-a073-8ed0ca02ae4b/kube-auth-proxy/0.log" Jul 06 19:51:12.783682 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:12.783657 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5947498495-gc2hh_d9096032-bd93-4923-b366-814e541ce48e/router/0.log" Jul 06 19:51:13.833793 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:13.833765 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-z69j4_29058e4e-4711-45e0-90c4-04141169e103/cleanup/0.log" Jul 06 19:51:14.445793 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:14.445766 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b84dcb6b7-m8w8n_19c32208-f6ac-4330-9d70-b5dc45e892e6/manager/0.log" Jul 06 19:51:14.495380 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:14.495354 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b84dcb6b7-m8w8n_19c32208-f6ac-4330-9d70-b5dc45e892e6/copy-manifests/0.log" Jul 06 19:51:16.036398 ip-10-0-138-110 kubenswrapper[2584]: I0706 19:51:16.036366 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-767ffd794c-8njk2_3a63d654-3d68-4c83-a12a-c51c6c689fbd/manager/0.log"