Jul 22 20:56:55.040467 ip-10-0-141-215 systemd[1]: Starting Kubernetes Kubelet... Jul 22 20:56:55.343208 ip-10-0-141-215 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 20:56:55.343208 ip-10-0-141-215 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 20:56:55.343208 ip-10-0-141-215 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 20:56:55.343208 ip-10-0-141-215 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 20:56:55.343208 ip-10-0-141-215 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 20:56:55.343915 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.343827 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 20:56:55.347599 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347582 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 20:56:55.347599 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347598 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 20:56:55.347599 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347602 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347605 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347609 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347612 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347615 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347618 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347621 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347624 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347627 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347629 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347632 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347634 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347637 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347639 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347651 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347655 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347658 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347661 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347664 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 20:56:55.347697 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347666 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347669 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347672 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347674 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347677 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347679 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347682 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347685 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347687 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347689 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347692 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347695 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347697 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347699 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347702 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347705 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347708 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347710 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347713 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347715 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 20:56:55.348145 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347718 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347720 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347723 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347725 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347728 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347730 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347733 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347736 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347738 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347740 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347743 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347745 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347748 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347750 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347754 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347756 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347759 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347761 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347764 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347766 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 20:56:55.348632 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347769 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347771 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347773 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347776 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347778 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347780 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347783 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347785 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347787 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347790 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347792 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347794 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347796 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347799 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347801 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347804 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347807 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347810 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347814 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347818 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 20:56:55.349107 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347821 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347823 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347825 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347828 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347832 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347835 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347838 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347841 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347844 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347846 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347849 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347851 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347854 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347856 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347858 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347861 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347864 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 20:56:55.349603 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.347866 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349845 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349854 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349858 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349861 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349863 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349866 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349868 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349871 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349875 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349878 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349882 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349886 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349889 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349892 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349895 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349898 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349900 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349903 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 20:56:55.350009 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349905 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349908 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349910 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349913 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349915 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349918 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349921 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349923 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349926 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349929 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349931 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349934 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349936 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349939 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349941 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349944 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349947 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349950 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349952 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349955 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 20:56:55.350509 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349957 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349960 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349962 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349964 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349968 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349971 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349973 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349975 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349978 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349981 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349983 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349986 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349988 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349991 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349993 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349996 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.349998 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350000 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350004 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350008 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 20:56:55.350996 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350011 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350014 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350017 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350021 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350024 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350027 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350031 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350035 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350038 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350040 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350043 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350046 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350048 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350051 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350053 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350056 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350058 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350061 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350063 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 20:56:55.351571 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350066 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350068 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350071 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350074 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350085 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350088 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350091 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350093 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350096 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350099 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350101 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350107 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350111 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350115 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350119 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350123 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350127 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350131 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350135 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350138 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 20:56:55.352023 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350141 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350144 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350550 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350556 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350559 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350561 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350565 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350567 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350570 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350572 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350575 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350577 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350580 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350582 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350585 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350588 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350590 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350593 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350595 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350598 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 20:56:55.352538 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350600 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350603 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350605 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350608 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350611 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350613 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350616 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350618 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350620 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350623 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350625 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350628 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350631 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350633 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350635 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350638 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350640 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350642 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350645 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350647 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 20:56:55.353020 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350649 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350652 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350654 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350656 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350659 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350661 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350664 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350667 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350670 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350672 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350675 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350677 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350679 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350682 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350685 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350688 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350690 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350693 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350697 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 20:56:55.353535 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350700 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350703 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350707 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350711 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350715 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350718 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350721 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350725 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350728 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350731 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350734 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350737 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350739 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350742 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350745 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350747 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350750 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350752 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350755 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 20:56:55.354091 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350757 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350759 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350762 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350765 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350767 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350769 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350772 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350774 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350776 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350779 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350781 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350783 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350786 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350788 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350790 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350793 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350795 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350798 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350802 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350804 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 20:56:55.354574 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350807 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350809 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.350811 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350888 2557 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350899 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350908 2557 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350914 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350919 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350923 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350929 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350936 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350939 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350942 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350946 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350949 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350952 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350956 2557 flags.go:64] FLAG: --cgroup-root="" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350958 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350961 2557 flags.go:64] FLAG: --client-ca-file="" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350964 2557 flags.go:64] FLAG: --cloud-provider="external" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350967 2557 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350971 2557 flags.go:64] FLAG: --cluster-domain="" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350974 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350977 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 20:56:55.355042 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350979 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350982 2557 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350986 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350989 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350992 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.350995 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351001 2557 flags.go:64] FLAG: --contention-profiling="false" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351003 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351006 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351009 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351012 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351016 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351019 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351022 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351024 2557 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351027 2557 flags.go:64] FLAG: --enable-server="true" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351030 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351034 2557 flags.go:64] FLAG: --event-burst="100" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351037 2557 flags.go:64] FLAG: --event-qps="50" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351039 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351043 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351046 2557 flags.go:64] FLAG: --eviction-hard="" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351050 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351053 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351056 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 20:56:55.355644 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351059 2557 flags.go:64] FLAG: --eviction-soft="" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351062 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351065 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351068 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351070 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351073 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351076 2557 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351078 2557 flags.go:64] FLAG: --feature-gates="" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351082 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351084 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351087 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351090 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351093 2557 flags.go:64] FLAG: --healthz-port="10248" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351097 2557 flags.go:64] FLAG: --help="false" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351100 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351103 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351105 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351108 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351112 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351115 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351118 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351121 2557 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351123 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 20:56:55.356289 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351126 2557 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351129 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351132 2557 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351134 2557 flags.go:64] FLAG: --kube-reserved="" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351139 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351142 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351144 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351147 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351150 2557 flags.go:64] FLAG: --lock-file="" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351152 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351155 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351158 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351163 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351166 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351169 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351172 2557 flags.go:64] FLAG: --logging-format="text" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351174 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351177 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351180 2557 flags.go:64] FLAG: --manifest-url="" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351183 2557 flags.go:64] FLAG: --manifest-url-header="" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351186 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351189 2557 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351207 2557 flags.go:64] FLAG: --max-pods="110" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351210 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351213 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 20:56:55.356914 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351216 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351219 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351222 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351225 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351228 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351235 2557 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351238 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351240 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351244 2557 flags.go:64] FLAG: --pod-cidr="" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351246 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351252 2557 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351255 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351259 2557 flags.go:64] FLAG: --pods-per-core="0" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351262 2557 flags.go:64] FLAG: --port="10250" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351265 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351268 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0736ec5c708cc2adc" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351270 2557 flags.go:64] FLAG: --qos-reserved="" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351273 2557 flags.go:64] FLAG: --read-only-port="10255" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351277 2557 flags.go:64] FLAG: --register-node="true" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351279 2557 flags.go:64] FLAG: --register-with-taints="" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351283 2557 flags.go:64] FLAG: --registry-burst="10" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351285 2557 flags.go:64] FLAG: --registry-qps="5" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351288 2557 flags.go:64] FLAG: --reserved-cpus="" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351291 2557 flags.go:64] FLAG: --reserved-memory="" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351294 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 20:56:55.357628 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351297 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351300 2557 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351302 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351305 2557 flags.go:64] FLAG: --runonce="false" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351309 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351312 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351315 2557 flags.go:64] FLAG: --seccomp-default="false" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351317 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351320 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351323 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351326 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351328 2557 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351331 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351334 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351336 2557 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351339 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351342 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351344 2557 flags.go:64] FLAG: --system-cgroups="" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351347 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351353 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351356 2557 flags.go:64] FLAG: --tls-cert-file="" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351359 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351363 2557 flags.go:64] FLAG: --tls-min-version="" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351365 2557 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351368 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 20:56:55.358280 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351371 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351374 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351377 2557 flags.go:64] FLAG: --v="2" Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351381 2557 flags.go:64] FLAG: --version="false" Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351384 2557 flags.go:64] FLAG: --vmodule="" Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351388 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.351391 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351524 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351529 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351533 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351536 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351541 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351544 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351546 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351549 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351552 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351554 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351557 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351560 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351562 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 20:56:55.358879 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351565 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351567 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351570 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351574 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351577 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351580 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351585 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351587 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351591 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351594 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351597 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351600 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351602 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351605 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351608 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351611 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351613 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351615 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351618 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 20:56:55.359380 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351620 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351622 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351625 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351627 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351630 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351633 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351635 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351638 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351640 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351642 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351645 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351647 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351650 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351652 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351654 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351657 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351659 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351662 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351664 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351668 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 20:56:55.359836 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351671 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351673 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351676 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351678 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351681 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351683 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351686 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351688 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351691 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351693 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351696 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351698 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351700 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351703 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351705 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351708 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351710 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351712 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351715 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351717 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 20:56:55.360350 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351720 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351722 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351724 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351727 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351729 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351732 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351734 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351736 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351738 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351741 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351743 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351747 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351749 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351751 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351754 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351757 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351759 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351761 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351764 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351766 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 20:56:55.360867 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351768 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351771 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351774 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351776 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351778 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351781 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.351783 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.352374 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.359016 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.359033 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.359049 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.359059 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359114 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359120 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359123 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 20:56:55.361448 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359126 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359129 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359132 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359135 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359137 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359140 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359142 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359145 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359147 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359150 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359153 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359156 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359158 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359160 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359163 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359165 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359168 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359170 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359173 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359175 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 20:56:55.361808 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359177 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359180 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359183 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359187 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359210 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359216 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359221 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359224 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359227 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359230 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359233 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359235 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359239 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359241 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359245 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359247 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359250 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359252 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359255 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 20:56:55.362325 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359258 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359260 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359263 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359265 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359268 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359270 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359273 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359275 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359278 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359280 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359282 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359285 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359287 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359289 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359292 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359294 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359297 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359299 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359302 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359305 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 20:56:55.362778 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359308 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359310 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359313 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359316 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359319 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359321 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359324 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359326 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359329 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359331 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359333 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359336 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359338 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359341 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359343 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359346 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359348 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359351 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359353 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359355 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 20:56:55.363271 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359358 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359360 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359362 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359365 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359367 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359370 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359372 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359374 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359377 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359381 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359386 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359391 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359395 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359398 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359401 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359404 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 20:56:55.363755 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359406 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.359411 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359548 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359553 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359556 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359559 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359562 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359564 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359567 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359569 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359572 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359574 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359577 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359580 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359582 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 20:56:55.364140 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359585 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359588 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359590 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359593 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359595 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359598 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359601 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359603 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359605 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359608 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359610 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359612 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359616 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359618 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359621 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359624 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359626 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359629 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359631 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359634 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 20:56:55.364560 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359636 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359638 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359641 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359644 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359646 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359648 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359650 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359653 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359655 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359658 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359660 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359662 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359665 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359667 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359670 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359672 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359675 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359677 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359680 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359682 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 20:56:55.365046 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359684 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359687 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359689 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359692 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359694 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359698 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359702 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359704 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359707 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359710 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359712 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359715 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359717 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359720 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359722 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359725 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359727 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359729 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359732 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 20:56:55.365619 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359734 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359737 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359739 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359741 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359744 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359746 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359749 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359751 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359755 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359759 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359761 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359764 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359767 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359770 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359773 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359776 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359778 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359781 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359784 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 20:56:55.366066 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359787 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359789 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359792 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359795 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359797 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359799 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359802 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:55.359804 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.359809 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.359927 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.362032 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.363113 2557 server.go:1019] "Starting client certificate rotation" Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.363231 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 20:56:55.366556 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.363273 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 20:56:55.366878 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.365154 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 20:56:55.366878 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.366736 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 20:56:55.376153 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.376132 2557 log.go:25] "Validated CRI v1 runtime API" Jul 22 20:56:55.379943 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.379925 2557 log.go:25] "Validated CRI v1 image API" Jul 22 20:56:55.380778 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.380758 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 20:56:55.382779 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.382761 2557 fs.go:135] Filesystem UUIDs: map[1a04e8b5-4b25-4dd6-abbb-8454cf2ead47:/dev/nvme0n1p3 5fa1552b-4499-46e1-8f63-075287287c64:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 22 20:56:55.382834 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.382780 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 20:56:55.388559 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.388444 2557 manager.go:216] Machine: {Timestamp:2026-07-22 20:56:55.387303347 +0000 UTC m=+0.253052115 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102111 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bdbce103be6ef5630c817656961fd SystemUUID:ec2bdbce-103b-e6ef-5630-c817656961fd BootID:c5d4c842-f8d2-45d5-a66b-ae6d0ad43a3d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:42:51:2f:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:42:51:2f:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:da:ae:e0:81:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 20:56:55.388559 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.388550 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 20:56:55.388681 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.388669 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 20:56:55.390508 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.390491 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 20:56:55.391146 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.391114 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 20:56:55.391314 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.391152 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 20:56:55.391744 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.391734 2557 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 20:56:55.391782 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.391747 2557 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 20:56:55.391782 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.391754 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 20:56:55.391782 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.391768 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 20:56:55.392980 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.392969 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 20:56:55.396555 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.396542 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 22 20:56:55.396683 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.396673 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 20:56:55.396715 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.396704 2557 kubelet.go:486] "Attempting to sync node with API server" Jul 22 20:56:55.396715 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.396713 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 20:56:55.396774 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.396727 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 20:56:55.396774 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.396737 2557 kubelet.go:398] "Adding apiserver pod source" Jul 22 20:56:55.396774 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.396745 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 20:56:55.397170 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.397146 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 20:56:55.397170 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.397170 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 20:56:55.398880 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.398865 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 20:56:55.400529 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.400516 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 20:56:55.400581 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.400546 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 20:56:55.401484 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401467 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 20:56:55.401575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401490 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 20:56:55.401575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401502 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 20:56:55.401575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401512 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 20:56:55.401575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401524 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 20:56:55.401575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401531 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 20:56:55.401575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401540 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 20:56:55.401575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401547 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 20:56:55.401575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401556 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 20:56:55.401575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401563 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 20:56:55.401575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401579 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 20:56:55.401869 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401585 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 20:56:55.401869 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401608 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 20:56:55.401869 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.401614 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 20:56:55.404879 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.404862 2557 server.go:1268] "Started kubelet" Jul 22 20:56:55.404993 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.404958 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 20:56:55.405132 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.404971 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 20:56:55.405261 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.405155 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 20:56:55.405839 ip-10-0-141-215 systemd[1]: Started Kubernetes Kubelet. Jul 22 20:56:55.406896 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.406853 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 20:56:55.408789 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.408765 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 20:56:55.409352 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.409317 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 20:56:55.409352 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.409320 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 20:56:55.410181 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.410162 2557 server.go:310] "Adding debug handlers to kubelet server" Jul 22 20:56:55.412489 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.412463 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 20:56:55.412775 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.412058 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-215.ec2.internal.18c4b8239aba6a11 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-215.ec2.internal,UID:ip-10-0-141-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-215.ec2.internal,},FirstTimestamp:2026-07-22 20:56:55.404833297 +0000 UTC m=+0.270582064,LastTimestamp:2026-07-22 20:56:55.404833297 +0000 UTC m=+0.270582064,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-215.ec2.internal,}" Jul 22 20:56:55.414155 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.414140 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 20:56:55.414242 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.414143 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 20:56:55.414305 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.414288 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 22 20:56:55.414686 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.414661 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 20:56:55.414686 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.414660 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 20:56:55.414686 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.414676 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vd9v4" Jul 22 20:56:55.414686 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.414678 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 20:56:55.414911 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.414828 2557 reconstruct.go:97] "Volume reconstruction finished" Jul 22 20:56:55.414911 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.414839 2557 reconciler.go:29] "Reconciler: start to sync state" Jul 22 20:56:55.415714 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.415592 2557 factory.go:55] Registering systemd factory Jul 22 20:56:55.415714 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.415608 2557 factory.go:223] Registration of the systemd container factory successfully Jul 22 20:56:55.415915 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.415809 2557 factory.go:153] Registering CRI-O factory Jul 22 20:56:55.415915 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.415824 2557 factory.go:223] Registration of the crio container factory successfully Jul 22 20:56:55.415915 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.415880 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 20:56:55.415915 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.415908 2557 factory.go:103] Registering Raw factory Jul 22 20:56:55.416076 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.415923 2557 manager.go:1196] Started watching for new ooms in manager Jul 22 20:56:55.416354 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.416340 2557 manager.go:349] Starting recovery of all containers Jul 22 20:56:55.422182 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.422151 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 20:56:55.422312 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.422176 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 20:56:55.425709 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.425690 2557 manager.go:354] Recovery completed Jul 22 20:56:55.426423 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.426400 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vd9v4" Jul 22 20:56:55.427248 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.427226 2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 22 20:56:55.430529 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.430515 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 20:56:55.434573 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.434557 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 20:56:55.434637 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.434586 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 20:56:55.434637 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.434596 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 20:56:55.435179 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.435165 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 20:56:55.435179 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.435176 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 20:56:55.435325 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.435206 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 22 20:56:55.435325 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.435168 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 20:56:55.436144 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.436129 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 20:56:55.436241 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.436162 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 20:56:55.436241 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.436177 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 20:56:55.436447 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.436359 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-215.ec2.internal.18c4b8239c803038 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-215.ec2.internal,UID:ip-10-0-141-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-215.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-215.ec2.internal,},FirstTimestamp:2026-07-22 20:56:55.434571832 +0000 UTC m=+0.300320603,LastTimestamp:2026-07-22 20:56:55.434571832 +0000 UTC m=+0.300320603,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-215.ec2.internal,}" Jul 22 20:56:55.437287 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.437272 2557 policy_none.go:49] "None policy: Start" Jul 22 20:56:55.437287 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.437290 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 20:56:55.437395 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.437300 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 20:56:55.439772 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.439758 2557 policy_none.go:47] "Start" Jul 22 20:56:55.478560 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.478537 2557 manager.go:337] "Starting Device Plugin manager" Jul 22 20:56:55.478670 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.478584 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 20:56:55.478670 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.478599 2557 server.go:87] "Starting device plugin registration server" Jul 22 20:56:55.479022 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.478880 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 20:56:55.479103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.479029 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 20:56:55.479154 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.479137 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 20:56:55.479277 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.479240 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 20:56:55.479277 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.479251 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 20:56:55.479844 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.479821 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 20:56:55.479916 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.479878 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-215.ec2.internal\" not found" Jul 22 20:56:55.539753 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.539703 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 20:56:55.541856 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.541059 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 20:56:55.541856 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.541095 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 20:56:55.541856 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.541116 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 20:56:55.541856 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.541147 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 20:56:55.543485 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.543463 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 20:56:55.579570 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.579546 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 20:56:55.580407 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.580393 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 20:56:55.580482 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.580425 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 20:56:55.580482 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.580439 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 20:56:55.580482 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.580463 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.587928 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.587914 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.587982 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.587935 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-215.ec2.internal\": node \"ip-10-0-141-215.ec2.internal\" not found" Jul 22 20:56:55.601871 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.601817 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 22 20:56:55.642214 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.642166 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"] Jul 22 20:56:55.642347 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.642248 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 20:56:55.643136 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.643120 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 20:56:55.643219 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.643149 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 20:56:55.643219 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.643160 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 20:56:55.645433 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.645420 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 20:56:55.645534 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.645521 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.645570 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.645557 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 20:56:55.646137 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.646119 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 20:56:55.646137 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.646134 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 20:56:55.646326 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.646150 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 20:56:55.646326 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.646164 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 20:56:55.646326 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.646152 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 20:56:55.646326 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.646305 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 20:56:55.648539 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.648524 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.648582 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.648557 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 20:56:55.650576 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.650562 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 20:56:55.650663 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.650590 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 20:56:55.650663 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.650604 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 20:56:55.663776 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.663756 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-215.ec2.internal\" not found" node="ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.669289 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.669273 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-215.ec2.internal\" not found" node="ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.702610 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.702582 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 22 20:56:55.716257 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.716235 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3282c041206637c42d4d82945b902f9-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"d3282c041206637c42d4d82945b902f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.716333 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.716269 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66374b902396b038bc2cc6e524216ed7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"66374b902396b038bc2cc6e524216ed7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.716333 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.716287 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66374b902396b038bc2cc6e524216ed7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"66374b902396b038bc2cc6e524216ed7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.803242 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.803182 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 22 20:56:55.816479 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.816454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3282c041206637c42d4d82945b902f9-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"d3282c041206637c42d4d82945b902f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.816554 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.816482 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66374b902396b038bc2cc6e524216ed7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"66374b902396b038bc2cc6e524216ed7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.816554 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.816498 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66374b902396b038bc2cc6e524216ed7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"66374b902396b038bc2cc6e524216ed7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.816554 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.816540 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66374b902396b038bc2cc6e524216ed7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"66374b902396b038bc2cc6e524216ed7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.816649 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.816573 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66374b902396b038bc2cc6e524216ed7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"66374b902396b038bc2cc6e524216ed7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.816649 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.816574 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3282c041206637c42d4d82945b902f9-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"d3282c041206637c42d4d82945b902f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.903977 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:55.903894 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 22 20:56:55.966354 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.966322 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 22 20:56:55.971997 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:55.971977 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 22 20:56:56.004336 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:56.004307 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 22 20:56:56.104896 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:56.104850 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 22 20:56:56.205398 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:56.205333 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 22 20:56:57.623157 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.623137 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 20:56:57.632585 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.632569 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 22 20:56:57.687086 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.687059 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 20:56:57.689493 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.689475 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 20:56:57.689596 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.689579 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 20:56:57.689657 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.689627 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 20:56:57.689705 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.689632 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 20:56:57.723786 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.723764 2557 apiserver.go:52] "Watching apiserver" Jul 22 20:56:57.740999 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.740973 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 20:56:57.741115 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.740978 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 22 20:56:57.742150 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.742131 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 20:56:57.743610 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.743591 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-swcmh","kube-system/konnectivity-agent-xp7dn","openshift-cluster-node-tuning-operator/tuned-2lmv7","openshift-dns/node-resolver-g6tpx","openshift-image-registry/node-ca-2tl7d","openshift-multus/multus-additional-cni-plugins-2tpx6","openshift-multus/multus-d7krj","openshift-multus/network-metrics-daemon-5s2tf","kube-system/global-pull-secret-syncer-fmkq4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d","openshift-network-diagnostics/network-check-target-hl4z6","openshift-network-operator/iptables-alerter-cxfqj"] Jul 22 20:56:57.746081 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.746068 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:56:57.748597 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.748578 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.749233 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.749219 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 20:56:57.749585 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.749570 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 20:56:57.749626 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.749581 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6vtmr\"" Jul 22 20:56:57.749818 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.749805 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 20:56:57.749874 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.749865 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 22 20:56:57.750680 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.750659 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g6tpx" Jul 22 20:56:57.751957 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.751929 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 20:56:57.752074 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.752055 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2qvv8\"" Jul 22 20:56:57.752225 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.752210 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 20:56:57.753713 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.753172 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 20:56:57.753713 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.753405 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 20:56:57.753713 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.753518 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-67w5g\"" Jul 22 20:56:57.753713 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.753661 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 20:56:57.753951 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.753901 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.756068 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.756052 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:56:57.756144 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.756112 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:56:57.756249 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.756236 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 20:56:57.756648 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.756634 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 20:56:57.756648 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.756642 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 20:56:57.756726 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.756670 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 20:56:57.756726 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.756670 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xknr8\"" Jul 22 20:56:57.756821 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.756762 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 20:56:57.757956 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.757924 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 20:51:56 +0000 UTC" deadline="2028-02-28 20:40:21.64314646 +0000 UTC" Jul 22 20:56:57.757997 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.757957 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14063h43m23.885192015s" Jul 22 20:56:57.758177 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.758165 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.759185 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.759169 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 20:56:57.760335 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.760309 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 20:56:57.760391 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.760367 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cxfqj" Jul 22 20:56:57.760722 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.760704 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kxl4c\"" Jul 22 20:56:57.760870 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.760855 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 20:56:57.760921 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.760860 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 20:56:57.762771 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.762749 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.762859 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.762837 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 20:56:57.762859 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.762852 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 20:56:57.763212 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.763194 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s2kst\"" Jul 22 20:56:57.763212 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.763204 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 20:56:57.764953 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.764932 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2tl7d" Jul 22 20:56:57.765413 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.765394 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 20:56:57.765526 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.765417 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 20:56:57.766627 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.766612 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 20:56:57.766706 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.766629 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 20:56:57.766706 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.766655 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 20:56:57.766706 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.766663 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hfv76\"" Jul 22 20:56:57.766706 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.766671 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 20:56:57.767224 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.767210 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.767376 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.767356 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 20:56:57.767491 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.767386 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 20:56:57.767491 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.767389 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 20:56:57.767576 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.767526 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wfqsg\"" Jul 22 20:56:57.769537 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.769519 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:57.769629 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.769568 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:56:57.770032 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.770016 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-97jx2\"" Jul 22 20:56:57.770136 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.770123 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 20:56:57.771544 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.771528 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmnl6" Jul 22 20:56:57.771683 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.771669 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"] Jul 22 20:56:57.771730 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.771693 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"] Jul 22 20:56:57.771760 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.771749 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:56:57.771807 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.771792 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:56:57.780916 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.780892 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmnl6" Jul 22 20:56:57.814684 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.814661 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 20:56:57.842149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.842121 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 20:56:57.846924 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.846891 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-lib-modules\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.846924 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.846929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr7vn\" (UniqueName: \"kubernetes.io/projected/210cd3a4-c863-42d9-b923-2861068be417-kube-api-access-kr7vn\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.847072 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.846946 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-kubelet\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.847072 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.846966 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-log-socket\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.847072 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.846999 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a4189a4-946c-42c6-9fe3-95db3c0c73bd-hosts-file\") pod \"node-resolver-g6tpx\" (UID: \"6a4189a4-946c-42c6-9fe3-95db3c0c73bd\") " pod="openshift-dns/node-resolver-g6tpx" Jul 22 20:56:57.847072 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847032 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-system-cni-dir\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.847072 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847055 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-multus-conf-dir\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.847072 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847071 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-run-netns\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.847243 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847102 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/400c915a-cea5-4e42-bb74-437f9e93133a-serviceca\") pod \"node-ca-2tl7d\" (UID: \"400c915a-cea5-4e42-bb74-437f9e93133a\") " pod="openshift-image-registry/node-ca-2tl7d" Jul 22 20:56:57.847243 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847130 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4svb8\" (UniqueName: \"kubernetes.io/projected/400c915a-cea5-4e42-bb74-437f9e93133a-kube-api-access-4svb8\") pod \"node-ca-2tl7d\" (UID: \"400c915a-cea5-4e42-bb74-437f9e93133a\") " pod="openshift-image-registry/node-ca-2tl7d" Jul 22 20:56:57.847243 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847146 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c400296-cf77-42dd-8c41-6866af91b447-multus-daemon-config\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.847243 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847160 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-modprobe-d\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.847243 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847177 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/210cd3a4-c863-42d9-b923-2861068be417-cni-binary-copy\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.847243 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847198 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.847243 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847213 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:56:57.847243 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847228 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-var-lib-cni-bin\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.847470 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847247 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-etc-kubernetes\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.847470 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847265 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-os-release\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.847470 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847278 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-node-log\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.847470 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847292 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-sys\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.847470 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847316 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/210cd3a4-c863-42d9-b923-2861068be417-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.847470 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847340 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-run-systemd\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.847470 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847354 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-multus-socket-dir-parent\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.847470 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847379 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-cni-bin\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.847470 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847400 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-ovnkube-config\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.847470 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847419 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7259g\" (UniqueName: \"kubernetes.io/projected/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-kube-api-access-7259g\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847476 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75dc5369-9597-4d82-9dee-89ad4a855dbe-dbus\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc94k\" (UniqueName: \"kubernetes.io/projected/6a4189a4-946c-42c6-9fe3-95db3c0c73bd-kube-api-access-lc94k\") pod \"node-resolver-g6tpx\" (UID: \"6a4189a4-946c-42c6-9fe3-95db3c0c73bd\") " pod="openshift-dns/node-resolver-g6tpx" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847509 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-device-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847526 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/400c915a-cea5-4e42-bb74-437f9e93133a-host\") pod \"node-ca-2tl7d\" (UID: \"400c915a-cea5-4e42-bb74-437f9e93133a\") " pod="openshift-image-registry/node-ca-2tl7d" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847548 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-registration-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847562 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-sys-fs\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847576 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-os-release\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847590 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-sysctl-d\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847611 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-systemd\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847635 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-cni-netd\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847664 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-system-cni-dir\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847696 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-ovn-node-metrics-cert\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847717 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75dc5369-9597-4d82-9dee-89ad4a855dbe-kubelet-config\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:57.847747 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847732 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f9adb415-0104-487d-80a4-5a3e9811efee-agent-certs\") pod \"konnectivity-agent-xp7dn\" (UID: \"f9adb415-0104-487d-80a4-5a3e9811efee\") " pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a4189a4-946c-42c6-9fe3-95db3c0c73bd-tmp-dir\") pod \"node-resolver-g6tpx\" (UID: \"6a4189a4-946c-42c6-9fe3-95db3c0c73bd\") " pod="openshift-dns/node-resolver-g6tpx" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847773 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-run-multus-certs\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847794 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-tuned\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847811 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/210cd3a4-c863-42d9-b923-2861068be417-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847826 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-run-netns\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847848 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-hostroot\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847871 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhrrc\" (UniqueName: \"kubernetes.io/projected/589ca9a0-45bf-47bc-8ac4-792fb7442fba-kube-api-access-xhrrc\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf-iptables-alerter-script\") pod \"iptables-alerter-cxfqj\" (UID: \"a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf\") " pod="openshift-network-operator/iptables-alerter-cxfqj" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-kubernetes\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847927 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-cnibin\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847952 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-run-ovn-kubernetes\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847969 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf-host-slash\") pod \"iptables-alerter-cxfqj\" (UID: \"a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf\") " pod="openshift-network-operator/iptables-alerter-cxfqj" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.847993 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-slash\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848010 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-etc-openvswitch\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848025 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:57.848149 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848047 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9dq4\" (UniqueName: \"kubernetes.io/projected/3b98e5db-0164-4705-8954-50b7dcb3cc39-kube-api-access-j9dq4\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848075 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-etc-selinux\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848095 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-cnibin\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848109 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-var-lib-cni-multus\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848128 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-multus-cni-dir\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848156 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-var-lib-kubelet\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848175 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdg88\" (UniqueName: \"kubernetes.io/projected/0c400296-cf77-42dd-8c41-6866af91b447-kube-api-access-hdg88\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-sysctl-conf\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848212 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-var-lib-kubelet\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848233 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-host\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848249 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/589ca9a0-45bf-47bc-8ac4-792fb7442fba-tmp\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848285 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9rvw\" (UniqueName: \"kubernetes.io/projected/a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf-kube-api-access-v9rvw\") pod \"iptables-alerter-cxfqj\" (UID: \"a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf\") " pod="openshift-network-operator/iptables-alerter-cxfqj" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848306 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-systemd-units\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848338 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848354 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-socket-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848369 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr7j4\" (UniqueName: \"kubernetes.io/projected/01e7aed5-9483-42ad-babc-9b9c43e151af-kube-api-access-hr7j4\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.848599 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848387 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c400296-cf77-42dd-8c41-6866af91b447-cni-binary-copy\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.849047 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848400 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-run-openvswitch\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.849047 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848423 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-run-ovn\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.849047 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848462 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-env-overrides\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.849047 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848478 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-run-k8s-cni-cncf-io\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.849047 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848500 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-sysconfig\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.849047 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848532 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.849047 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848553 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-var-lib-openvswitch\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.849047 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848567 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-ovnkube-script-lib\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.849047 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848593 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkjgn\" (UniqueName: \"kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn\") pod \"network-check-target-hl4z6\" (UID: \"940c3cac-b997-4898-8eb3-bf1a957db943\") " pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:56:57.849047 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848610 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f9adb415-0104-487d-80a4-5a3e9811efee-konnectivity-ca\") pod \"konnectivity-agent-xp7dn\" (UID: \"f9adb415-0104-487d-80a4-5a3e9811efee\") " pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:56:57.849047 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.848629 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-run\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.949554 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/589ca9a0-45bf-47bc-8ac4-792fb7442fba-tmp\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.949554 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949558 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9rvw\" (UniqueName: \"kubernetes.io/projected/a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf-kube-api-access-v9rvw\") pod \"iptables-alerter-cxfqj\" (UID: \"a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf\") " pod="openshift-network-operator/iptables-alerter-cxfqj" Jul 22 20:56:57.949825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949575 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-systemd-units\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.949825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.949825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949609 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-socket-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.949825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949631 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr7j4\" (UniqueName: \"kubernetes.io/projected/01e7aed5-9483-42ad-babc-9b9c43e151af-kube-api-access-hr7j4\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.949825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949657 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-systemd-units\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.949825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949674 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.949825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949766 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-socket-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.949825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949796 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c400296-cf77-42dd-8c41-6866af91b447-cni-binary-copy\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.949825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949827 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-run-openvswitch\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949851 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-run-ovn\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949874 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-env-overrides\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949890 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-run-openvswitch\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-run-k8s-cni-cncf-io\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949897 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949940 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-run-k8s-cni-cncf-io\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-sysconfig\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949949 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-run-ovn\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949974 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949983 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-sysconfig\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.949999 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-var-lib-openvswitch\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950027 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-ovnkube-script-lib\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950052 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkjgn\" (UniqueName: \"kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn\") pod \"network-check-target-hl4z6\" (UID: \"940c3cac-b997-4898-8eb3-bf1a957db943\") " pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950068 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-var-lib-openvswitch\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950075 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f9adb415-0104-487d-80a4-5a3e9811efee-konnectivity-ca\") pod \"konnectivity-agent-xp7dn\" (UID: \"f9adb415-0104-487d-80a4-5a3e9811efee\") " pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950098 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-run\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950126 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-lib-modules\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.950246 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950131 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950147 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr7vn\" (UniqueName: \"kubernetes.io/projected/210cd3a4-c863-42d9-b923-2861068be417-kube-api-access-kr7vn\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950172 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-kubelet\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950192 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-log-socket\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950214 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a4189a4-946c-42c6-9fe3-95db3c0c73bd-hosts-file\") pod \"node-resolver-g6tpx\" (UID: \"6a4189a4-946c-42c6-9fe3-95db3c0c73bd\") " pod="openshift-dns/node-resolver-g6tpx" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950237 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-system-cni-dir\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950257 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-multus-conf-dir\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-run-netns\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950344 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/400c915a-cea5-4e42-bb74-437f9e93133a-serviceca\") pod \"node-ca-2tl7d\" (UID: \"400c915a-cea5-4e42-bb74-437f9e93133a\") " pod="openshift-image-registry/node-ca-2tl7d" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950372 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4svb8\" (UniqueName: \"kubernetes.io/projected/400c915a-cea5-4e42-bb74-437f9e93133a-kube-api-access-4svb8\") pod \"node-ca-2tl7d\" (UID: \"400c915a-cea5-4e42-bb74-437f9e93133a\") " pod="openshift-image-registry/node-ca-2tl7d" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950396 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c400296-cf77-42dd-8c41-6866af91b447-multus-daemon-config\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-modprobe-d\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950420 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-env-overrides\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950455 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a4189a4-946c-42c6-9fe3-95db3c0c73bd-hosts-file\") pod \"node-resolver-g6tpx\" (UID: \"6a4189a4-946c-42c6-9fe3-95db3c0c73bd\") " pod="openshift-dns/node-resolver-g6tpx" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/210cd3a4-c863-42d9-b923-2861068be417-cni-binary-copy\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950504 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c400296-cf77-42dd-8c41-6866af91b447-cni-binary-copy\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.951104 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950549 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-var-lib-cni-bin\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950568 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-run\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950573 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-etc-kubernetes\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950597 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-os-release\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950613 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-kubelet\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950619 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-node-log\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950644 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-sys\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950645 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-ovnkube-script-lib\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950657 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-log-socket\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950660 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f9adb415-0104-487d-80a4-5a3e9811efee-konnectivity-ca\") pod \"konnectivity-agent-xp7dn\" (UID: \"f9adb415-0104-487d-80a4-5a3e9811efee\") " pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950667 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/210cd3a4-c863-42d9-b923-2861068be417-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-run-systemd\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950710 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950716 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-multus-socket-dir-parent\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950747 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-lib-modules\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950753 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-cni-bin\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.950759 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:56:57.951930 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950776 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-ovnkube-config\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950776 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-multus-conf-dir\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950789 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-run-netns\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950808 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-os-release\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950817 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7259g\" (UniqueName: \"kubernetes.io/projected/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-kube-api-access-7259g\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950853 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-node-log\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950855 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-cni-bin\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950856 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75dc5369-9597-4d82-9dee-89ad4a855dbe-dbus\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.950876 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs podName:3b98e5db-0164-4705-8954-50b7dcb3cc39 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:58.450854125 +0000 UTC m=+1.990362419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs") pod "network-metrics-daemon-5s2tf" (UID: "3b98e5db-0164-4705-8954-50b7dcb3cc39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950758 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-etc-kubernetes\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950886 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-multus-socket-dir-parent\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950911 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-sys\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950955 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75dc5369-9597-4d82-9dee-89ad4a855dbe-dbus\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951015 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/210cd3a4-c863-42d9-b923-2861068be417-cni-binary-copy\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951107 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc94k\" (UniqueName: \"kubernetes.io/projected/6a4189a4-946c-42c6-9fe3-95db3c0c73bd-kube-api-access-lc94k\") pod \"node-resolver-g6tpx\" (UID: \"6a4189a4-946c-42c6-9fe3-95db3c0c73bd\") " pod="openshift-dns/node-resolver-g6tpx" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.950825 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-system-cni-dir\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951149 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-device-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.953103 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951145 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-modprobe-d\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951218 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-run-systemd\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951245 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-ovnkube-config\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951260 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-var-lib-cni-bin\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951263 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-device-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951288 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/400c915a-cea5-4e42-bb74-437f9e93133a-host\") pod \"node-ca-2tl7d\" (UID: \"400c915a-cea5-4e42-bb74-437f9e93133a\") " pod="openshift-image-registry/node-ca-2tl7d" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951316 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-registration-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951341 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/400c915a-cea5-4e42-bb74-437f9e93133a-host\") pod \"node-ca-2tl7d\" (UID: \"400c915a-cea5-4e42-bb74-437f9e93133a\") " pod="openshift-image-registry/node-ca-2tl7d" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951343 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-sys-fs\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951373 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-os-release\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951385 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-sys-fs\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951399 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-sysctl-d\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951401 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-registration-dir\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951418 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/210cd3a4-c863-42d9-b923-2861068be417-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951423 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-systemd\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951467 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-os-release\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951475 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-cni-netd\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951499 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-system-cni-dir\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.953982 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951504 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-systemd\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951525 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-ovn-node-metrics-cert\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951532 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-sysctl-d\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951550 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75dc5369-9597-4d82-9dee-89ad4a855dbe-kubelet-config\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951555 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-cni-netd\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951573 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-system-cni-dir\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951606 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75dc5369-9597-4d82-9dee-89ad4a855dbe-kubelet-config\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951657 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f9adb415-0104-487d-80a4-5a3e9811efee-agent-certs\") pod \"konnectivity-agent-xp7dn\" (UID: \"f9adb415-0104-487d-80a4-5a3e9811efee\") " pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951681 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a4189a4-946c-42c6-9fe3-95db3c0c73bd-tmp-dir\") pod \"node-resolver-g6tpx\" (UID: \"6a4189a4-946c-42c6-9fe3-95db3c0c73bd\") " pod="openshift-dns/node-resolver-g6tpx" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951703 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/400c915a-cea5-4e42-bb74-437f9e93133a-serviceca\") pod \"node-ca-2tl7d\" (UID: \"400c915a-cea5-4e42-bb74-437f9e93133a\") " pod="openshift-image-registry/node-ca-2tl7d" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951709 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-run-multus-certs\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951737 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-run-multus-certs\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951752 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-tuned\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951784 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/210cd3a4-c863-42d9-b923-2861068be417-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951809 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-run-netns\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951832 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-hostroot\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951855 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhrrc\" (UniqueName: \"kubernetes.io/projected/589ca9a0-45bf-47bc-8ac4-792fb7442fba-kube-api-access-xhrrc\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.954811 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951878 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf-iptables-alerter-script\") pod \"iptables-alerter-cxfqj\" (UID: \"a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf\") " pod="openshift-network-operator/iptables-alerter-cxfqj" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951888 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-run-netns\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951900 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-kubernetes\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951924 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-cnibin\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951948 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-run-ovn-kubernetes\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.951972 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf-host-slash\") pod \"iptables-alerter-cxfqj\" (UID: \"a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf\") " pod="openshift-network-operator/iptables-alerter-cxfqj" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952001 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a4189a4-946c-42c6-9fe3-95db3c0c73bd-tmp-dir\") pod \"node-resolver-g6tpx\" (UID: \"6a4189a4-946c-42c6-9fe3-95db3c0c73bd\") " pod="openshift-dns/node-resolver-g6tpx" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952069 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-slash\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952003 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-slash\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952107 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-etc-openvswitch\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952131 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952159 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9dq4\" (UniqueName: \"kubernetes.io/projected/3b98e5db-0164-4705-8954-50b7dcb3cc39-kube-api-access-j9dq4\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952164 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-hostroot\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952181 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-etc-selinux\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952206 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-cnibin\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952240 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-var-lib-cni-multus\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952274 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-multus-cni-dir\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.955293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952354 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/210cd3a4-c863-42d9-b923-2861068be417-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952380 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-var-lib-kubelet\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.952476 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952488 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01e7aed5-9483-42ad-babc-9b9c43e151af-etc-selinux\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952470 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdg88\" (UniqueName: \"kubernetes.io/projected/0c400296-cf77-42dd-8c41-6866af91b447-kube-api-access-hdg88\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952510 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf-iptables-alerter-script\") pod \"iptables-alerter-cxfqj\" (UID: \"a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf\") " pod="openshift-network-operator/iptables-alerter-cxfqj" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952541 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/210cd3a4-c863-42d9-b923-2861068be417-cnibin\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.952554 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret podName:75dc5369-9597-4d82-9dee-89ad4a855dbe nodeName:}" failed. No retries permitted until 2026-07-22 20:56:58.452538289 +0000 UTC m=+1.992046572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret") pod "global-pull-secret-syncer-fmkq4" (UID: "75dc5369-9597-4d82-9dee-89ad4a855dbe") : object "kube-system"/"original-pull-secret" not registered Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952553 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-host-run-ovn-kubernetes\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952593 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-var-lib-cni-multus\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952602 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf-host-slash\") pod \"iptables-alerter-cxfqj\" (UID: \"a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf\") " pod="openshift-network-operator/iptables-alerter-cxfqj" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952603 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-sysctl-conf\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952632 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-etc-openvswitch\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952644 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-var-lib-kubelet\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952665 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-host\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952684 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-multus-cni-dir\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952700 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-sysctl-conf\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.955787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952728 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-kubernetes\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952740 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-var-lib-kubelet\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952744 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/589ca9a0-45bf-47bc-8ac4-792fb7442fba-host\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952776 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-cnibin\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.952790 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c400296-cf77-42dd-8c41-6866af91b447-host-var-lib-kubelet\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.953218 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c400296-cf77-42dd-8c41-6866af91b447-multus-daemon-config\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.954099 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/589ca9a0-45bf-47bc-8ac4-792fb7442fba-tmp\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.954237 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/589ca9a0-45bf-47bc-8ac4-792fb7442fba-etc-tuned\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.954694 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f9adb415-0104-487d-80a4-5a3e9811efee-agent-certs\") pod \"konnectivity-agent-xp7dn\" (UID: \"f9adb415-0104-487d-80a4-5a3e9811efee\") " pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.954831 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-ovn-node-metrics-cert\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.955804 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.955824 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.955837 2557 projected.go:196] Error preparing data for projected volume kube-api-access-xkjgn for pod openshift-network-diagnostics/network-check-target-hl4z6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:56:57.956468 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:57.955893 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn podName:940c3cac-b997-4898-8eb3-bf1a957db943 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:58.455878847 +0000 UTC m=+1.995387153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xkjgn" (UniqueName: "kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn") pod "network-check-target-hl4z6" (UID: "940c3cac-b997-4898-8eb3-bf1a957db943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:56:57.958034 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.958013 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr7j4\" (UniqueName: \"kubernetes.io/projected/01e7aed5-9483-42ad-babc-9b9c43e151af-kube-api-access-hr7j4\") pod \"aws-ebs-csi-driver-node-d246d\" (UID: \"01e7aed5-9483-42ad-babc-9b9c43e151af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:57.958687 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.958643 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9rvw\" (UniqueName: \"kubernetes.io/projected/a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf-kube-api-access-v9rvw\") pod \"iptables-alerter-cxfqj\" (UID: \"a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf\") " pod="openshift-network-operator/iptables-alerter-cxfqj" Jul 22 20:56:57.962818 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.962772 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc94k\" (UniqueName: \"kubernetes.io/projected/6a4189a4-946c-42c6-9fe3-95db3c0c73bd-kube-api-access-lc94k\") pod \"node-resolver-g6tpx\" (UID: \"6a4189a4-946c-42c6-9fe3-95db3c0c73bd\") " pod="openshift-dns/node-resolver-g6tpx" Jul 22 20:56:57.963014 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.962989 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4svb8\" (UniqueName: \"kubernetes.io/projected/400c915a-cea5-4e42-bb74-437f9e93133a-kube-api-access-4svb8\") pod \"node-ca-2tl7d\" (UID: \"400c915a-cea5-4e42-bb74-437f9e93133a\") " pod="openshift-image-registry/node-ca-2tl7d" Jul 22 20:56:57.963645 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.963620 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr7vn\" (UniqueName: \"kubernetes.io/projected/210cd3a4-c863-42d9-b923-2861068be417-kube-api-access-kr7vn\") pod \"multus-additional-cni-plugins-2tpx6\" (UID: \"210cd3a4-c863-42d9-b923-2861068be417\") " pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:57.964084 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.964065 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9dq4\" (UniqueName: \"kubernetes.io/projected/3b98e5db-0164-4705-8954-50b7dcb3cc39-kube-api-access-j9dq4\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:56:57.964335 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.964304 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdg88\" (UniqueName: \"kubernetes.io/projected/0c400296-cf77-42dd-8c41-6866af91b447-kube-api-access-hdg88\") pod \"multus-d7krj\" (UID: \"0c400296-cf77-42dd-8c41-6866af91b447\") " pod="openshift-multus/multus-d7krj" Jul 22 20:56:57.965154 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.965132 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhrrc\" (UniqueName: \"kubernetes.io/projected/589ca9a0-45bf-47bc-8ac4-792fb7442fba-kube-api-access-xhrrc\") pod \"tuned-2lmv7\" (UID: \"589ca9a0-45bf-47bc-8ac4-792fb7442fba\") " pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:57.965269 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:57.965253 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7259g\" (UniqueName: \"kubernetes.io/projected/b06ebac5-6877-4ec2-acd3-5d30adc0a66f-kube-api-access-7259g\") pod \"ovnkube-node-swcmh\" (UID: \"b06ebac5-6877-4ec2-acd3-5d30adc0a66f\") " pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:58.052044 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:58.052009 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66374b902396b038bc2cc6e524216ed7.slice/crio-f6c56e3ab3fdacfb0a7095222cbf2c02ba6485b4a50c1617f1864023d9b321fd WatchSource:0}: Error finding container f6c56e3ab3fdacfb0a7095222cbf2c02ba6485b4a50c1617f1864023d9b321fd: Status 404 returned error can't find the container with id f6c56e3ab3fdacfb0a7095222cbf2c02ba6485b4a50c1617f1864023d9b321fd Jul 22 20:56:58.052412 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:58.052391 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3282c041206637c42d4d82945b902f9.slice/crio-c24b22b29ea2d5d7f3936cb8ed8fe0667c13b808461cc79b8afd5ec08401739e WatchSource:0}: Error finding container c24b22b29ea2d5d7f3936cb8ed8fe0667c13b808461cc79b8afd5ec08401739e: Status 404 returned error can't find the container with id c24b22b29ea2d5d7f3936cb8ed8fe0667c13b808461cc79b8afd5ec08401739e Jul 22 20:56:58.056936 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.056918 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 20:56:58.081646 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.081618 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:56:58.087704 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.087685 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" Jul 22 20:56:58.091053 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:58.091032 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9adb415_0104_487d_80a4_5a3e9811efee.slice/crio-a3959912e1282c0416c2f49043728a3fcbac13de4c60b9cd8bb155f350acd452 WatchSource:0}: Error finding container a3959912e1282c0416c2f49043728a3fcbac13de4c60b9cd8bb155f350acd452: Status 404 returned error can't find the container with id a3959912e1282c0416c2f49043728a3fcbac13de4c60b9cd8bb155f350acd452 Jul 22 20:56:58.096551 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:58.096529 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589ca9a0_45bf_47bc_8ac4_792fb7442fba.slice/crio-d050484383b43fcd5342f50cfcff20fb7739a34791df5a8eafcaabbca72ad327 WatchSource:0}: Error finding container d050484383b43fcd5342f50cfcff20fb7739a34791df5a8eafcaabbca72ad327: Status 404 returned error can't find the container with id d050484383b43fcd5342f50cfcff20fb7739a34791df5a8eafcaabbca72ad327 Jul 22 20:56:58.111761 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.111739 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g6tpx" Jul 22 20:56:58.121403 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:58.121378 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4189a4_946c_42c6_9fe3_95db3c0c73bd.slice/crio-f8151c76b639778fa227b6cdf7278c2bfcfa28f142a2e467417739517e398495 WatchSource:0}: Error finding container f8151c76b639778fa227b6cdf7278c2bfcfa28f142a2e467417739517e398495: Status 404 returned error can't find the container with id f8151c76b639778fa227b6cdf7278c2bfcfa28f142a2e467417739517e398495 Jul 22 20:56:58.128506 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.128483 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" Jul 22 20:56:58.134371 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.134349 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" Jul 22 20:56:58.136993 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:58.136966 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210cd3a4_c863_42d9_b923_2861068be417.slice/crio-6b5fb41767ad0fdb91fd950e249c4a56410d488fb96ac90647f4c8378d3d24e9 WatchSource:0}: Error finding container 6b5fb41767ad0fdb91fd950e249c4a56410d488fb96ac90647f4c8378d3d24e9: Status 404 returned error can't find the container with id 6b5fb41767ad0fdb91fd950e249c4a56410d488fb96ac90647f4c8378d3d24e9 Jul 22 20:56:58.142709 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:58.142684 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e7aed5_9483_42ad_babc_9b9c43e151af.slice/crio-35df7801238cb725dcbbd92e80275911ecb1110ed5d0d86c98b495461eaebd36 WatchSource:0}: Error finding container 35df7801238cb725dcbbd92e80275911ecb1110ed5d0d86c98b495461eaebd36: Status 404 returned error can't find the container with id 35df7801238cb725dcbbd92e80275911ecb1110ed5d0d86c98b495461eaebd36 Jul 22 20:56:58.153802 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.153781 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cxfqj" Jul 22 20:56:58.163986 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:58.163961 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a7278b_bd4e_4594_9cec_d0a1bf49e1bf.slice/crio-d9f906f0ba8fa279e9497c1f0e37c62a7c87b1f5725e2ea78ebf97d2d0d5898d WatchSource:0}: Error finding container d9f906f0ba8fa279e9497c1f0e37c62a7c87b1f5725e2ea78ebf97d2d0d5898d: Status 404 returned error can't find the container with id d9f906f0ba8fa279e9497c1f0e37c62a7c87b1f5725e2ea78ebf97d2d0d5898d Jul 22 20:56:58.174657 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.174638 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:56:58.183026 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:58.183004 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06ebac5_6877_4ec2_acd3_5d30adc0a66f.slice/crio-54002ecd388aeb57e7f4bb1d6656b72ab2ed214c06ef2c801953e1a931831277 WatchSource:0}: Error finding container 54002ecd388aeb57e7f4bb1d6656b72ab2ed214c06ef2c801953e1a931831277: Status 404 returned error can't find the container with id 54002ecd388aeb57e7f4bb1d6656b72ab2ed214c06ef2c801953e1a931831277 Jul 22 20:56:58.195164 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.195144 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2tl7d" Jul 22 20:56:58.199792 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.199772 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d7krj" Jul 22 20:56:58.204189 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:58.204163 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400c915a_cea5_4e42_bb74_437f9e93133a.slice/crio-891ec8d299d30a1ad0deb0fee10db04131a9d7ccbc0d0ba6804416128f5ee851 WatchSource:0}: Error finding container 891ec8d299d30a1ad0deb0fee10db04131a9d7ccbc0d0ba6804416128f5ee851: Status 404 returned error can't find the container with id 891ec8d299d30a1ad0deb0fee10db04131a9d7ccbc0d0ba6804416128f5ee851 Jul 22 20:56:58.208616 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:56:58.208592 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c400296_cf77_42dd_8c41_6866af91b447.slice/crio-91e215ffdaf581873ff1b3680ba04fb12bbb79dc6523397210089b1677f757ac WatchSource:0}: Error finding container 91e215ffdaf581873ff1b3680ba04fb12bbb79dc6523397210089b1677f757ac: Status 404 returned error can't find the container with id 91e215ffdaf581873ff1b3680ba04fb12bbb79dc6523397210089b1677f757ac Jul 22 20:56:58.210174 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:58.210145 2557 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-multus start failed in pod multus-d7krj_openshift-multus(0c400296-cf77-42dd-8c41-6866af91b447): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 22 20:56:58.210243 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:58.210180 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-multus/multus-d7krj" podUID="0c400296-cf77-42dd-8c41-6866af91b447" Jul 22 20:56:58.456421 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.456345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:58.456421 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.456387 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkjgn\" (UniqueName: \"kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn\") pod \"network-check-target-hl4z6\" (UID: \"940c3cac-b997-4898-8eb3-bf1a957db943\") " pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:56:58.456421 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.456410 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:56:58.456646 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:58.456512 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 20:56:58.456646 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:58.456525 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:56:58.456646 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:58.456529 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 20:56:58.456646 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:58.456551 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 20:56:58.456646 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:58.456584 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs podName:3b98e5db-0164-4705-8954-50b7dcb3cc39 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:59.456561218 +0000 UTC m=+2.996069518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs") pod "network-metrics-daemon-5s2tf" (UID: "3b98e5db-0164-4705-8954-50b7dcb3cc39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:56:58.456646 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:58.456586 2557 projected.go:196] Error preparing data for projected volume kube-api-access-xkjgn for pod openshift-network-diagnostics/network-check-target-hl4z6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:56:58.456646 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:58.456603 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret podName:75dc5369-9597-4d82-9dee-89ad4a855dbe nodeName:}" failed. No retries permitted until 2026-07-22 20:56:59.456593132 +0000 UTC m=+2.996101418 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret") pod "global-pull-secret-syncer-fmkq4" (UID: "75dc5369-9597-4d82-9dee-89ad4a855dbe") : object "kube-system"/"original-pull-secret" not registered Jul 22 20:56:58.456646 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:58.456624 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn podName:940c3cac-b997-4898-8eb3-bf1a957db943 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:59.456615038 +0000 UTC m=+2.996123322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkjgn" (UniqueName: "kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn") pod "network-check-target-hl4z6" (UID: "940c3cac-b997-4898-8eb3-bf1a957db943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:56:58.784203 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.784087 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 20:51:57 +0000 UTC" deadline="2028-04-04 17:44:03.68936341 +0000 UTC" Jul 22 20:56:58.784203 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.784153 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14924h47m4.905214759s" Jul 22 20:56:58.875260 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.875206 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" event={"ID":"01e7aed5-9483-42ad-babc-9b9c43e151af","Type":"ContainerStarted","Data":"35df7801238cb725dcbbd92e80275911ecb1110ed5d0d86c98b495461eaebd36"} Jul 22 20:56:58.877017 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.876991 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g6tpx" event={"ID":"6a4189a4-946c-42c6-9fe3-95db3c0c73bd","Type":"ContainerStarted","Data":"f8151c76b639778fa227b6cdf7278c2bfcfa28f142a2e467417739517e398495"} Jul 22 20:56:58.882662 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.882632 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xp7dn" event={"ID":"f9adb415-0104-487d-80a4-5a3e9811efee","Type":"ContainerStarted","Data":"a3959912e1282c0416c2f49043728a3fcbac13de4c60b9cd8bb155f350acd452"} Jul 22 20:56:58.886303 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.886259 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"66374b902396b038bc2cc6e524216ed7","Type":"ContainerStarted","Data":"f6c56e3ab3fdacfb0a7095222cbf2c02ba6485b4a50c1617f1864023d9b321fd"} Jul 22 20:56:58.890801 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.890005 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d7krj" event={"ID":"0c400296-cf77-42dd-8c41-6866af91b447","Type":"ContainerStarted","Data":"91e215ffdaf581873ff1b3680ba04fb12bbb79dc6523397210089b1677f757ac"} Jul 22 20:56:58.894264 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.892261 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" event={"ID":"b06ebac5-6877-4ec2-acd3-5d30adc0a66f","Type":"ContainerStarted","Data":"54002ecd388aeb57e7f4bb1d6656b72ab2ed214c06ef2c801953e1a931831277"} Jul 22 20:56:58.894264 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:58.893288 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:33e7088dd590651a8add807e644a951c24dc2ea04589a5b08214c6a33ec14009\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-multus/multus-d7krj" podUID="0c400296-cf77-42dd-8c41-6866af91b447" Jul 22 20:56:58.903728 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.903696 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" event={"ID":"210cd3a4-c863-42d9-b923-2861068be417","Type":"ContainerStarted","Data":"6b5fb41767ad0fdb91fd950e249c4a56410d488fb96ac90647f4c8378d3d24e9"} Jul 22 20:56:58.905831 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.905768 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" event={"ID":"589ca9a0-45bf-47bc-8ac4-792fb7442fba","Type":"ContainerStarted","Data":"d050484383b43fcd5342f50cfcff20fb7739a34791df5a8eafcaabbca72ad327"} Jul 22 20:56:58.908986 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.908954 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" event={"ID":"d3282c041206637c42d4d82945b902f9","Type":"ContainerStarted","Data":"c24b22b29ea2d5d7f3936cb8ed8fe0667c13b808461cc79b8afd5ec08401739e"} Jul 22 20:56:58.911663 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.911636 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2tl7d" event={"ID":"400c915a-cea5-4e42-bb74-437f9e93133a","Type":"ContainerStarted","Data":"891ec8d299d30a1ad0deb0fee10db04131a9d7ccbc0d0ba6804416128f5ee851"} Jul 22 20:56:58.916726 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:58.916696 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cxfqj" event={"ID":"a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf","Type":"ContainerStarted","Data":"d9f906f0ba8fa279e9497c1f0e37c62a7c87b1f5725e2ea78ebf97d2d0d5898d"} Jul 22 20:56:59.248213 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:59.248110 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 20:56:59.464727 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:59.464692 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkjgn\" (UniqueName: \"kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn\") pod \"network-check-target-hl4z6\" (UID: \"940c3cac-b997-4898-8eb3-bf1a957db943\") " pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:56:59.464908 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:59.464749 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:56:59.464908 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:59.464796 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:59.465012 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:59.464948 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 20:56:59.465012 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:59.465010 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret podName:75dc5369-9597-4d82-9dee-89ad4a855dbe nodeName:}" failed. No retries permitted until 2026-07-22 20:57:01.464992345 +0000 UTC m=+5.004500627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret") pod "global-pull-secret-syncer-fmkq4" (UID: "75dc5369-9597-4d82-9dee-89ad4a855dbe") : object "kube-system"/"original-pull-secret" not registered Jul 22 20:56:59.465426 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:59.465407 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 20:56:59.465426 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:59.465452 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 20:56:59.465600 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:59.465464 2557 projected.go:196] Error preparing data for projected volume kube-api-access-xkjgn for pod openshift-network-diagnostics/network-check-target-hl4z6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:56:59.465600 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:59.465510 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn podName:940c3cac-b997-4898-8eb3-bf1a957db943 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:01.465495155 +0000 UTC m=+5.005003440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkjgn" (UniqueName: "kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn") pod "network-check-target-hl4z6" (UID: "940c3cac-b997-4898-8eb3-bf1a957db943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:56:59.465600 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:59.465573 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:56:59.465751 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:59.465609 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs podName:3b98e5db-0164-4705-8954-50b7dcb3cc39 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:01.465596287 +0000 UTC m=+5.005104570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs") pod "network-metrics-daemon-5s2tf" (UID: "3b98e5db-0164-4705-8954-50b7dcb3cc39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:56:59.785011 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:59.784906 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 20:51:57 +0000 UTC" deadline="2028-05-03 23:29:53.152153292 +0000 UTC" Jul 22 20:56:59.785011 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:59.784967 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15626h32m53.367190047s" Jul 22 20:56:59.801472 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:59.801429 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 20:56:59.867653 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:59.867621 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:56:59.867824 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:59.867741 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:56:59.868157 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:59.868137 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:56:59.868268 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:59.868247 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:56:59.868348 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:59.868334 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:56:59.868457 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:56:59.868416 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:56:59.882732 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:56:59.882703 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 20:57:01.484128 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:01.484082 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:01.484650 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:01.484154 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkjgn\" (UniqueName: \"kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn\") pod \"network-check-target-hl4z6\" (UID: \"940c3cac-b997-4898-8eb3-bf1a957db943\") " pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:01.484650 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:01.484189 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:01.484650 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:01.484302 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:57:01.484650 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:01.484372 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs podName:3b98e5db-0164-4705-8954-50b7dcb3cc39 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:05.484354251 +0000 UTC m=+9.023862531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs") pod "network-metrics-daemon-5s2tf" (UID: "3b98e5db-0164-4705-8954-50b7dcb3cc39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:57:01.484872 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:01.484720 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 20:57:01.484872 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:01.484759 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret podName:75dc5369-9597-4d82-9dee-89ad4a855dbe nodeName:}" failed. No retries permitted until 2026-07-22 20:57:05.484748977 +0000 UTC m=+9.024257257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret") pod "global-pull-secret-syncer-fmkq4" (UID: "75dc5369-9597-4d82-9dee-89ad4a855dbe") : object "kube-system"/"original-pull-secret" not registered Jul 22 20:57:01.484872 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:01.484819 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 20:57:01.484872 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:01.484833 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 20:57:01.484872 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:01.484845 2557 projected.go:196] Error preparing data for projected volume kube-api-access-xkjgn for pod openshift-network-diagnostics/network-check-target-hl4z6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:57:01.485079 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:01.484882 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn podName:940c3cac-b997-4898-8eb3-bf1a957db943 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:05.484871059 +0000 UTC m=+9.024379355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkjgn" (UniqueName: "kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn") pod "network-check-target-hl4z6" (UID: "940c3cac-b997-4898-8eb3-bf1a957db943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:57:01.868990 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:01.868470 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:01.868990 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:01.868483 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:01.868990 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:01.868605 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:01.868990 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:01.868484 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:01.868990 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:01.868714 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:01.868990 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:01.868834 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:03.867998 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:03.867917 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:03.868515 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:03.868029 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:03.868515 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:03.867931 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:03.868515 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:03.868066 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:03.868515 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:03.868119 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:03.868515 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:03.868189 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:05.519766 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:05.519420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:05.519766 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:05.519512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:05.519766 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:05.519552 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkjgn\" (UniqueName: \"kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn\") pod \"network-check-target-hl4z6\" (UID: \"940c3cac-b997-4898-8eb3-bf1a957db943\") " pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:05.519766 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:05.519559 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:57:05.519766 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:05.519622 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs podName:3b98e5db-0164-4705-8954-50b7dcb3cc39 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:13.519603029 +0000 UTC m=+17.059111331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs") pod "network-metrics-daemon-5s2tf" (UID: "3b98e5db-0164-4705-8954-50b7dcb3cc39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:57:05.519766 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:05.519664 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 20:57:05.519766 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:05.519682 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 20:57:05.519766 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:05.519695 2557 projected.go:196] Error preparing data for projected volume kube-api-access-xkjgn for pod openshift-network-diagnostics/network-check-target-hl4z6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:57:05.519766 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:05.519705 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 20:57:05.519766 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:05.519737 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn podName:940c3cac-b997-4898-8eb3-bf1a957db943 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:13.519724771 +0000 UTC m=+17.059233052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkjgn" (UniqueName: "kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn") pod "network-check-target-hl4z6" (UID: "940c3cac-b997-4898-8eb3-bf1a957db943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:57:05.519766 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:05.519772 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret podName:75dc5369-9597-4d82-9dee-89ad4a855dbe nodeName:}" failed. No retries permitted until 2026-07-22 20:57:13.519753522 +0000 UTC m=+17.059261813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret") pod "global-pull-secret-syncer-fmkq4" (UID: "75dc5369-9597-4d82-9dee-89ad4a855dbe") : object "kube-system"/"original-pull-secret" not registered Jul 22 20:57:05.868064 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:05.867948 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:05.868277 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:05.868069 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:05.868277 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:05.868085 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:05.868277 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:05.868084 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:05.868277 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:05.868173 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:05.868277 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:05.868258 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:07.867951 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:07.867919 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:07.868378 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:07.867963 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:07.868378 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:07.867919 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:07.868378 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:07.868078 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:07.868378 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:07.868204 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:07.868378 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:07.868268 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:09.868321 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:09.868277 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:09.868785 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:09.868277 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:09.868785 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:09.868425 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:09.868785 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:09.868277 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:09.868785 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:09.868482 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:09.868785 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:09.868597 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:11.868386 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:11.868346 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:11.868386 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:11.868350 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:11.868904 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:11.868545 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:11.868904 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:11.868729 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:11.868904 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:11.868827 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:11.869035 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:11.868914 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:13.576845 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.576384 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:13.577330 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.576895 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkjgn\" (UniqueName: \"kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn\") pod \"network-check-target-hl4z6\" (UID: \"940c3cac-b997-4898-8eb3-bf1a957db943\") " pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:13.577330 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:13.576615 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 20:57:13.577330 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:13.577024 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret podName:75dc5369-9597-4d82-9dee-89ad4a855dbe nodeName:}" failed. No retries permitted until 2026-07-22 20:57:29.577002341 +0000 UTC m=+33.116510677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret") pod "global-pull-secret-syncer-fmkq4" (UID: "75dc5369-9597-4d82-9dee-89ad4a855dbe") : object "kube-system"/"original-pull-secret" not registered Jul 22 20:57:13.577330 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:13.577042 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:57:13.577330 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:13.577093 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs podName:3b98e5db-0164-4705-8954-50b7dcb3cc39 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:29.577075126 +0000 UTC m=+33.116583409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs") pod "network-metrics-daemon-5s2tf" (UID: "3b98e5db-0164-4705-8954-50b7dcb3cc39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 20:57:13.577330 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:13.577177 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 20:57:13.577330 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:13.577190 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 20:57:13.577330 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:13.577203 2557 projected.go:196] Error preparing data for projected volume kube-api-access-xkjgn for pod openshift-network-diagnostics/network-check-target-hl4z6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:57:13.577330 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:13.577239 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn podName:940c3cac-b997-4898-8eb3-bf1a957db943 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:29.577227725 +0000 UTC m=+33.116736010 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkjgn" (UniqueName: "kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn") pod "network-check-target-hl4z6" (UID: "940c3cac-b997-4898-8eb3-bf1a957db943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 20:57:13.577330 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.576943 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:13.868254 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.868167 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:13.868415 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.868271 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:13.868415 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:13.868278 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:13.868415 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.868312 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:13.868415 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:13.868401 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:13.868647 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:13.868516 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:13.969769 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.969727 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" event={"ID":"01e7aed5-9483-42ad-babc-9b9c43e151af","Type":"ContainerStarted","Data":"0245b53841224caac5092379b613feebe8da359151c5b056a1621364ce91e208"} Jul 22 20:57:13.971542 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.971511 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g6tpx" event={"ID":"6a4189a4-946c-42c6-9fe3-95db3c0c73bd","Type":"ContainerStarted","Data":"8534c41cf6adcf213ecfdbed5e88b7875c44c038683c525df5eecab2c68b06e8"} Jul 22 20:57:13.973454 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.973409 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xp7dn" event={"ID":"f9adb415-0104-487d-80a4-5a3e9811efee","Type":"ContainerStarted","Data":"e871d2326bb496fa86d9d1a70049d36f931c0153268be3de7619875d4f32b1e8"} Jul 22 20:57:13.975695 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.975667 2557 generic.go:356] "Generic (PLEG): container finished" podID="66374b902396b038bc2cc6e524216ed7" containerID="2b9530dd524dbc013762c8d0931349e66901c128043e18a755ddd253425aab3e" exitCode=0 Jul 22 20:57:13.975829 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.975745 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"66374b902396b038bc2cc6e524216ed7","Type":"ContainerDied","Data":"2b9530dd524dbc013762c8d0931349e66901c128043e18a755ddd253425aab3e"} Jul 22 20:57:13.980030 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.979955 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 20:57:13.980419 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.980381 2557 generic.go:356] "Generic (PLEG): container finished" podID="b06ebac5-6877-4ec2-acd3-5d30adc0a66f" containerID="e913a6a9e11690d12bd9f63de943318cd3599afbc841862a42c1c5649da437ce" exitCode=1 Jul 22 20:57:13.980575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.980452 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" event={"ID":"b06ebac5-6877-4ec2-acd3-5d30adc0a66f","Type":"ContainerStarted","Data":"97445f8475eda68e5d0d83172e08ec773476f97048072c8d7a9a9bd84aafdf8f"} Jul 22 20:57:13.980575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.980524 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" event={"ID":"b06ebac5-6877-4ec2-acd3-5d30adc0a66f","Type":"ContainerStarted","Data":"ae836541748d804f17b8de5a3b05549172395af4822aac780157ce452a638835"} Jul 22 20:57:13.980575 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.980567 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" event={"ID":"b06ebac5-6877-4ec2-acd3-5d30adc0a66f","Type":"ContainerStarted","Data":"1f07447b4d57ab2643a88164f7456fb8112ac0dc1e1c441ac52cc218e469dcc5"} Jul 22 20:57:13.980693 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.980615 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" event={"ID":"b06ebac5-6877-4ec2-acd3-5d30adc0a66f","Type":"ContainerStarted","Data":"da73bd8121b258680ef8528c57b030eb831a446aa202b61aaa81f1321a283b2a"} Jul 22 20:57:13.980693 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.980662 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" event={"ID":"b06ebac5-6877-4ec2-acd3-5d30adc0a66f","Type":"ContainerDied","Data":"e913a6a9e11690d12bd9f63de943318cd3599afbc841862a42c1c5649da437ce"} Jul 22 20:57:13.980755 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.980710 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" event={"ID":"b06ebac5-6877-4ec2-acd3-5d30adc0a66f","Type":"ContainerStarted","Data":"a67018826e8579b12ed6d7f8520b3a8c8315aa6f32ac0c660bced092d5b88ef7"} Jul 22 20:57:13.982295 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.982265 2557 generic.go:356] "Generic (PLEG): container finished" podID="210cd3a4-c863-42d9-b923-2861068be417" containerID="4e08476fb37b69f94b9a80a434525301afe9b1d323625c558696bd2490a10d49" exitCode=0 Jul 22 20:57:13.982403 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.982338 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" event={"ID":"210cd3a4-c863-42d9-b923-2861068be417","Type":"ContainerDied","Data":"4e08476fb37b69f94b9a80a434525301afe9b1d323625c558696bd2490a10d49"} Jul 22 20:57:13.984459 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.984407 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" event={"ID":"589ca9a0-45bf-47bc-8ac4-792fb7442fba","Type":"ContainerStarted","Data":"25d1c9068cc84e9c5fcd4c5e4599a6077630954ded6cf39e4fed2a3a5b610921"} Jul 22 20:57:13.986903 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.986774 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" event={"ID":"d3282c041206637c42d4d82945b902f9","Type":"ContainerStarted","Data":"e9a311e4513598ff431b5012debff3444113cdb55a9cba2e9a1910936faae244"} Jul 22 20:57:13.988594 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.988524 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g6tpx" podStartSLOduration=3.275688003 podStartE2EDuration="17.988508708s" totalImagesPullingTime="14.712820705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:13.988102639 +0000 UTC m=+17.527610941" watchObservedRunningTime="2026-07-22 20:57:13.988508708 +0000 UTC m=+17.528017010" Jul 22 20:57:13.988705 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:13.988643 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2tl7d" event={"ID":"400c915a-cea5-4e42-bb74-437f9e93133a","Type":"ContainerStarted","Data":"e9fac2c2bd2202dc420b6c89f8fdbd81f113d6e2c88883bd91388d4ade92242e"} Jul 22 20:57:14.002299 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.002256 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" podStartSLOduration=17.002242145 podStartE2EDuration="17.002242145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:14.001644563 +0000 UTC m=+17.541152869" watchObservedRunningTime="2026-07-22 20:57:14.002242145 +0000 UTC m=+17.541750447" Jul 22 20:57:14.036376 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.036319 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2lmv7" podStartSLOduration=3.271623862 podStartE2EDuration="18.036298862s" totalImagesPullingTime="14.764675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:14.0360959 +0000 UTC m=+17.575604205" watchObservedRunningTime="2026-07-22 20:57:14.036298862 +0000 UTC m=+17.575807155" Jul 22 20:57:14.072924 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.072872 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xp7dn" podStartSLOduration=3.304367908 podStartE2EDuration="18.072852174s" totalImagesPullingTime="14.768484266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:14.072566852 +0000 UTC m=+17.612075157" watchObservedRunningTime="2026-07-22 20:57:14.072852174 +0000 UTC m=+17.612360479" Jul 22 20:57:14.312873 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.312792 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:57:14.313731 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.313709 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:57:14.328089 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.328044 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2tl7d" podStartSLOduration=2.6979479360000003 podStartE2EDuration="17.328030027s" totalImagesPullingTime="14.630082091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:14.086706301 +0000 UTC m=+17.626214604" watchObservedRunningTime="2026-07-22 20:57:14.328030027 +0000 UTC m=+17.867538344" Jul 22 20:57:14.517956 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.517777 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 20:57:14.815221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.815118 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T20:57:14.517940472Z","UUID":"3d05a1e1-8c47-4ff9-95c8-6054358d9496","Handler":null,"Name":"","Endpoint":""} Jul 22 20:57:14.817140 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.817116 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 20:57:14.817281 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.817165 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 20:57:14.993666 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.993622 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cxfqj" event={"ID":"a1a7278b-bd4e-4594-9cec-d0a1bf49e1bf","Type":"ContainerStarted","Data":"1dbe81ca64918d189469b0f738edc4af69890461b73421ba60622b18510dd8f6"} Jul 22 20:57:14.996669 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.996637 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" event={"ID":"01e7aed5-9483-42ad-babc-9b9c43e151af","Type":"ContainerStarted","Data":"4dfd727021aab41641262b5b4638af4c6f143eba9264e291896fdc1a80c2e5fc"} Jul 22 20:57:14.999388 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:14.999325 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"66374b902396b038bc2cc6e524216ed7","Type":"ContainerStarted","Data":"0b8b1ab0c8ff4f3b38be90f9a633d070e739362f38ad66338085c670b89aecc5"} Jul 22 20:57:15.008815 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:15.008760 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cxfqj" podStartSLOduration=4.313134299 podStartE2EDuration="19.008741624s" totalImagesPullingTime="14.695607325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:15.008387846 +0000 UTC m=+18.547896150" watchObservedRunningTime="2026-07-22 20:57:15.008741624 +0000 UTC m=+18.548249927" Jul 22 20:57:15.867823 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:15.867749 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:15.867823 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:15.867791 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:15.868292 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:15.867749 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:15.868292 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:15.867887 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:15.868292 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:15.867960 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:15.868292 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:15.868054 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:16.005012 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:16.004980 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 20:57:16.005479 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:16.005422 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" event={"ID":"b06ebac5-6877-4ec2-acd3-5d30adc0a66f","Type":"ContainerStarted","Data":"e0d7d2c041e3f7932a7724ef67a9a9d477e2de72eb3858fa83590d8473481104"} Jul 22 20:57:16.007825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:16.007726 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 20:57:16.007825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:16.007756 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" event={"ID":"01e7aed5-9483-42ad-babc-9b9c43e151af","Type":"ContainerStarted","Data":"b72f1de7a1fbc8e9c97a0dcd1e3df468250b46759f3ee76ce569527f6fc58298"} Jul 22 20:57:16.030542 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:16.030497 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d246d" podStartSLOduration=3.336342842 podStartE2EDuration="20.030484143s" totalImagesPullingTime="16.694141301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:16.030350904 +0000 UTC m=+19.569859199" watchObservedRunningTime="2026-07-22 20:57:16.030484143 +0000 UTC m=+19.569992445" Jul 22 20:57:16.030802 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:16.030783 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" podStartSLOduration=19.03077744 podStartE2EDuration="19.03077744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:15.02239241 +0000 UTC m=+18.561900752" watchObservedRunningTime="2026-07-22 20:57:16.03077744 +0000 UTC m=+19.570285742" Jul 22 20:57:17.515778 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:17.515746 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:57:17.516199 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:17.515862 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 20:57:17.516574 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:17.516554 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xp7dn" Jul 22 20:57:17.867873 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:17.867837 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:17.868030 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:17.867945 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:17.868293 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:17.868274 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:17.868370 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:17.868276 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:17.868419 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:17.868395 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:17.868553 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:17.868505 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:19.020309 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:19.020062 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 20:57:19.020857 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:19.020742 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" event={"ID":"b06ebac5-6877-4ec2-acd3-5d30adc0a66f","Type":"ContainerStarted","Data":"642c214f2ce2c5dda87ea625f4b42f04336eb59458c9595d36e015d32795ebc5"} Jul 22 20:57:19.021350 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:19.021289 2557 scope.go:117] "RemoveContainer" containerID="e913a6a9e11690d12bd9f63de943318cd3599afbc841862a42c1c5649da437ce" Jul 22 20:57:19.021483 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:19.021463 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:57:19.021802 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:19.021787 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:57:19.023941 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:19.023881 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" event={"ID":"210cd3a4-c863-42d9-b923-2861068be417","Type":"ContainerStarted","Data":"38108f38c886015f910b7f91c679d538f89c602e4d0e09efceca9fcdbeb6afbd"} Jul 22 20:57:19.040164 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:19.040141 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:57:19.042266 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:19.042249 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:57:19.867818 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:19.867784 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:19.867818 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:19.867814 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:19.868024 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:19.867929 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:19.868024 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:19.867971 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:19.868087 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:19.868019 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:19.868115 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:19.868089 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:20.032283 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:20.032252 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 20:57:20.032931 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:20.032909 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 20:57:20.033166 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:20.033137 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" event={"ID":"b06ebac5-6877-4ec2-acd3-5d30adc0a66f","Type":"ContainerStarted","Data":"7d7cc9469af500dc7d123768c13a0ff2d785892a7957d51c5517de6d1e83c846"} Jul 22 20:57:20.035396 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:20.035369 2557 generic.go:356] "Generic (PLEG): container finished" podID="210cd3a4-c863-42d9-b923-2861068be417" containerID="38108f38c886015f910b7f91c679d538f89c602e4d0e09efceca9fcdbeb6afbd" exitCode=0 Jul 22 20:57:20.035514 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:20.035418 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" event={"ID":"210cd3a4-c863-42d9-b923-2861068be417","Type":"ContainerDied","Data":"38108f38c886015f910b7f91c679d538f89c602e4d0e09efceca9fcdbeb6afbd"} Jul 22 20:57:20.059958 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:20.059888 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" podStartSLOduration=8.170862675 podStartE2EDuration="23.059868459s" totalImagesPullingTime="14.889005784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:20.058455709 +0000 UTC m=+23.597964002" watchObservedRunningTime="2026-07-22 20:57:20.059868459 +0000 UTC m=+23.599376763" Jul 22 20:57:21.037810 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:21.037780 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 20:57:21.043319 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:21.043295 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fmkq4"] Jul 22 20:57:21.043484 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:21.043410 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:21.043566 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:21.043543 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:21.046041 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:21.045997 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5s2tf"] Jul 22 20:57:21.046180 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:21.046157 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:21.046705 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:21.046293 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:21.046791 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:21.046704 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hl4z6"] Jul 22 20:57:21.046843 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:21.046800 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:21.046905 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:21.046887 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:22.868112 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:22.867807 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:22.868112 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:22.867885 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:22.868627 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:22.867911 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:22.868627 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:22.868177 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:22.868627 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:22.868245 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:22.868627 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:22.868312 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:24.045848 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:24.045814 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d7krj" event={"ID":"0c400296-cf77-42dd-8c41-6866af91b447","Type":"ContainerStarted","Data":"468d4b3295b94f05d3476fc8b9e4d7d178d30de2ee0b5dfefa671b82c0cadc52"} Jul 22 20:57:24.048767 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:24.048671 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" event={"ID":"210cd3a4-c863-42d9-b923-2861068be417","Type":"ContainerStarted","Data":"5af045bf953cfc48d80295e7c93bf4a3a4e637964609df22d95fb9602f0a8c6b"} Jul 22 20:57:24.065838 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:24.065794 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d7krj" podStartSLOduration=1.929532076 podStartE2EDuration="27.065779869s" totalImagesPullingTime="25.136247793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-22 20:57:24.065248646 +0000 UTC m=+27.604756951" watchObservedRunningTime="2026-07-22 20:57:24.065779869 +0000 UTC m=+27.605288171" Jul 22 20:57:24.257674 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:24.257602 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:57:24.257825 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:24.257814 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 20:57:24.268878 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:24.268850 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-swcmh" Jul 22 20:57:24.867667 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:24.867641 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:24.867806 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:24.867641 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:24.867806 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:24.867766 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmkq4" podUID="75dc5369-9597-4d82-9dee-89ad4a855dbe" Jul 22 20:57:24.867885 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:24.867641 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:24.867885 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:24.867821 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl4z6" podUID="940c3cac-b997-4898-8eb3-bf1a957db943" Jul 22 20:57:24.867946 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:24.867890 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:57:25.053331 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.053251 2557 generic.go:356] "Generic (PLEG): container finished" podID="210cd3a4-c863-42d9-b923-2861068be417" containerID="5af045bf953cfc48d80295e7c93bf4a3a4e637964609df22d95fb9602f0a8c6b" exitCode=0 Jul 22 20:57:25.053711 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.053341 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" event={"ID":"210cd3a4-c863-42d9-b923-2861068be417","Type":"ContainerDied","Data":"5af045bf953cfc48d80295e7c93bf4a3a4e637964609df22d95fb9602f0a8c6b"} Jul 22 20:57:25.853918 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.853685 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeReady" Jul 22 20:57:25.854106 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.854046 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 20:57:25.897303 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.897272 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54bf7db6b7-nr9fj"] Jul 22 20:57:25.925234 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.925209 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zhcx7"] Jul 22 20:57:25.925378 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.925337 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:25.931529 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.931505 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b7lth\"" Jul 22 20:57:25.931529 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.931525 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 20:57:25.932275 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.932252 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 20:57:25.932383 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.932261 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 20:57:25.937570 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.937537 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54bf7db6b7-nr9fj"] Jul 22 20:57:25.937680 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.937576 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jz77h"] Jul 22 20:57:25.937680 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.937651 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:25.938022 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.937976 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 20:57:25.940945 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.940926 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 20:57:25.941105 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.940966 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6fmcx\"" Jul 22 20:57:25.941551 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.941486 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 20:57:25.951808 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.951784 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zhcx7"] Jul 22 20:57:25.951897 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.951826 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jz77h"] Jul 22 20:57:25.951897 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.951887 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jz77h" Jul 22 20:57:25.955176 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.955157 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 20:57:25.956508 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.956490 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 20:57:25.956687 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.956624 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 20:57:25.956835 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:25.956666 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5ll7d\"" Jul 22 20:57:26.078754 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.078689 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.078754 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.078721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-image-registry-private-configuration\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.078754 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.078738 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-ca-trust-extracted\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.079221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.078759 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef1dd499-990b-49f1-adb6-9e68904d36ed-config-volume\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.079221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.078798 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-certificates\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.079221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.078853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-trusted-ca\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.079221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.078876 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff5z2\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-kube-api-access-ff5z2\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.079221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.078892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.079221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.078912 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bjpc\" (UniqueName: \"kubernetes.io/projected/ef1dd499-990b-49f1-adb6-9e68904d36ed-kube-api-access-7bjpc\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.079221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.078992 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-bound-sa-token\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.079221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.079038 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2861d068-fec4-432f-b35e-3d9c9f81154d-cert\") pod \"ingress-canary-jz77h\" (UID: \"2861d068-fec4-432f-b35e-3d9c9f81154d\") " pod="openshift-ingress-canary/ingress-canary-jz77h" Jul 22 20:57:26.079221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.079079 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cclt\" (UniqueName: \"kubernetes.io/projected/2861d068-fec4-432f-b35e-3d9c9f81154d-kube-api-access-8cclt\") pod \"ingress-canary-jz77h\" (UID: \"2861d068-fec4-432f-b35e-3d9c9f81154d\") " pod="openshift-ingress-canary/ingress-canary-jz77h" Jul 22 20:57:26.079221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.079107 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-installation-pull-secrets\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.079221 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.079146 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef1dd499-990b-49f1-adb6-9e68904d36ed-tmp-dir\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.180263 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180229 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-image-registry-private-configuration\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.180263 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180263 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-ca-trust-extracted\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.180541 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180282 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef1dd499-990b-49f1-adb6-9e68904d36ed-config-volume\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.180541 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-certificates\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.180541 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180347 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-trusted-ca\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.180541 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180372 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff5z2\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-kube-api-access-ff5z2\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.180541 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180395 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.180541 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180418 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bjpc\" (UniqueName: \"kubernetes.io/projected/ef1dd499-990b-49f1-adb6-9e68904d36ed-kube-api-access-7bjpc\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.180541 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180482 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-bound-sa-token\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.180541 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180510 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2861d068-fec4-432f-b35e-3d9c9f81154d-cert\") pod \"ingress-canary-jz77h\" (UID: \"2861d068-fec4-432f-b35e-3d9c9f81154d\") " pod="openshift-ingress-canary/ingress-canary-jz77h" Jul 22 20:57:26.180541 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180530 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cclt\" (UniqueName: \"kubernetes.io/projected/2861d068-fec4-432f-b35e-3d9c9f81154d-kube-api-access-8cclt\") pod \"ingress-canary-jz77h\" (UID: \"2861d068-fec4-432f-b35e-3d9c9f81154d\") " pod="openshift-ingress-canary/ingress-canary-jz77h" Jul 22 20:57:26.180907 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180555 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-installation-pull-secrets\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.180907 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180591 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef1dd499-990b-49f1-adb6-9e68904d36ed-tmp-dir\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.180907 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.180629 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.180907 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:26.180723 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 20:57:26.180907 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:26.180751 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54bf7db6b7-nr9fj: secret "image-registry-tls" not found Jul 22 20:57:26.180907 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:26.180777 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 20:57:26.180907 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:26.180822 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls podName:cf9fb21e-a5d4-4439-9b61-a2c2e749d129 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:26.680803023 +0000 UTC m=+30.220311325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls") pod "image-registry-54bf7db6b7-nr9fj" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129") : secret "image-registry-tls" not found Jul 22 20:57:26.180907 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:26.180841 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls podName:ef1dd499-990b-49f1-adb6-9e68904d36ed nodeName:}" failed. No retries permitted until 2026-07-22 20:57:26.680831943 +0000 UTC m=+30.220340230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls") pod "dns-default-zhcx7" (UID: "ef1dd499-990b-49f1-adb6-9e68904d36ed") : secret "dns-default-metrics-tls" not found Jul 22 20:57:26.181298 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.181018 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-ca-trust-extracted\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.181481 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.181461 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-certificates\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.181670 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.181647 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef1dd499-990b-49f1-adb6-9e68904d36ed-tmp-dir\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.181787 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.181764 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-trusted-ca\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.181840 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.181781 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef1dd499-990b-49f1-adb6-9e68904d36ed-config-volume\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.184894 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.184869 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-installation-pull-secrets\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.185016 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.184908 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-image-registry-private-configuration\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.185016 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.184949 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2861d068-fec4-432f-b35e-3d9c9f81154d-cert\") pod \"ingress-canary-jz77h\" (UID: \"2861d068-fec4-432f-b35e-3d9c9f81154d\") " pod="openshift-ingress-canary/ingress-canary-jz77h" Jul 22 20:57:26.193345 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.193324 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-bound-sa-token\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.193345 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.193345 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bjpc\" (UniqueName: \"kubernetes.io/projected/ef1dd499-990b-49f1-adb6-9e68904d36ed-kube-api-access-7bjpc\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.193907 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.193888 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cclt\" (UniqueName: \"kubernetes.io/projected/2861d068-fec4-432f-b35e-3d9c9f81154d-kube-api-access-8cclt\") pod \"ingress-canary-jz77h\" (UID: \"2861d068-fec4-432f-b35e-3d9c9f81154d\") " pod="openshift-ingress-canary/ingress-canary-jz77h" Jul 22 20:57:26.193907 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.193900 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff5z2\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-kube-api-access-ff5z2\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.263108 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.263077 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jz77h" Jul 22 20:57:26.463256 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.463226 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jz77h"] Jul 22 20:57:26.500513 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:57:26.500485 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2861d068_fec4_432f_b35e_3d9c9f81154d.slice/crio-0f3445de80b8d9341662b9d23dbc5107f405554e7516ce1bef5c461a0db4824b WatchSource:0}: Error finding container 0f3445de80b8d9341662b9d23dbc5107f405554e7516ce1bef5c461a0db4824b: Status 404 returned error can't find the container with id 0f3445de80b8d9341662b9d23dbc5107f405554e7516ce1bef5c461a0db4824b Jul 22 20:57:26.685651 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.685617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:26.685798 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.685689 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:26.685798 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:26.685763 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 20:57:26.685798 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:26.685779 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 20:57:26.685798 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:26.685790 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54bf7db6b7-nr9fj: secret "image-registry-tls" not found Jul 22 20:57:26.685959 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:26.685825 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls podName:ef1dd499-990b-49f1-adb6-9e68904d36ed nodeName:}" failed. No retries permitted until 2026-07-22 20:57:27.685809233 +0000 UTC m=+31.225317513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls") pod "dns-default-zhcx7" (UID: "ef1dd499-990b-49f1-adb6-9e68904d36ed") : secret "dns-default-metrics-tls" not found Jul 22 20:57:26.685959 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:26.685840 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls podName:cf9fb21e-a5d4-4439-9b61-a2c2e749d129 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:27.685833739 +0000 UTC m=+31.225342018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls") pod "image-registry-54bf7db6b7-nr9fj" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129") : secret "image-registry-tls" not found Jul 22 20:57:26.868784 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.868543 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:26.868784 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.868629 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:26.868983 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.868663 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:26.871958 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.871938 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 20:57:26.872081 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.872000 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 20:57:26.872081 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.871999 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j26qm\"" Jul 22 20:57:26.872197 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.872187 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 20:57:26.872736 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.872719 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvpxr\"" Jul 22 20:57:26.872799 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:26.872751 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 20:57:27.059249 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:27.059211 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jz77h" event={"ID":"2861d068-fec4-432f-b35e-3d9c9f81154d","Type":"ContainerStarted","Data":"0f3445de80b8d9341662b9d23dbc5107f405554e7516ce1bef5c461a0db4824b"} Jul 22 20:57:27.061912 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:27.061885 2557 generic.go:356] "Generic (PLEG): container finished" podID="210cd3a4-c863-42d9-b923-2861068be417" containerID="1e8493cb13969ac9f11bb958da57ad02f959cc86f1500977347f6858050a3f81" exitCode=0 Jul 22 20:57:27.062028 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:27.061921 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" event={"ID":"210cd3a4-c863-42d9-b923-2861068be417","Type":"ContainerDied","Data":"1e8493cb13969ac9f11bb958da57ad02f959cc86f1500977347f6858050a3f81"} Jul 22 20:57:27.692489 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:27.692196 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:27.692489 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:27.692277 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:27.692489 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:27.692378 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 20:57:27.692489 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:27.692399 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54bf7db6b7-nr9fj: secret "image-registry-tls" not found Jul 22 20:57:27.692489 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:27.692416 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 20:57:27.692489 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:27.692476 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls podName:cf9fb21e-a5d4-4439-9b61-a2c2e749d129 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:29.692455445 +0000 UTC m=+33.231963743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls") pod "image-registry-54bf7db6b7-nr9fj" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129") : secret "image-registry-tls" not found Jul 22 20:57:27.692489 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:27.692502 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls podName:ef1dd499-990b-49f1-adb6-9e68904d36ed nodeName:}" failed. No retries permitted until 2026-07-22 20:57:29.692494228 +0000 UTC m=+33.232002507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls") pod "dns-default-zhcx7" (UID: "ef1dd499-990b-49f1-adb6-9e68904d36ed") : secret "dns-default-metrics-tls" not found Jul 22 20:57:29.608271 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:29.608232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkjgn\" (UniqueName: \"kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn\") pod \"network-check-target-hl4z6\" (UID: \"940c3cac-b997-4898-8eb3-bf1a957db943\") " pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:29.608763 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:29.608280 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:57:29.608763 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:29.608389 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 20:57:29.608763 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:29.608473 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs podName:3b98e5db-0164-4705-8954-50b7dcb3cc39 nodeName:}" failed. No retries permitted until 2026-07-22 20:58:01.608454536 +0000 UTC m=+65.147962835 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs") pod "network-metrics-daemon-5s2tf" (UID: "3b98e5db-0164-4705-8954-50b7dcb3cc39") : secret "metrics-daemon-secret" not found Jul 22 20:57:29.608763 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:29.608500 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:29.612412 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:29.612379 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dc5369-9597-4d82-9dee-89ad4a855dbe-original-pull-secret\") pod \"global-pull-secret-syncer-fmkq4\" (UID: \"75dc5369-9597-4d82-9dee-89ad4a855dbe\") " pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:29.612665 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:29.612641 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkjgn\" (UniqueName: \"kubernetes.io/projected/940c3cac-b997-4898-8eb3-bf1a957db943-kube-api-access-xkjgn\") pod \"network-check-target-hl4z6\" (UID: \"940c3cac-b997-4898-8eb3-bf1a957db943\") " pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:29.709199 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:29.709072 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:29.709199 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:29.709128 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:29.709499 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:29.709259 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 20:57:29.709499 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:29.709271 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 20:57:29.709499 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:29.709312 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54bf7db6b7-nr9fj: secret "image-registry-tls" not found Jul 22 20:57:29.709499 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:29.709322 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls podName:ef1dd499-990b-49f1-adb6-9e68904d36ed nodeName:}" failed. No retries permitted until 2026-07-22 20:57:33.70930868 +0000 UTC m=+37.248816960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls") pod "dns-default-zhcx7" (UID: "ef1dd499-990b-49f1-adb6-9e68904d36ed") : secret "dns-default-metrics-tls" not found Jul 22 20:57:29.709499 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:29.709375 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls podName:cf9fb21e-a5d4-4439-9b61-a2c2e749d129 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:33.709349368 +0000 UTC m=+37.248857647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls") pod "image-registry-54bf7db6b7-nr9fj" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129") : secret "image-registry-tls" not found Jul 22 20:57:29.883586 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:29.883496 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmkq4" Jul 22 20:57:29.888544 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:29.888519 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:30.070540 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:30.070497 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jz77h" event={"ID":"2861d068-fec4-432f-b35e-3d9c9f81154d","Type":"ContainerStarted","Data":"f501768a5caa0592d92d9431daea22434a27d7a8fe9f8750903c59b9d3409044"} Jul 22 20:57:30.085671 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:30.085614 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jz77h" podStartSLOduration=2.59502364 podStartE2EDuration="5.085593027s" totalImagesPullingTime="2.490569387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:30.084671208 +0000 UTC m=+33.624179509" watchObservedRunningTime="2026-07-22 20:57:30.085593027 +0000 UTC m=+33.625101325" Jul 22 20:57:31.524407 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:31.524385 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fmkq4"] Jul 22 20:57:31.526676 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:57:31.526648 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75dc5369_9597_4d82_9dee_89ad4a855dbe.slice/crio-18d5342793650e78622b80d3cd24224afb84a98b22b7860ce302b2e42bf36ed1 WatchSource:0}: Error finding container 18d5342793650e78622b80d3cd24224afb84a98b22b7860ce302b2e42bf36ed1: Status 404 returned error can't find the container with id 18d5342793650e78622b80d3cd24224afb84a98b22b7860ce302b2e42bf36ed1 Jul 22 20:57:31.538199 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:31.538175 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hl4z6"] Jul 22 20:57:31.540952 ip-10-0-141-215 kubenswrapper[2557]: W0722 20:57:31.540929 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940c3cac_b997_4898_8eb3_bf1a957db943.slice/crio-0475a9baeb916084d48cbc8c3c1b43caf855cd6f815b17df8918ce300cea3af1 WatchSource:0}: Error finding container 0475a9baeb916084d48cbc8c3c1b43caf855cd6f815b17df8918ce300cea3af1: Status 404 returned error can't find the container with id 0475a9baeb916084d48cbc8c3c1b43caf855cd6f815b17df8918ce300cea3af1 Jul 22 20:57:32.077247 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:32.077217 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fmkq4" event={"ID":"75dc5369-9597-4d82-9dee-89ad4a855dbe","Type":"ContainerStarted","Data":"18d5342793650e78622b80d3cd24224afb84a98b22b7860ce302b2e42bf36ed1"} Jul 22 20:57:32.079786 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:32.079761 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" event={"ID":"210cd3a4-c863-42d9-b923-2861068be417","Type":"ContainerStarted","Data":"dc6d89e87fa6f7fee000ab249064c6eb422f89577e3934aa13f83d7a1b5688a7"} Jul 22 20:57:32.081144 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:32.081124 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hl4z6" event={"ID":"940c3cac-b997-4898-8eb3-bf1a957db943","Type":"ContainerStarted","Data":"0475a9baeb916084d48cbc8c3c1b43caf855cd6f815b17df8918ce300cea3af1"} Jul 22 20:57:33.088313 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:33.088271 2557 generic.go:356] "Generic (PLEG): container finished" podID="210cd3a4-c863-42d9-b923-2861068be417" containerID="dc6d89e87fa6f7fee000ab249064c6eb422f89577e3934aa13f83d7a1b5688a7" exitCode=0 Jul 22 20:57:33.088313 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:33.088312 2557 generic.go:356] "Generic (PLEG): container finished" podID="210cd3a4-c863-42d9-b923-2861068be417" containerID="c2068f8652c351853f75290235d7a7d80de4064af62b13b922b1e0a28c8cf942" exitCode=0 Jul 22 20:57:33.088922 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:33.088377 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" event={"ID":"210cd3a4-c863-42d9-b923-2861068be417","Type":"ContainerDied","Data":"dc6d89e87fa6f7fee000ab249064c6eb422f89577e3934aa13f83d7a1b5688a7"} Jul 22 20:57:33.088922 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:33.088418 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" event={"ID":"210cd3a4-c863-42d9-b923-2861068be417","Type":"ContainerDied","Data":"c2068f8652c351853f75290235d7a7d80de4064af62b13b922b1e0a28c8cf942"} Jul 22 20:57:33.744712 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:33.744667 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:33.744891 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:33.744765 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:33.744891 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:33.744863 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 20:57:33.745039 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:33.744941 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls podName:ef1dd499-990b-49f1-adb6-9e68904d36ed nodeName:}" failed. No retries permitted until 2026-07-22 20:57:41.744923233 +0000 UTC m=+45.284431517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls") pod "dns-default-zhcx7" (UID: "ef1dd499-990b-49f1-adb6-9e68904d36ed") : secret "dns-default-metrics-tls" not found Jul 22 20:57:33.745039 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:33.744944 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 20:57:33.745039 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:33.744965 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54bf7db6b7-nr9fj: secret "image-registry-tls" not found Jul 22 20:57:33.745151 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:33.745055 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls podName:cf9fb21e-a5d4-4439-9b61-a2c2e749d129 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:41.745037853 +0000 UTC m=+45.284546140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls") pod "image-registry-54bf7db6b7-nr9fj" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129") : secret "image-registry-tls" not found Jul 22 20:57:34.094998 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:34.094958 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" event={"ID":"210cd3a4-c863-42d9-b923-2861068be417","Type":"ContainerStarted","Data":"ba7339c4a7463f1a3f2951ea9d62de39176ab0fb5d634c4edc94fea653248e83"} Jul 22 20:57:34.119999 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:34.119938 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2tpx6" podStartSLOduration=8.416838142 podStartE2EDuration="38.119919098s" totalImagesPullingTime="29.703080956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:34.11811335 +0000 UTC m=+37.657621669" watchObservedRunningTime="2026-07-22 20:57:34.119919098 +0000 UTC m=+37.659427402" Jul 22 20:57:37.104537 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:37.104474 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hl4z6" event={"ID":"940c3cac-b997-4898-8eb3-bf1a957db943","Type":"ContainerStarted","Data":"1117a75962726e0bd40dca03dc36f050bc9889d579eebbdb53be6f693af1f705"} Jul 22 20:57:37.104871 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:37.104663 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:57:37.121869 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:37.121808 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hl4z6" podStartSLOduration=34.895442004 podStartE2EDuration="40.121789024s" totalImagesPullingTime="5.22634702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:37.121043483 +0000 UTC m=+40.660551785" watchObservedRunningTime="2026-07-22 20:57:37.121789024 +0000 UTC m=+40.661297305" Jul 22 20:57:38.110260 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:38.110218 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fmkq4" event={"ID":"75dc5369-9597-4d82-9dee-89ad4a855dbe","Type":"ContainerStarted","Data":"53013c816662a02e542d5c9f646f961c358eb2f5ea8488a1371d8353a7cad780"} Jul 22 20:57:38.125234 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:38.125187 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fmkq4" podStartSLOduration=35.578434052 podStartE2EDuration="41.125171648s" totalImagesPullingTime="5.546737596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:38.124771443 +0000 UTC m=+41.664279744" watchObservedRunningTime="2026-07-22 20:57:38.125171648 +0000 UTC m=+41.664679949" Jul 22 20:57:41.803310 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:41.803271 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:41.803763 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:41.803342 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:41.803763 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:41.803459 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 20:57:41.803763 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:41.803470 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 20:57:41.803763 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:41.803491 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54bf7db6b7-nr9fj: secret "image-registry-tls" not found Jul 22 20:57:41.803763 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:41.803541 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls podName:ef1dd499-990b-49f1-adb6-9e68904d36ed nodeName:}" failed. No retries permitted until 2026-07-22 20:57:57.803520582 +0000 UTC m=+61.343028861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls") pod "dns-default-zhcx7" (UID: "ef1dd499-990b-49f1-adb6-9e68904d36ed") : secret "dns-default-metrics-tls" not found Jul 22 20:57:41.803763 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:41.803555 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls podName:cf9fb21e-a5d4-4439-9b61-a2c2e749d129 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:57.803549275 +0000 UTC m=+61.343057554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls") pod "image-registry-54bf7db6b7-nr9fj" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129") : secret "image-registry-tls" not found Jul 22 20:57:57.902855 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:57.902813 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:57:57.903472 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:57:57.902900 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:57:57.903472 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:57.902978 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 20:57:57.903472 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:57.902999 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 20:57:57.903472 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:57.903002 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54bf7db6b7-nr9fj: secret "image-registry-tls" not found Jul 22 20:57:57.903472 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:57.903058 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls podName:cf9fb21e-a5d4-4439-9b61-a2c2e749d129 nodeName:}" failed. No retries permitted until 2026-07-22 20:58:29.90304394 +0000 UTC m=+93.442552220 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls") pod "image-registry-54bf7db6b7-nr9fj" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129") : secret "image-registry-tls" not found Jul 22 20:57:57.903472 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:57:57.903072 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls podName:ef1dd499-990b-49f1-adb6-9e68904d36ed nodeName:}" failed. No retries permitted until 2026-07-22 20:58:29.90306602 +0000 UTC m=+93.442574299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls") pod "dns-default-zhcx7" (UID: "ef1dd499-990b-49f1-adb6-9e68904d36ed") : secret "dns-default-metrics-tls" not found Jul 22 20:58:01.626945 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:58:01.626901 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:58:01.627329 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:58:01.627058 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 20:58:01.627329 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:58:01.627125 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs podName:3b98e5db-0164-4705-8954-50b7dcb3cc39 nodeName:}" failed. No retries permitted until 2026-07-22 20:59:05.627110182 +0000 UTC m=+129.166618463 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs") pod "network-metrics-daemon-5s2tf" (UID: "3b98e5db-0164-4705-8954-50b7dcb3cc39") : secret "metrics-daemon-secret" not found Jul 22 20:58:08.112676 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:58:08.112641 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hl4z6" Jul 22 20:58:29.920491 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:58:29.920420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:58:29.921000 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:58:29.920513 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:58:29.921000 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:58:29.920597 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 20:58:29.921000 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:58:29.920621 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54bf7db6b7-nr9fj: secret "image-registry-tls" not found Jul 22 20:58:29.921000 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:58:29.920685 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls podName:cf9fb21e-a5d4-4439-9b61-a2c2e749d129 nodeName:}" failed. No retries permitted until 2026-07-22 20:59:33.920667559 +0000 UTC m=+157.460175839 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls") pod "image-registry-54bf7db6b7-nr9fj" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129") : secret "image-registry-tls" not found Jul 22 20:58:29.921000 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:58:29.920593 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 20:58:29.921000 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:58:29.920736 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls podName:ef1dd499-990b-49f1-adb6-9e68904d36ed nodeName:}" failed. No retries permitted until 2026-07-22 20:59:33.920722321 +0000 UTC m=+157.460230605 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls") pod "dns-default-zhcx7" (UID: "ef1dd499-990b-49f1-adb6-9e68904d36ed") : secret "dns-default-metrics-tls" not found Jul 22 20:59:05.666649 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:59:05.666591 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 20:59:05.667149 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:59:05.666751 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 20:59:05.667149 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:59:05.666824 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs podName:3b98e5db-0164-4705-8954-50b7dcb3cc39 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:07.666807512 +0000 UTC m=+251.206315795 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs") pod "network-metrics-daemon-5s2tf" (UID: "3b98e5db-0164-4705-8954-50b7dcb3cc39") : secret "metrics-daemon-secret" not found Jul 22 20:59:28.942660 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:59:28.942623 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" podUID="cf9fb21e-a5d4-4439-9b61-a2c2e749d129" Jul 22 20:59:28.948802 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:59:28.948778 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zhcx7" podUID="ef1dd499-990b-49f1-adb6-9e68904d36ed" Jul 22 20:59:29.374029 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:59:29.374000 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zhcx7" Jul 22 20:59:29.374197 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:59:29.374045 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:59:29.878640 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:59:29.878593 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 20:59:33.958128 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:59:33.958073 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls\") pod \"image-registry-54bf7db6b7-nr9fj\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 20:59:33.958541 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:59:33.958150 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 20:59:33.958541 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:59:33.958223 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 20:59:33.958541 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:59:33.958233 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 20:59:33.958541 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:59:33.958242 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54bf7db6b7-nr9fj: secret "image-registry-tls" not found Jul 22 20:59:33.958541 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:59:33.958296 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls podName:ef1dd499-990b-49f1-adb6-9e68904d36ed nodeName:}" failed. No retries permitted until 2026-07-22 21:01:35.958282028 +0000 UTC m=+279.497790308 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls") pod "dns-default-zhcx7" (UID: "ef1dd499-990b-49f1-adb6-9e68904d36ed") : secret "dns-default-metrics-tls" not found Jul 22 20:59:33.958541 ip-10-0-141-215 kubenswrapper[2557]: E0722 20:59:33.958310 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls podName:cf9fb21e-a5d4-4439-9b61-a2c2e749d129 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:35.958303845 +0000 UTC m=+279.497812125 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls") pod "image-registry-54bf7db6b7-nr9fj" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129") : secret "image-registry-tls" not found Jul 22 20:59:41.868427 ip-10-0-141-215 kubenswrapper[2557]: I0722 20:59:41.868392 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 21:01:05.343317 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.343277 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-bw9fb"] Jul 22 21:01:05.345204 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.345184 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.347233 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.347198 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s"] Jul 22 21:01:05.348408 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.348385 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 22 21:01:05.348714 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.348697 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64"] Jul 22 21:01:05.348833 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.348815 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" Jul 22 21:01:05.349877 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.349848 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 22 21:01:05.349877 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.349856 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 21:01:05.349877 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.349866 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 21:01:05.350077 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.349913 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nqkzc\"" Jul 22 21:01:05.350584 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.350565 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bvgwp"] Jul 22 21:01:05.350680 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.350665 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:05.351165 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.351145 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-r8l2d\"" Jul 22 21:01:05.351559 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.351539 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 22 21:01:05.351663 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.351625 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 22 21:01:05.351663 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.351631 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 22 21:01:05.352357 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.352338 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c69f9dccb-qd97j"] Jul 22 21:01:05.352481 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.352376 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 22 21:01:05.357639 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.352973 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.357639 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.353521 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 21:01:05.357639 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.356552 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 22 21:01:05.358686 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.358556 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 21:01:05.359008 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.358968 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 22 21:01:05.359195 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.359175 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8dtwd\"" Jul 22 21:01:05.359699 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.359677 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-bw9fb"] Jul 22 21:01:05.359795 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.359735 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 22 21:01:05.359795 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.359768 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.360871 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.360851 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 22 21:01:05.362158 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.362142 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 22 21:01:05.362295 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.362250 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 22 21:01:05.362701 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.362681 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s"] Jul 22 21:01:05.362952 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.362842 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 22 21:01:05.363554 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.363322 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 22 21:01:05.363554 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.363546 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 21:01:05.363895 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.363584 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 22 21:01:05.363895 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.363807 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7s6pl\"" Jul 22 21:01:05.363895 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.363826 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 22 21:01:05.364287 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.364246 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 21:01:05.364374 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.364315 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 22 21:01:05.364468 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.364388 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9sngp\"" Jul 22 21:01:05.366004 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.365982 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 22 21:01:05.366403 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.366389 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bvgwp"] Jul 22 21:01:05.367399 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.367380 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64"] Jul 22 21:01:05.372349 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.372323 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c69f9dccb-qd97j"] Jul 22 21:01:05.441569 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441536 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/beaa77f6-0828-48c3-953c-0bacf46c177b-config\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.441742 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441586 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcv7l\" (UniqueName: \"kubernetes.io/projected/ea28784d-6539-4974-8542-ce1ce879d129-kube-api-access-lcv7l\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:05.441742 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441615 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:05.441742 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441640 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxfq5\" (UniqueName: \"kubernetes.io/projected/472c551d-bdfe-4ec3-910e-49ba89267ecf-kube-api-access-rxfq5\") pod \"kube-storage-version-migrator-operator-7658d9b749-csx4s\" (UID: \"472c551d-bdfe-4ec3-910e-49ba89267ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" Jul 22 21:01:05.441742 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/beaa77f6-0828-48c3-953c-0bacf46c177b-trusted-ca\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.441943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441755 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-serving-cert\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.441943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441778 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.441943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441818 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ea28784d-6539-4974-8542-ce1ce879d129-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:05.441943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441845 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr8z9\" (UniqueName: \"kubernetes.io/projected/beaa77f6-0828-48c3-953c-0bacf46c177b-kube-api-access-wr8z9\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.441943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441863 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.441943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-tmp\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.441943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441910 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zw4t\" (UniqueName: \"kubernetes.io/projected/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-kube-api-access-7zw4t\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.442230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.441962 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/472c551d-bdfe-4ec3-910e-49ba89267ecf-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-csx4s\" (UID: \"472c551d-bdfe-4ec3-910e-49ba89267ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" Jul 22 21:01:05.442230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.442029 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/beaa77f6-0828-48c3-953c-0bacf46c177b-serving-cert\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.442230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.442050 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.442230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.442069 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/472c551d-bdfe-4ec3-910e-49ba89267ecf-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-csx4s\" (UID: \"472c551d-bdfe-4ec3-910e-49ba89267ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" Jul 22 21:01:05.442230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.442088 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-snapshots\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.442230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.442118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-service-ca-bundle\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.442230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.442149 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-stats-auth\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.442230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.442185 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkmnj\" (UniqueName: \"kubernetes.io/projected/252c0d53-08ac-4f77-b716-489cc651023d-kube-api-access-nkmnj\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.442230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.442216 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-default-certificate\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.543359 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543337 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/472c551d-bdfe-4ec3-910e-49ba89267ecf-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-csx4s\" (UID: \"472c551d-bdfe-4ec3-910e-49ba89267ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" Jul 22 21:01:05.543530 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543372 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-snapshots\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.543530 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543397 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-service-ca-bundle\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.543530 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-stats-auth\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.543685 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkmnj\" (UniqueName: \"kubernetes.io/projected/252c0d53-08ac-4f77-b716-489cc651023d-kube-api-access-nkmnj\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.543685 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543583 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-default-certificate\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543745 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/beaa77f6-0828-48c3-953c-0bacf46c177b-config\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543805 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcv7l\" (UniqueName: \"kubernetes.io/projected/ea28784d-6539-4974-8542-ce1ce879d129-kube-api-access-lcv7l\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543837 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543856 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxfq5\" (UniqueName: \"kubernetes.io/projected/472c551d-bdfe-4ec3-910e-49ba89267ecf-kube-api-access-rxfq5\") pod \"kube-storage-version-migrator-operator-7658d9b749-csx4s\" (UID: \"472c551d-bdfe-4ec3-910e-49ba89267ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543897 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/beaa77f6-0828-48c3-953c-0bacf46c177b-trusted-ca\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543926 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-serving-cert\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543948 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.543976 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ea28784d-6539-4974-8542-ce1ce879d129-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:05.543990 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544002 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/472c551d-bdfe-4ec3-910e-49ba89267ecf-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-csx4s\" (UID: \"472c551d-bdfe-4ec3-910e-49ba89267ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544014 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr8z9\" (UniqueName: \"kubernetes.io/projected/beaa77f6-0828-48c3-953c-0bacf46c177b-kube-api-access-wr8z9\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544039 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544046 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-service-ca-bundle\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:05.544077 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls podName:ea28784d-6539-4974-8542-ce1ce879d129 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:06.044057566 +0000 UTC m=+249.583565847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l6w64" (UID: "ea28784d-6539-4974-8542-ce1ce879d129") : secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:05.544381 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:05.544119 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 21:01:05.545156 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:05.544175 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs podName:252c0d53-08ac-4f77-b716-489cc651023d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:06.044160046 +0000 UTC m=+249.583668330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs") pod "router-default-5c69f9dccb-qd97j" (UID: "252c0d53-08ac-4f77-b716-489cc651023d") : secret "router-metrics-certs-default" not found Jul 22 21:01:05.545156 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:05.544413 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle podName:252c0d53-08ac-4f77-b716-489cc651023d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:06.0443973 +0000 UTC m=+249.583905604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle") pod "router-default-5c69f9dccb-qd97j" (UID: "252c0d53-08ac-4f77-b716-489cc651023d") : configmap references non-existent config key: service-ca.crt Jul 22 21:01:05.545156 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544491 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/beaa77f6-0828-48c3-953c-0bacf46c177b-config\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.545156 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544548 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-tmp\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.545156 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544581 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zw4t\" (UniqueName: \"kubernetes.io/projected/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-kube-api-access-7zw4t\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.545156 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544611 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/472c551d-bdfe-4ec3-910e-49ba89267ecf-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-csx4s\" (UID: \"472c551d-bdfe-4ec3-910e-49ba89267ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" Jul 22 21:01:05.545156 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544659 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/beaa77f6-0828-48c3-953c-0bacf46c177b-serving-cert\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.545156 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544687 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.545156 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544825 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-tmp\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.545156 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.544977 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ea28784d-6539-4974-8542-ce1ce879d129-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:05.545645 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.545160 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-snapshots\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.545645 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.545281 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/beaa77f6-0828-48c3-953c-0bacf46c177b-trusted-ca\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.545729 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.545706 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.546728 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.546701 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-serving-cert\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.546961 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.546940 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-default-certificate\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.547027 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.546940 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-stats-auth\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.547174 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.547159 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/472c551d-bdfe-4ec3-910e-49ba89267ecf-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-csx4s\" (UID: \"472c551d-bdfe-4ec3-910e-49ba89267ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" Jul 22 21:01:05.547870 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.547852 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/beaa77f6-0828-48c3-953c-0bacf46c177b-serving-cert\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.556029 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.555989 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkmnj\" (UniqueName: \"kubernetes.io/projected/252c0d53-08ac-4f77-b716-489cc651023d-kube-api-access-nkmnj\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:05.556133 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.556035 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcv7l\" (UniqueName: \"kubernetes.io/projected/ea28784d-6539-4974-8542-ce1ce879d129-kube-api-access-lcv7l\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:05.556991 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.556971 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxfq5\" (UniqueName: \"kubernetes.io/projected/472c551d-bdfe-4ec3-910e-49ba89267ecf-kube-api-access-rxfq5\") pod \"kube-storage-version-migrator-operator-7658d9b749-csx4s\" (UID: \"472c551d-bdfe-4ec3-910e-49ba89267ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" Jul 22 21:01:05.557284 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.557268 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr8z9\" (UniqueName: \"kubernetes.io/projected/beaa77f6-0828-48c3-953c-0bacf46c177b-kube-api-access-wr8z9\") pod \"console-operator-565b7b569d-bvgwp\" (UID: \"beaa77f6-0828-48c3-953c-0bacf46c177b\") " pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.557759 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.557740 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zw4t\" (UniqueName: \"kubernetes.io/projected/c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1-kube-api-access-7zw4t\") pod \"insights-operator-555d9d7885-bw9fb\" (UID: \"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1\") " pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.659627 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.659565 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-bw9fb" Jul 22 21:01:05.667943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.667894 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" Jul 22 21:01:05.680928 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.680903 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:05.803224 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.803151 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-bw9fb"] Jul 22 21:01:05.807344 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:05.807310 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc075f6a4_3da1_4ae6_b3d9_65748bc0c1c1.slice/crio-e92d5435491fb73fb5efbc45aa32cf4dde0abfcf98caf06a50fd43c9b719859b WatchSource:0}: Error finding container e92d5435491fb73fb5efbc45aa32cf4dde0abfcf98caf06a50fd43c9b719859b: Status 404 returned error can't find the container with id e92d5435491fb73fb5efbc45aa32cf4dde0abfcf98caf06a50fd43c9b719859b Jul 22 21:01:05.818284 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.818245 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s"] Jul 22 21:01:05.823968 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:05.823928 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472c551d_bdfe_4ec3_910e_49ba89267ecf.slice/crio-c24c7432197018e0b4a6544cb69102549ade55862508723c997a7a6875f4fadc WatchSource:0}: Error finding container c24c7432197018e0b4a6544cb69102549ade55862508723c997a7a6875f4fadc: Status 404 returned error can't find the container with id c24c7432197018e0b4a6544cb69102549ade55862508723c997a7a6875f4fadc Jul 22 21:01:05.837936 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:05.837912 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bvgwp"] Jul 22 21:01:05.840617 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:05.840592 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeaa77f6_0828_48c3_953c_0bacf46c177b.slice/crio-5989a2a96b3983de93adda2ab144ebe787e85ff9ace19973b122430ec44e1cb6 WatchSource:0}: Error finding container 5989a2a96b3983de93adda2ab144ebe787e85ff9ace19973b122430ec44e1cb6: Status 404 returned error can't find the container with id 5989a2a96b3983de93adda2ab144ebe787e85ff9ace19973b122430ec44e1cb6 Jul 22 21:01:06.048849 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:06.048778 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:06.048960 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:06.048867 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:06.048960 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:06.048908 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:06.048960 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:06.048924 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 21:01:06.049055 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:06.048986 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs podName:252c0d53-08ac-4f77-b716-489cc651023d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:07.048969622 +0000 UTC m=+250.588477902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs") pod "router-default-5c69f9dccb-qd97j" (UID: "252c0d53-08ac-4f77-b716-489cc651023d") : secret "router-metrics-certs-default" not found Jul 22 21:01:06.049055 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:06.048994 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:06.049055 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:06.049002 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle podName:252c0d53-08ac-4f77-b716-489cc651023d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:07.048992413 +0000 UTC m=+250.588500711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle") pod "router-default-5c69f9dccb-qd97j" (UID: "252c0d53-08ac-4f77-b716-489cc651023d") : configmap references non-existent config key: service-ca.crt Jul 22 21:01:06.049055 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:06.049043 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls podName:ea28784d-6539-4974-8542-ce1ce879d129 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:07.049030853 +0000 UTC m=+250.588539136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l6w64" (UID: "ea28784d-6539-4974-8542-ce1ce879d129") : secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:06.601665 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:06.601623 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" event={"ID":"472c551d-bdfe-4ec3-910e-49ba89267ecf","Type":"ContainerStarted","Data":"c24c7432197018e0b4a6544cb69102549ade55862508723c997a7a6875f4fadc"} Jul 22 21:01:06.602811 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:06.602781 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-bw9fb" event={"ID":"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1","Type":"ContainerStarted","Data":"e92d5435491fb73fb5efbc45aa32cf4dde0abfcf98caf06a50fd43c9b719859b"} Jul 22 21:01:06.603950 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:06.603927 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" event={"ID":"beaa77f6-0828-48c3-953c-0bacf46c177b","Type":"ContainerStarted","Data":"5989a2a96b3983de93adda2ab144ebe787e85ff9ace19973b122430ec44e1cb6"} Jul 22 21:01:07.054999 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:07.054881 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:07.054999 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:07.054953 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:07.054999 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:07.054998 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:07.055268 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:07.055045 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:07.055268 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:07.055120 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle podName:252c0d53-08ac-4f77-b716-489cc651023d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:09.055101039 +0000 UTC m=+252.594609324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle") pod "router-default-5c69f9dccb-qd97j" (UID: "252c0d53-08ac-4f77-b716-489cc651023d") : configmap references non-existent config key: service-ca.crt Jul 22 21:01:07.055268 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:07.055142 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls podName:ea28784d-6539-4974-8542-ce1ce879d129 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:09.055132162 +0000 UTC m=+252.594640453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l6w64" (UID: "ea28784d-6539-4974-8542-ce1ce879d129") : secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:07.055268 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:07.055148 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 21:01:07.055268 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:07.055197 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs podName:252c0d53-08ac-4f77-b716-489cc651023d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:09.055180101 +0000 UTC m=+252.594688397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs") pod "router-default-5c69f9dccb-qd97j" (UID: "252c0d53-08ac-4f77-b716-489cc651023d") : secret "router-metrics-certs-default" not found Jul 22 21:01:07.760400 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:07.760359 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 21:01:07.760840 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:07.760541 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 21:01:07.760840 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:07.760610 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs podName:3b98e5db-0164-4705-8954-50b7dcb3cc39 nodeName:}" failed. No retries permitted until 2026-07-22 21:03:09.760594304 +0000 UTC m=+373.300102583 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs") pod "network-metrics-daemon-5s2tf" (UID: "3b98e5db-0164-4705-8954-50b7dcb3cc39") : secret "metrics-daemon-secret" not found Jul 22 21:01:08.612082 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:08.612055 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/0.log" Jul 22 21:01:08.612223 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:08.612095 2557 generic.go:356] "Generic (PLEG): container finished" podID="beaa77f6-0828-48c3-953c-0bacf46c177b" containerID="32f051c551eb588ee6b3aa8f80523cb2967181e0044f92d2467e1ed93b798342" exitCode=255 Jul 22 21:01:08.612223 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:08.612186 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" event={"ID":"beaa77f6-0828-48c3-953c-0bacf46c177b","Type":"ContainerDied","Data":"32f051c551eb588ee6b3aa8f80523cb2967181e0044f92d2467e1ed93b798342"} Jul 22 21:01:08.612472 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:08.612425 2557 scope.go:117] "RemoveContainer" containerID="32f051c551eb588ee6b3aa8f80523cb2967181e0044f92d2467e1ed93b798342" Jul 22 21:01:08.613810 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:08.613774 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" event={"ID":"472c551d-bdfe-4ec3-910e-49ba89267ecf","Type":"ContainerStarted","Data":"00a70f420cfe1fec24be530e5469422b35ba85945fc249d9cdd5aaea0338143c"} Jul 22 21:01:08.644367 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:08.644301 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" podStartSLOduration=1.075830756 podStartE2EDuration="3.644286994s" totalImagesPullingTime="2.568456238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:08.643272091 +0000 UTC m=+252.182780394" watchObservedRunningTime="2026-07-22 21:01:08.644286994 +0000 UTC m=+252.183795290" Jul 22 21:01:09.071715 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:09.071642 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:09.071715 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:09.071684 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:09.072092 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:09.071788 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle podName:252c0d53-08ac-4f77-b716-489cc651023d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:13.071776199 +0000 UTC m=+256.611284478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle") pod "router-default-5c69f9dccb-qd97j" (UID: "252c0d53-08ac-4f77-b716-489cc651023d") : configmap references non-existent config key: service-ca.crt Jul 22 21:01:09.072092 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:09.071789 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:09.072092 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:09.071817 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:09.075994 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:09.072185 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls podName:ea28784d-6539-4974-8542-ce1ce879d129 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:13.071835751 +0000 UTC m=+256.611344052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l6w64" (UID: "ea28784d-6539-4974-8542-ce1ce879d129") : secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:09.075994 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:09.072269 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 21:01:09.075994 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:09.072327 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs podName:252c0d53-08ac-4f77-b716-489cc651023d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:13.072304598 +0000 UTC m=+256.611812880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs") pod "router-default-5c69f9dccb-qd97j" (UID: "252c0d53-08ac-4f77-b716-489cc651023d") : secret "router-metrics-certs-default" not found Jul 22 21:01:09.619521 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:09.619485 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/1.log" Jul 22 21:01:09.620033 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:09.620017 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/0.log" Jul 22 21:01:09.620144 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:09.620053 2557 generic.go:356] "Generic (PLEG): container finished" podID="beaa77f6-0828-48c3-953c-0bacf46c177b" containerID="6ee63ea258cfcf1cd863441e8fbb7f1c8aa18d311df305cc13033aafd1fd52ba" exitCode=255 Jul 22 21:01:09.620202 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:09.620137 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" event={"ID":"beaa77f6-0828-48c3-953c-0bacf46c177b","Type":"ContainerDied","Data":"6ee63ea258cfcf1cd863441e8fbb7f1c8aa18d311df305cc13033aafd1fd52ba"} Jul 22 21:01:09.620272 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:09.620256 2557 scope.go:117] "RemoveContainer" containerID="32f051c551eb588ee6b3aa8f80523cb2967181e0044f92d2467e1ed93b798342" Jul 22 21:01:09.620570 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:09.620542 2557 scope.go:117] "RemoveContainer" containerID="6ee63ea258cfcf1cd863441e8fbb7f1c8aa18d311df305cc13033aafd1fd52ba" Jul 22 21:01:09.620747 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:09.620728 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bvgwp_openshift-console-operator(beaa77f6-0828-48c3-953c-0bacf46c177b)\"" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" podUID="beaa77f6-0828-48c3-953c-0bacf46c177b" Jul 22 21:01:10.624666 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:10.624640 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/1.log" Jul 22 21:01:10.625135 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:10.624962 2557 scope.go:117] "RemoveContainer" containerID="6ee63ea258cfcf1cd863441e8fbb7f1c8aa18d311df305cc13033aafd1fd52ba" Jul 22 21:01:10.625135 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:10.625106 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bvgwp_openshift-console-operator(beaa77f6-0828-48c3-953c-0bacf46c177b)\"" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" podUID="beaa77f6-0828-48c3-953c-0bacf46c177b" Jul 22 21:01:11.630603 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.630567 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-bw9fb" event={"ID":"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1","Type":"ContainerStarted","Data":"fbc1cf30669c140efc09eb38515cf3b1f5de93d4c29ca27b68ca43efee664dd0"} Jul 22 21:01:11.647538 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.647488 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-bw9fb" podStartSLOduration=1.210943859 podStartE2EDuration="6.647472801s" totalImagesPullingTime="5.436528942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:11.646852406 +0000 UTC m=+255.186360709" watchObservedRunningTime="2026-07-22 21:01:11.647472801 +0000 UTC m=+255.186981102" Jul 22 21:01:11.841608 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.841577 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-vspbr"] Jul 22 21:01:11.843272 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.843255 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-vspbr" Jul 22 21:01:11.846171 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.846148 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4555q\"" Jul 22 21:01:11.846621 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.846602 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 22 21:01:11.846810 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.846796 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 22 21:01:11.846891 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.846873 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 22 21:01:11.847380 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.847366 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 22 21:01:11.854267 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.854248 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-vspbr"] Jul 22 21:01:11.997749 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.997676 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mxhv\" (UniqueName: \"kubernetes.io/projected/d8f15030-079d-4b9f-9e28-d472ff40ff99-kube-api-access-8mxhv\") pod \"service-ca-58598695f7-vspbr\" (UID: \"d8f15030-079d-4b9f-9e28-d472ff40ff99\") " pod="openshift-service-ca/service-ca-58598695f7-vspbr" Jul 22 21:01:11.997749 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.997730 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8f15030-079d-4b9f-9e28-d472ff40ff99-signing-cabundle\") pod \"service-ca-58598695f7-vspbr\" (UID: \"d8f15030-079d-4b9f-9e28-d472ff40ff99\") " pod="openshift-service-ca/service-ca-58598695f7-vspbr" Jul 22 21:01:11.997929 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:11.997807 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8f15030-079d-4b9f-9e28-d472ff40ff99-signing-key\") pod \"service-ca-58598695f7-vspbr\" (UID: \"d8f15030-079d-4b9f-9e28-d472ff40ff99\") " pod="openshift-service-ca/service-ca-58598695f7-vspbr" Jul 22 21:01:12.054376 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.054344 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qzn68"] Jul 22 21:01:12.059286 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.059261 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.061600 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.061577 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 21:01:12.061744 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.061628 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jvwv8\"" Jul 22 21:01:12.061866 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.061851 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 21:01:12.067095 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.067075 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qzn68"] Jul 22 21:01:12.098582 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.098556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mxhv\" (UniqueName: \"kubernetes.io/projected/d8f15030-079d-4b9f-9e28-d472ff40ff99-kube-api-access-8mxhv\") pod \"service-ca-58598695f7-vspbr\" (UID: \"d8f15030-079d-4b9f-9e28-d472ff40ff99\") " pod="openshift-service-ca/service-ca-58598695f7-vspbr" Jul 22 21:01:12.098680 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.098600 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8f15030-079d-4b9f-9e28-d472ff40ff99-signing-cabundle\") pod \"service-ca-58598695f7-vspbr\" (UID: \"d8f15030-079d-4b9f-9e28-d472ff40ff99\") " pod="openshift-service-ca/service-ca-58598695f7-vspbr" Jul 22 21:01:12.098680 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.098634 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8f15030-079d-4b9f-9e28-d472ff40ff99-signing-key\") pod \"service-ca-58598695f7-vspbr\" (UID: \"d8f15030-079d-4b9f-9e28-d472ff40ff99\") " pod="openshift-service-ca/service-ca-58598695f7-vspbr" Jul 22 21:01:12.099254 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.099233 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8f15030-079d-4b9f-9e28-d472ff40ff99-signing-cabundle\") pod \"service-ca-58598695f7-vspbr\" (UID: \"d8f15030-079d-4b9f-9e28-d472ff40ff99\") " pod="openshift-service-ca/service-ca-58598695f7-vspbr" Jul 22 21:01:12.101097 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.101081 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8f15030-079d-4b9f-9e28-d472ff40ff99-signing-key\") pod \"service-ca-58598695f7-vspbr\" (UID: \"d8f15030-079d-4b9f-9e28-d472ff40ff99\") " pod="openshift-service-ca/service-ca-58598695f7-vspbr" Jul 22 21:01:12.106583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.106556 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mxhv\" (UniqueName: \"kubernetes.io/projected/d8f15030-079d-4b9f-9e28-d472ff40ff99-kube-api-access-8mxhv\") pod \"service-ca-58598695f7-vspbr\" (UID: \"d8f15030-079d-4b9f-9e28-d472ff40ff99\") " pod="openshift-service-ca/service-ca-58598695f7-vspbr" Jul 22 21:01:12.152534 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.152505 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-vspbr" Jul 22 21:01:12.199919 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.199885 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prhzc\" (UniqueName: \"kubernetes.io/projected/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-api-access-prhzc\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.200035 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.199959 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-data-volume\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.200093 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.200063 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.200178 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.200159 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-crio-socket\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.200238 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.200195 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.272683 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.272614 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-vspbr"] Jul 22 21:01:12.275401 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:12.275373 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f15030_079d_4b9f_9e28_d472ff40ff99.slice/crio-28dab4c47c947fe6da475dc1589e300fe3ed03196968a81ea76c6dd1a64201ae WatchSource:0}: Error finding container 28dab4c47c947fe6da475dc1589e300fe3ed03196968a81ea76c6dd1a64201ae: Status 404 returned error can't find the container with id 28dab4c47c947fe6da475dc1589e300fe3ed03196968a81ea76c6dd1a64201ae Jul 22 21:01:12.301021 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.300997 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-data-volume\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.301121 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.301032 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.301121 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.301061 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-crio-socket\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.301121 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.301075 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.301281 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:12.301146 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 21:01:12.301281 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:12.301164 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 21:01:12.301281 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.301150 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-crio-socket\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.301281 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:12.301216 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls podName:a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:12.80120274 +0000 UTC m=+256.340711019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qzn68" (UID: "a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3") : secret "insights-runtime-extractor-tls" not found Jul 22 21:01:12.301281 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:12.301243 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm podName:a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:12.801231153 +0000 UTC m=+256.340739433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qzn68" (UID: "a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3") : configmap "kube-rbac-proxy" not found Jul 22 21:01:12.301529 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.301310 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prhzc\" (UniqueName: \"kubernetes.io/projected/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-api-access-prhzc\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.301529 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.301362 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-data-volume\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.310200 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.310179 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prhzc\" (UniqueName: \"kubernetes.io/projected/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-api-access-prhzc\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.634315 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.634280 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-vspbr" event={"ID":"d8f15030-079d-4b9f-9e28-d472ff40ff99","Type":"ContainerStarted","Data":"28dab4c47c947fe6da475dc1589e300fe3ed03196968a81ea76c6dd1a64201ae"} Jul 22 21:01:12.805750 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.805713 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.805911 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:12.805761 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:12.805911 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:12.805826 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 21:01:12.805911 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:12.805887 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm podName:a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:13.805868981 +0000 UTC m=+257.345377261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qzn68" (UID: "a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3") : configmap "kube-rbac-proxy" not found Jul 22 21:01:12.806154 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:12.805940 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 21:01:12.806154 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:12.806002 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls podName:a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:13.805986298 +0000 UTC m=+257.345494578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qzn68" (UID: "a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3") : secret "insights-runtime-extractor-tls" not found Jul 22 21:01:13.108346 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:13.108313 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:13.108559 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:13.108464 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:13.108559 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:13.108508 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 21:01:13.108673 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:13.108581 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs podName:252c0d53-08ac-4f77-b716-489cc651023d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:21.108561063 +0000 UTC m=+264.648069346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs") pod "router-default-5c69f9dccb-qd97j" (UID: "252c0d53-08ac-4f77-b716-489cc651023d") : secret "router-metrics-certs-default" not found Jul 22 21:01:13.108673 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:13.108600 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:13.108673 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:13.108607 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle podName:252c0d53-08ac-4f77-b716-489cc651023d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:21.108592348 +0000 UTC m=+264.648100634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle") pod "router-default-5c69f9dccb-qd97j" (UID: "252c0d53-08ac-4f77-b716-489cc651023d") : configmap references non-existent config key: service-ca.crt Jul 22 21:01:13.108673 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:13.108510 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:13.108673 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:13.108639 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls podName:ea28784d-6539-4974-8542-ce1ce879d129 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:21.108628138 +0000 UTC m=+264.648136419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l6w64" (UID: "ea28784d-6539-4974-8542-ce1ce879d129") : secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:13.814555 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:13.814511 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:13.814988 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:13.814583 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:13.814988 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:13.814617 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 21:01:13.814988 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:13.814691 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm podName:a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:15.814671884 +0000 UTC m=+259.354180167 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qzn68" (UID: "a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3") : configmap "kube-rbac-proxy" not found Jul 22 21:01:13.814988 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:13.814711 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 21:01:13.814988 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:13.814775 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls podName:a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:15.814758568 +0000 UTC m=+259.354266874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qzn68" (UID: "a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3") : secret "insights-runtime-extractor-tls" not found Jul 22 21:01:14.641493 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:14.641451 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-vspbr" event={"ID":"d8f15030-079d-4b9f-9e28-d472ff40ff99","Type":"ContainerStarted","Data":"37bc92817dc1790713ccecf1172514f938f767622c0f699639622339f34c2209"} Jul 22 21:01:14.658072 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:14.658029 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-vspbr" podStartSLOduration=1.796113421 podStartE2EDuration="3.658014439s" totalImagesPullingTime="1.861901018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:14.657718792 +0000 UTC m=+258.197227093" watchObservedRunningTime="2026-07-22 21:01:14.658014439 +0000 UTC m=+258.197522742" Jul 22 21:01:15.131034 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:15.131003 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g6tpx_6a4189a4-946c-42c6-9fe3-95db3c0c73bd/dns-node-resolver/0.log" Jul 22 21:01:15.680979 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:15.680949 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:15.681160 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:15.681052 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:15.681362 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:15.681349 2557 scope.go:117] "RemoveContainer" containerID="6ee63ea258cfcf1cd863441e8fbb7f1c8aa18d311df305cc13033aafd1fd52ba" Jul 22 21:01:15.681569 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:15.681547 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bvgwp_openshift-console-operator(beaa77f6-0828-48c3-953c-0bacf46c177b)\"" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" podUID="beaa77f6-0828-48c3-953c-0bacf46c177b" Jul 22 21:01:15.739568 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:15.739540 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2tl7d_400c915a-cea5-4e42-bb74-437f9e93133a/node-ca/0.log" Jul 22 21:01:15.832493 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:15.832458 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:15.832678 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:15.832544 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 21:01:15.832678 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:15.832617 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm podName:a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:19.832598446 +0000 UTC m=+263.372106727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qzn68" (UID: "a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3") : configmap "kube-rbac-proxy" not found Jul 22 21:01:15.832798 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:15.832726 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:15.833331 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:15.833313 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 21:01:15.833383 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:15.833368 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls podName:a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:19.833353087 +0000 UTC m=+263.372861370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qzn68" (UID: "a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3") : secret "insights-runtime-extractor-tls" not found Jul 22 21:01:16.647470 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:16.647430 2557 scope.go:117] "RemoveContainer" containerID="6ee63ea258cfcf1cd863441e8fbb7f1c8aa18d311df305cc13033aafd1fd52ba" Jul 22 21:01:16.647877 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:16.647598 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bvgwp_openshift-console-operator(beaa77f6-0828-48c3-953c-0bacf46c177b)\"" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" podUID="beaa77f6-0828-48c3-953c-0bacf46c177b" Jul 22 21:01:16.731071 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:16.731044 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jz77h_2861d068-fec4-432f-b35e-3d9c9f81154d/serve-healthcheck-canary/0.log" Jul 22 21:01:17.533922 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:17.533842 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-csx4s_472c551d-bdfe-4ec3-910e-49ba89267ecf/kube-storage-version-migrator-operator/0.log" Jul 22 21:01:19.864905 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:19.864868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:19.865326 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:19.864920 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:19.865326 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:19.864983 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 21:01:19.865326 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:19.865041 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm podName:a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:27.865026529 +0000 UTC m=+271.404534809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qzn68" (UID: "a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3") : configmap "kube-rbac-proxy" not found Jul 22 21:01:19.865326 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:19.865088 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 21:01:19.865326 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:19.865140 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls podName:a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:27.865127525 +0000 UTC m=+271.404635805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qzn68" (UID: "a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3") : secret "insights-runtime-extractor-tls" not found Jul 22 21:01:21.174672 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:21.174619 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:21.175157 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:21.174694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:21.175157 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:21.174732 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:21.175157 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:21.174767 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:21.175157 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:21.174853 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle podName:252c0d53-08ac-4f77-b716-489cc651023d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:37.174834115 +0000 UTC m=+280.714342402 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle") pod "router-default-5c69f9dccb-qd97j" (UID: "252c0d53-08ac-4f77-b716-489cc651023d") : configmap references non-existent config key: service-ca.crt Jul 22 21:01:21.175157 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:21.174874 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls podName:ea28784d-6539-4974-8542-ce1ce879d129 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:37.174864931 +0000 UTC m=+280.714373211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l6w64" (UID: "ea28784d-6539-4974-8542-ce1ce879d129") : secret "cluster-monitoring-operator-tls" not found Jul 22 21:01:21.177336 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:21.177313 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/252c0d53-08ac-4f77-b716-489cc651023d-metrics-certs\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:27.925076 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:27.925042 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:27.925469 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:27.925087 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:27.925599 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:27.925578 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:27.927399 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:27.927382 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzn68\" (UID: \"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3\") " pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:27.968830 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:27.968798 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qzn68" Jul 22 21:01:28.094315 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:28.094289 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qzn68"] Jul 22 21:01:28.096629 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:28.096600 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ce1ccb_0a34_4afe_9a53_6a7cd4d7ebd3.slice/crio-1cc907253211d148e83f17e8cfb06824a2277759e10b08db28c99c357a2145d5 WatchSource:0}: Error finding container 1cc907253211d148e83f17e8cfb06824a2277759e10b08db28c99c357a2145d5: Status 404 returned error can't find the container with id 1cc907253211d148e83f17e8cfb06824a2277759e10b08db28c99c357a2145d5 Jul 22 21:01:28.683283 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:28.683251 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qzn68" event={"ID":"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3","Type":"ContainerStarted","Data":"1cc907253211d148e83f17e8cfb06824a2277759e10b08db28c99c357a2145d5"} Jul 22 21:01:28.869130 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:28.868307 2557 scope.go:117] "RemoveContainer" containerID="6ee63ea258cfcf1cd863441e8fbb7f1c8aa18d311df305cc13033aafd1fd52ba" Jul 22 21:01:29.688228 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:29.688200 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:01:29.688708 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:29.688688 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/1.log" Jul 22 21:01:29.688788 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:29.688729 2557 generic.go:356] "Generic (PLEG): container finished" podID="beaa77f6-0828-48c3-953c-0bacf46c177b" containerID="1f6d20ab0424a4e6d84c275c730ab0c690280efa6b677f0cb2ec35a2c45cf490" exitCode=255 Jul 22 21:01:29.688788 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:29.688775 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" event={"ID":"beaa77f6-0828-48c3-953c-0bacf46c177b","Type":"ContainerDied","Data":"1f6d20ab0424a4e6d84c275c730ab0c690280efa6b677f0cb2ec35a2c45cf490"} Jul 22 21:01:29.688889 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:29.688822 2557 scope.go:117] "RemoveContainer" containerID="6ee63ea258cfcf1cd863441e8fbb7f1c8aa18d311df305cc13033aafd1fd52ba" Jul 22 21:01:29.689189 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:29.689152 2557 scope.go:117] "RemoveContainer" containerID="1f6d20ab0424a4e6d84c275c730ab0c690280efa6b677f0cb2ec35a2c45cf490" Jul 22 21:01:29.689356 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:29.689333 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-bvgwp_openshift-console-operator(beaa77f6-0828-48c3-953c-0bacf46c177b)\"" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" podUID="beaa77f6-0828-48c3-953c-0bacf46c177b" Jul 22 21:01:30.693858 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:30.693822 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:01:32.375563 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:32.375516 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zhcx7" podUID="ef1dd499-990b-49f1-adb6-9e68904d36ed" Jul 22 21:01:32.375563 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:32.375516 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" podUID="cf9fb21e-a5d4-4439-9b61-a2c2e749d129" Jul 22 21:01:32.700598 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:32.700514 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 21:01:32.700598 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:32.700527 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zhcx7" Jul 22 21:01:33.478340 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.478307 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54bf7db6b7-nr9fj"] Jul 22 21:01:33.478776 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:33.478547 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" podUID="cf9fb21e-a5d4-4439-9b61-a2c2e749d129" Jul 22 21:01:33.703459 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.703410 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 21:01:33.726202 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.726175 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 21:01:33.776324 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.776260 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-trusted-ca\") pod \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " Jul 22 21:01:33.776324 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.776298 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-ca-trust-extracted\") pod \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " Jul 22 21:01:33.776324 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.776319 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff5z2\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-kube-api-access-ff5z2\") pod \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " Jul 22 21:01:33.776586 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.776348 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-certificates\") pod \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " Jul 22 21:01:33.776586 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.776374 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-image-registry-private-configuration\") pod \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " Jul 22 21:01:33.776586 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.776407 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-bound-sa-token\") pod \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " Jul 22 21:01:33.776586 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.776474 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-installation-pull-secrets\") pod \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\" (UID: \"cf9fb21e-a5d4-4439-9b61-a2c2e749d129\") " Jul 22 21:01:33.776786 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.776607 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cf9fb21e-a5d4-4439-9b61-a2c2e749d129" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:01:33.776786 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.776719 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-ca-trust-extracted\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:01:33.776863 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.776781 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cf9fb21e-a5d4-4439-9b61-a2c2e749d129" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:01:33.776863 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.776824 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cf9fb21e-a5d4-4439-9b61-a2c2e749d129" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:01:33.778867 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.778839 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cf9fb21e-a5d4-4439-9b61-a2c2e749d129" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 21:01:33.778979 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.778898 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cf9fb21e-a5d4-4439-9b61-a2c2e749d129" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 21:01:33.778979 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.778932 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cf9fb21e-a5d4-4439-9b61-a2c2e749d129" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:01:33.779084 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.779006 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-kube-api-access-ff5z2" (OuterVolumeSpecName: "kube-api-access-ff5z2") pod "cf9fb21e-a5d4-4439-9b61-a2c2e749d129" (UID: "cf9fb21e-a5d4-4439-9b61-a2c2e749d129"). InnerVolumeSpecName "kube-api-access-ff5z2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:01:33.877911 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.877888 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-bound-sa-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:01:33.877911 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.877908 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-installation-pull-secrets\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:01:33.878042 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.877918 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-trusted-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:01:33.878042 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.877927 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff5z2\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-kube-api-access-ff5z2\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:01:33.878042 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.877937 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-certificates\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:01:33.878042 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:33.877946 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-image-registry-private-configuration\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:01:34.709412 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:34.709380 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bf7db6b7-nr9fj" Jul 22 21:01:34.709881 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:34.709504 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qzn68" event={"ID":"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3","Type":"ContainerStarted","Data":"da5b11cdc1e544dc4348f673aaeba1ff3067d12ac0dd93c16834ca455596da3b"} Jul 22 21:01:34.744896 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:34.744861 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54bf7db6b7-nr9fj"] Jul 22 21:01:34.746528 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:34.746504 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54bf7db6b7-nr9fj"] Jul 22 21:01:34.785311 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:34.785277 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf9fb21e-a5d4-4439-9b61-a2c2e749d129-registry-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:01:34.873351 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:34.873145 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf9fb21e-a5d4-4439-9b61-a2c2e749d129" path="/var/lib/kubelet/pods/cf9fb21e-a5d4-4439-9b61-a2c2e749d129/volumes" Jul 22 21:01:35.681611 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:35.681571 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:35.681802 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:35.681632 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:35.681981 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:35.681965 2557 scope.go:117] "RemoveContainer" containerID="1f6d20ab0424a4e6d84c275c730ab0c690280efa6b677f0cb2ec35a2c45cf490" Jul 22 21:01:35.682182 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:35.682158 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-bvgwp_openshift-console-operator(beaa77f6-0828-48c3-953c-0bacf46c177b)\"" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" podUID="beaa77f6-0828-48c3-953c-0bacf46c177b" Jul 22 21:01:35.995627 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:35.995534 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 21:01:35.998579 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:35.998538 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef1dd499-990b-49f1-adb6-9e68904d36ed-metrics-tls\") pod \"dns-default-zhcx7\" (UID: \"ef1dd499-990b-49f1-adb6-9e68904d36ed\") " pod="openshift-dns/dns-default-zhcx7" Jul 22 21:01:36.004036 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:36.004013 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6fmcx\"" Jul 22 21:01:36.012286 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:36.012260 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zhcx7" Jul 22 21:01:37.203419 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.203378 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:37.203924 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.203460 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:37.204156 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.204135 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c0d53-08ac-4f77-b716-489cc651023d-service-ca-bundle\") pod \"router-default-5c69f9dccb-qd97j\" (UID: \"252c0d53-08ac-4f77-b716-489cc651023d\") " pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:37.206088 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.206052 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea28784d-6539-4974-8542-ce1ce879d129-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l6w64\" (UID: \"ea28784d-6539-4974-8542-ce1ce879d129\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:37.355960 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.355929 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zhcx7"] Jul 22 21:01:37.362922 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:37.362894 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1dd499_990b_49f1_adb6_9e68904d36ed.slice/crio-5d4c2547494934b205fb128b16370074824582ce3a32631487de2f52e38b9032 WatchSource:0}: Error finding container 5d4c2547494934b205fb128b16370074824582ce3a32631487de2f52e38b9032: Status 404 returned error can't find the container with id 5d4c2547494934b205fb128b16370074824582ce3a32631487de2f52e38b9032 Jul 22 21:01:37.475680 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.475617 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" Jul 22 21:01:37.485686 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.485667 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:37.607916 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.607777 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64"] Jul 22 21:01:37.609872 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:37.609848 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea28784d_6539_4974_8542_ce1ce879d129.slice/crio-0d1a4edf86dd24f69d1984e3dc0106e0255a4cbb30c0d813dac9ced739dd6edf WatchSource:0}: Error finding container 0d1a4edf86dd24f69d1984e3dc0106e0255a4cbb30c0d813dac9ced739dd6edf: Status 404 returned error can't find the container with id 0d1a4edf86dd24f69d1984e3dc0106e0255a4cbb30c0d813dac9ced739dd6edf Jul 22 21:01:37.623048 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.623027 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c69f9dccb-qd97j"] Jul 22 21:01:37.625740 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:37.625720 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252c0d53_08ac_4f77_b716_489cc651023d.slice/crio-df5fc7a8b08031284f18ed9cfe993d71b79d6f265776e049f0cbd9e4a87a4e0e WatchSource:0}: Error finding container df5fc7a8b08031284f18ed9cfe993d71b79d6f265776e049f0cbd9e4a87a4e0e: Status 404 returned error can't find the container with id df5fc7a8b08031284f18ed9cfe993d71b79d6f265776e049f0cbd9e4a87a4e0e Jul 22 21:01:37.720014 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.719978 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" event={"ID":"ea28784d-6539-4974-8542-ce1ce879d129","Type":"ContainerStarted","Data":"0d1a4edf86dd24f69d1984e3dc0106e0255a4cbb30c0d813dac9ced739dd6edf"} Jul 22 21:01:37.721137 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.721116 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zhcx7" event={"ID":"ef1dd499-990b-49f1-adb6-9e68904d36ed","Type":"ContainerStarted","Data":"5d4c2547494934b205fb128b16370074824582ce3a32631487de2f52e38b9032"} Jul 22 21:01:37.722859 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.722840 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qzn68" event={"ID":"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3","Type":"ContainerStarted","Data":"6229d8d6aaae29ea4eca9ffdb3056a23e44a729c5cd5cc883ce171142bc91631"} Jul 22 21:01:37.724149 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.724124 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c69f9dccb-qd97j" event={"ID":"252c0d53-08ac-4f77-b716-489cc651023d","Type":"ContainerStarted","Data":"fcc03c8daed86f40da5ee6495507a88740e565936eefe92359184f16ee8b0b30"} Jul 22 21:01:37.724197 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.724163 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c69f9dccb-qd97j" event={"ID":"252c0d53-08ac-4f77-b716-489cc651023d","Type":"ContainerStarted","Data":"df5fc7a8b08031284f18ed9cfe993d71b79d6f265776e049f0cbd9e4a87a4e0e"} Jul 22 21:01:37.742215 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:37.742141 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5c69f9dccb-qd97j" podStartSLOduration=32.742128191 podStartE2EDuration="32.742128191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:37.741059859 +0000 UTC m=+281.280568161" watchObservedRunningTime="2026-07-22 21:01:37.742128191 +0000 UTC m=+281.281636493" Jul 22 21:01:38.486408 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:38.486374 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:38.489482 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:38.489454 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:38.727734 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:38.727700 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:38.729015 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:38.728992 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c69f9dccb-qd97j" Jul 22 21:01:40.503010 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.502975 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml"] Jul 22 21:01:40.506222 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.506192 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml" Jul 22 21:01:40.508900 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.508659 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 22 21:01:40.508900 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.508658 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2dc7r\"" Jul 22 21:01:40.514142 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.514110 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml"] Jul 22 21:01:40.534184 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.534155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/16085d6b-cade-4b0b-894e-b2663dac12d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-fm9ml\" (UID: \"16085d6b-cade-4b0b-894e-b2663dac12d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml" Jul 22 21:01:40.635538 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.635502 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/16085d6b-cade-4b0b-894e-b2663dac12d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-fm9ml\" (UID: \"16085d6b-cade-4b0b-894e-b2663dac12d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml" Jul 22 21:01:40.635705 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:40.635678 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 22 21:01:40.635830 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:40.635760 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16085d6b-cade-4b0b-894e-b2663dac12d2-tls-certificates podName:16085d6b-cade-4b0b-894e-b2663dac12d2 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:41.135739806 +0000 UTC m=+284.675248088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/16085d6b-cade-4b0b-894e-b2663dac12d2-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-fm9ml" (UID: "16085d6b-cade-4b0b-894e-b2663dac12d2") : secret "prometheus-operator-admission-webhook-tls" not found Jul 22 21:01:40.736887 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.736759 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" event={"ID":"ea28784d-6539-4974-8542-ce1ce879d129","Type":"ContainerStarted","Data":"23675cb968a8701a91fe2374575e43ce35e65dcb51e7d2dc27e09485aad13dc3"} Jul 22 21:01:40.739319 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.739296 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zhcx7" event={"ID":"ef1dd499-990b-49f1-adb6-9e68904d36ed","Type":"ContainerStarted","Data":"200137cd9efa4561b54404c47f3c999b58946cb8ca48e41b85588965094338c9"} Jul 22 21:01:40.739485 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.739335 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zhcx7" event={"ID":"ef1dd499-990b-49f1-adb6-9e68904d36ed","Type":"ContainerStarted","Data":"bd4f788adf134a028211dd2a58233254026371af4ae73e48ba814065e79aacd3"} Jul 22 21:01:40.739485 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.739383 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zhcx7" Jul 22 21:01:40.752311 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.752270 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l6w64" podStartSLOduration=33.38540445 podStartE2EDuration="35.752252867s" totalImagesPullingTime="2.366848417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:40.751470869 +0000 UTC m=+284.290979172" watchObservedRunningTime="2026-07-22 21:01:40.752252867 +0000 UTC m=+284.291761169" Jul 22 21:01:40.767822 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:40.767740 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zhcx7" podStartSLOduration=253.157192107 podStartE2EDuration="4m15.76772311s" totalImagesPullingTime="2.610531003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:40.766926769 +0000 UTC m=+284.306435073" watchObservedRunningTime="2026-07-22 21:01:40.76772311 +0000 UTC m=+284.307231413" Jul 22 21:01:41.140346 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:41.140305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/16085d6b-cade-4b0b-894e-b2663dac12d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-fm9ml\" (UID: \"16085d6b-cade-4b0b-894e-b2663dac12d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml" Jul 22 21:01:41.143272 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:41.143239 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/16085d6b-cade-4b0b-894e-b2663dac12d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-fm9ml\" (UID: \"16085d6b-cade-4b0b-894e-b2663dac12d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml" Jul 22 21:01:41.417777 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:41.417692 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml" Jul 22 21:01:41.559369 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:41.559338 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml"] Jul 22 21:01:41.562015 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:41.561986 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16085d6b_cade_4b0b_894e_b2663dac12d2.slice/crio-faff03106c64926ab5698e23a39a5e6a261e3bc044f313b0e403e3d176297196 WatchSource:0}: Error finding container faff03106c64926ab5698e23a39a5e6a261e3bc044f313b0e403e3d176297196: Status 404 returned error can't find the container with id faff03106c64926ab5698e23a39a5e6a261e3bc044f313b0e403e3d176297196 Jul 22 21:01:41.744750 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:41.744658 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml" event={"ID":"16085d6b-cade-4b0b-894e-b2663dac12d2","Type":"ContainerStarted","Data":"faff03106c64926ab5698e23a39a5e6a261e3bc044f313b0e403e3d176297196"} Jul 22 21:01:43.754736 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:43.754701 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qzn68" event={"ID":"a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3","Type":"ContainerStarted","Data":"ebb9c6144905c66e0851414ecfd4b81aa33932eef3128da8dd96595355626f34"} Jul 22 21:01:43.775628 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:43.775574 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qzn68" podStartSLOduration=16.676738873 podStartE2EDuration="31.775552078s" totalImagesPullingTime="15.098813205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:01:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:43.774187189 +0000 UTC m=+287.313695493" watchObservedRunningTime="2026-07-22 21:01:43.775552078 +0000 UTC m=+287.315060381" Jul 22 21:01:44.760138 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:44.760099 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml" event={"ID":"16085d6b-cade-4b0b-894e-b2663dac12d2","Type":"ContainerStarted","Data":"56ba55037185247c7501d8d0a989141f98a7c5cdfce16441a924982dc66d6a5e"} Jul 22 21:01:44.760594 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:44.760379 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml" Jul 22 21:01:44.765014 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:44.764991 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml" Jul 22 21:01:44.775821 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:44.775780 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fm9ml" podStartSLOduration=2.387616254 podStartE2EDuration="4.775768241s" totalImagesPullingTime="2.388151987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:44.774845269 +0000 UTC m=+288.314353571" watchObservedRunningTime="2026-07-22 21:01:44.775768241 +0000 UTC m=+288.315276543" Jul 22 21:01:44.868977 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:44.868927 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5s2tf" podUID="3b98e5db-0164-4705-8954-50b7dcb3cc39" Jul 22 21:01:45.587560 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.587531 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp"] Jul 22 21:01:45.590614 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.590599 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:45.593696 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.593676 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 22 21:01:45.594618 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.594601 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 21:01:45.594694 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.594604 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 22 21:01:45.594694 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.594604 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vqnbp\"" Jul 22 21:01:45.604565 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.604542 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp"] Jul 22 21:01:45.675272 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.675246 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d398a525-7df4-4296-bc1b-f06acab23842-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:45.675395 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.675278 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d398a525-7df4-4296-bc1b-f06acab23842-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:45.675395 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.675310 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d398a525-7df4-4296-bc1b-f06acab23842-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:45.675395 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.675330 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kkk8\" (UniqueName: \"kubernetes.io/projected/d398a525-7df4-4296-bc1b-f06acab23842-kube-api-access-8kkk8\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:45.776536 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.776512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kkk8\" (UniqueName: \"kubernetes.io/projected/d398a525-7df4-4296-bc1b-f06acab23842-kube-api-access-8kkk8\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:45.776922 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.776561 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d398a525-7df4-4296-bc1b-f06acab23842-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:45.776922 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.776580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d398a525-7df4-4296-bc1b-f06acab23842-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:45.776922 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.776620 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d398a525-7df4-4296-bc1b-f06acab23842-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:45.776922 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:45.776702 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 22 21:01:45.776922 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:45.776776 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d398a525-7df4-4296-bc1b-f06acab23842-prometheus-operator-tls podName:d398a525-7df4-4296-bc1b-f06acab23842 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:46.276755496 +0000 UTC m=+289.816263796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d398a525-7df4-4296-bc1b-f06acab23842-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-dlsxp" (UID: "d398a525-7df4-4296-bc1b-f06acab23842") : secret "prometheus-operator-tls" not found Jul 22 21:01:45.777290 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.777274 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d398a525-7df4-4296-bc1b-f06acab23842-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:45.779012 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.778996 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d398a525-7df4-4296-bc1b-f06acab23842-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:45.788642 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:45.788621 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kkk8\" (UniqueName: \"kubernetes.io/projected/d398a525-7df4-4296-bc1b-f06acab23842-kube-api-access-8kkk8\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:46.279634 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:46.279599 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d398a525-7df4-4296-bc1b-f06acab23842-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:46.282085 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:46.282064 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d398a525-7df4-4296-bc1b-f06acab23842-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-dlsxp\" (UID: \"d398a525-7df4-4296-bc1b-f06acab23842\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:46.505533 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:46.505501 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" Jul 22 21:01:46.629036 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:46.629012 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp"] Jul 22 21:01:46.631370 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:46.631348 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd398a525_7df4_4296_bc1b_f06acab23842.slice/crio-fa1f31a06e82a2c20862dbca829a120d6e71b72cbcf939a4d517ac4fb6dd3686 WatchSource:0}: Error finding container fa1f31a06e82a2c20862dbca829a120d6e71b72cbcf939a4d517ac4fb6dd3686: Status 404 returned error can't find the container with id fa1f31a06e82a2c20862dbca829a120d6e71b72cbcf939a4d517ac4fb6dd3686 Jul 22 21:01:46.769572 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:46.769534 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" event={"ID":"d398a525-7df4-4296-bc1b-f06acab23842","Type":"ContainerStarted","Data":"fa1f31a06e82a2c20862dbca829a120d6e71b72cbcf939a4d517ac4fb6dd3686"} Jul 22 21:01:49.867934 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:49.867905 2557 scope.go:117] "RemoveContainer" containerID="1f6d20ab0424a4e6d84c275c730ab0c690280efa6b677f0cb2ec35a2c45cf490" Jul 22 21:01:50.746939 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:50.746775 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zhcx7" Jul 22 21:01:50.786717 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:50.786681 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" event={"ID":"d398a525-7df4-4296-bc1b-f06acab23842","Type":"ContainerStarted","Data":"ddd08f93f15f1617288d83c1e9bc616c988e9fb655814c5021c26f9e17912f8c"} Jul 22 21:01:50.788942 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:50.788910 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:01:50.789062 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:50.789014 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" event={"ID":"beaa77f6-0828-48c3-953c-0bacf46c177b","Type":"ContainerStarted","Data":"4cd77a4e291a0d4661d06d67202542e20f6338ca62cd4e618e7a58402c37f415"} Jul 22 21:01:50.791901 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:50.791867 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:50.810278 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:50.810229 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" podStartSLOduration=43.256936257 podStartE2EDuration="45.810209026s" totalImagesPullingTime="2.553272769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:50.809885956 +0000 UTC m=+294.349394258" watchObservedRunningTime="2026-07-22 21:01:50.810209026 +0000 UTC m=+294.349717328" Jul 22 21:01:50.864215 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:50.863876 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-bvgwp" Jul 22 21:01:51.045669 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.045591 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-j688d"] Jul 22 21:01:51.049788 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.049762 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-j688d" Jul 22 21:01:51.053715 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.053689 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 21:01:51.054027 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.054009 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 21:01:51.054373 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.054353 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-77txs\"" Jul 22 21:01:51.059562 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.059541 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-j688d"] Jul 22 21:01:51.116336 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.116306 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mbwg\" (UniqueName: \"kubernetes.io/projected/dc5f4ccd-270a-485b-a7bf-4d3d022da1ea-kube-api-access-6mbwg\") pod \"downloads-5bc67dcd46-j688d\" (UID: \"dc5f4ccd-270a-485b-a7bf-4d3d022da1ea\") " pod="openshift-console/downloads-5bc67dcd46-j688d" Jul 22 21:01:51.217016 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.216986 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mbwg\" (UniqueName: \"kubernetes.io/projected/dc5f4ccd-270a-485b-a7bf-4d3d022da1ea-kube-api-access-6mbwg\") pod \"downloads-5bc67dcd46-j688d\" (UID: \"dc5f4ccd-270a-485b-a7bf-4d3d022da1ea\") " pod="openshift-console/downloads-5bc67dcd46-j688d" Jul 22 21:01:51.226275 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.226240 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mbwg\" (UniqueName: \"kubernetes.io/projected/dc5f4ccd-270a-485b-a7bf-4d3d022da1ea-kube-api-access-6mbwg\") pod \"downloads-5bc67dcd46-j688d\" (UID: \"dc5f4ccd-270a-485b-a7bf-4d3d022da1ea\") " pod="openshift-console/downloads-5bc67dcd46-j688d" Jul 22 21:01:51.362108 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.362077 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-j688d" Jul 22 21:01:51.489916 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.489887 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-j688d"] Jul 22 21:01:51.494343 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:51.494311 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5f4ccd_270a_485b_a7bf_4d3d022da1ea.slice/crio-9bec753abe09b043953f39d2c0686c126e5503c687734846970ab2a1ae1a18c6 WatchSource:0}: Error finding container 9bec753abe09b043953f39d2c0686c126e5503c687734846970ab2a1ae1a18c6: Status 404 returned error can't find the container with id 9bec753abe09b043953f39d2c0686c126e5503c687734846970ab2a1ae1a18c6 Jul 22 21:01:51.794056 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.793956 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" event={"ID":"d398a525-7df4-4296-bc1b-f06acab23842","Type":"ContainerStarted","Data":"7c2f54a8346d7e8bad575a6bc7d79ef2bf9b78499fef872e2577316f790c553a"} Jul 22 21:01:51.795182 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.795159 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-j688d" event={"ID":"dc5f4ccd-270a-485b-a7bf-4d3d022da1ea","Type":"ContainerStarted","Data":"9bec753abe09b043953f39d2c0686c126e5503c687734846970ab2a1ae1a18c6"} Jul 22 21:01:51.815732 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:51.815691 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dlsxp" podStartSLOduration=2.73972266 podStartE2EDuration="6.815677386s" totalImagesPullingTime="4.075954726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:51.814700274 +0000 UTC m=+295.354208576" watchObservedRunningTime="2026-07-22 21:01:51.815677386 +0000 UTC m=+295.355185686" Jul 22 21:01:53.923391 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.923205 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97"] Jul 22 21:01:53.928726 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.928703 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:53.932205 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.931963 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 22 21:01:53.932205 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.932074 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-75bzv\"" Jul 22 21:01:53.932205 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.931966 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 22 21:01:53.939282 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.937954 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97"] Jul 22 21:01:53.948970 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.948930 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-crvhz"] Jul 22 21:01:53.953267 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.952512 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:53.956005 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.955129 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-snlqk\"" Jul 22 21:01:53.956005 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.955622 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 22 21:01:53.956005 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.955696 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 22 21:01:53.956005 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.955833 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 22 21:01:53.963169 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.963151 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-52plc"] Jul 22 21:01:53.967045 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.967028 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:53.970953 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.970510 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 21:01:53.971838 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.971794 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-crvhz"] Jul 22 21:01:53.971958 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.971943 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8pdzx\"" Jul 22 21:01:53.972307 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.972286 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 21:01:53.976537 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:53.974314 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 21:01:54.039531 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039502 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpdk7\" (UniqueName: \"kubernetes.io/projected/86d14b48-1706-4ed9-9c5a-c97f6132e702-kube-api-access-fpdk7\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.039664 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039541 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-textfile\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.039664 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039571 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86d14b48-1706-4ed9-9c5a-c97f6132e702-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.039664 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039611 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg5rb\" (UniqueName: \"kubernetes.io/projected/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-api-access-rg5rb\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.039664 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039638 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/011ce416-92a1-46ff-b0fc-649a7e72921d-metrics-client-ca\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.039857 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039663 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-accelerators-collector-config\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.039857 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039699 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5616ac0e-f5c3-48fa-9afb-694747dc26f9-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.039857 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/011ce416-92a1-46ff-b0fc-649a7e72921d-root\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.039857 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039751 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5616ac0e-f5c3-48fa-9afb-694747dc26f9-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.039857 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039779 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/86d14b48-1706-4ed9-9c5a-c97f6132e702-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.039857 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039804 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bbd6\" (UniqueName: \"kubernetes.io/projected/011ce416-92a1-46ff-b0fc-649a7e72921d-kube-api-access-9bbd6\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.039857 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039832 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86d14b48-1706-4ed9-9c5a-c97f6132e702-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.040193 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039859 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-wtmp\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.040193 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039882 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.040193 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039917 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-tls\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.040193 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.039946 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/011ce416-92a1-46ff-b0fc-649a7e72921d-sys\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.040193 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.040148 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.040193 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.040190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.040522 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.040224 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.141975 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.141497 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/011ce416-92a1-46ff-b0fc-649a7e72921d-sys\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.141975 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.141810 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.141975 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.141868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.141975 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.141898 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/011ce416-92a1-46ff-b0fc-649a7e72921d-sys\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.141975 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.141906 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.141975 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.141968 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpdk7\" (UniqueName: \"kubernetes.io/projected/86d14b48-1706-4ed9-9c5a-c97f6132e702-kube-api-access-fpdk7\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.141997 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-textfile\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142066 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86d14b48-1706-4ed9-9c5a-c97f6132e702-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142092 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg5rb\" (UniqueName: \"kubernetes.io/projected/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-api-access-rg5rb\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142137 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/011ce416-92a1-46ff-b0fc-649a7e72921d-metrics-client-ca\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142166 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-accelerators-collector-config\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142224 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5616ac0e-f5c3-48fa-9afb-694747dc26f9-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142252 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/011ce416-92a1-46ff-b0fc-649a7e72921d-root\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142299 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5616ac0e-f5c3-48fa-9afb-694747dc26f9-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142333 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/86d14b48-1706-4ed9-9c5a-c97f6132e702-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142379 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbd6\" (UniqueName: \"kubernetes.io/projected/011ce416-92a1-46ff-b0fc-649a7e72921d-kube-api-access-9bbd6\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86d14b48-1706-4ed9-9c5a-c97f6132e702-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142491 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-wtmp\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.142583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142534 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.143173 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-tls\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.143173 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.142684 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.143173 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:54.142789 2557 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 22 21:01:54.143173 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:54.142803 2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 21:01:54.143173 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:54.142844 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-tls podName:5616ac0e-f5c3-48fa-9afb-694747dc26f9 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:54.642826094 +0000 UTC m=+298.182334391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-crvhz" (UID: "5616ac0e-f5c3-48fa-9afb-694747dc26f9") : secret "kube-state-metrics-tls" not found Jul 22 21:01:54.143173 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:54.142861 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-tls podName:011ce416-92a1-46ff-b0fc-649a7e72921d nodeName:}" failed. No retries permitted until 2026-07-22 21:01:54.642852387 +0000 UTC m=+298.182360672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-tls") pod "node-exporter-52plc" (UID: "011ce416-92a1-46ff-b0fc-649a7e72921d") : secret "node-exporter-tls" not found Jul 22 21:01:54.143173 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.143099 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/011ce416-92a1-46ff-b0fc-649a7e72921d-root\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.143540 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.143375 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-textfile\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.145294 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.144025 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86d14b48-1706-4ed9-9c5a-c97f6132e702-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.145294 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.144105 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5616ac0e-f5c3-48fa-9afb-694747dc26f9-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.145294 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:54.144212 2557 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 22 21:01:54.145294 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:54.144274 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d14b48-1706-4ed9-9c5a-c97f6132e702-openshift-state-metrics-tls podName:86d14b48-1706-4ed9-9c5a-c97f6132e702 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:54.644256734 +0000 UTC m=+298.183765029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/86d14b48-1706-4ed9-9c5a-c97f6132e702-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-bwb97" (UID: "86d14b48-1706-4ed9-9c5a-c97f6132e702") : secret "openshift-state-metrics-tls" not found Jul 22 21:01:54.145294 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.144804 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/011ce416-92a1-46ff-b0fc-649a7e72921d-metrics-client-ca\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.145294 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.144933 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-accelerators-collector-config\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.145294 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.145071 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-wtmp\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.151452 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.146639 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5616ac0e-f5c3-48fa-9afb-694747dc26f9-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.151452 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.147088 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.159116 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.159088 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86d14b48-1706-4ed9-9c5a-c97f6132e702-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.163564 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.162952 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpdk7\" (UniqueName: \"kubernetes.io/projected/86d14b48-1706-4ed9-9c5a-c97f6132e702-kube-api-access-fpdk7\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.165537 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.165462 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bbd6\" (UniqueName: \"kubernetes.io/projected/011ce416-92a1-46ff-b0fc-649a7e72921d-kube-api-access-9bbd6\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.169311 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.169178 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg5rb\" (UniqueName: \"kubernetes.io/projected/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-api-access-rg5rb\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.170894 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.170838 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.647039 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.647000 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:54.647222 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.647101 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/86d14b48-1706-4ed9-9c5a-c97f6132e702-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.647222 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.647146 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-tls\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.647222 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:54.647167 2557 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 22 21:01:54.647397 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:54.647241 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-tls podName:5616ac0e-f5c3-48fa-9afb-694747dc26f9 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:55.647219755 +0000 UTC m=+299.186728055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-crvhz" (UID: "5616ac0e-f5c3-48fa-9afb-694747dc26f9") : secret "kube-state-metrics-tls" not found Jul 22 21:01:54.650489 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.650359 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/011ce416-92a1-46ff-b0fc-649a7e72921d-node-exporter-tls\") pod \"node-exporter-52plc\" (UID: \"011ce416-92a1-46ff-b0fc-649a7e72921d\") " pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:54.650489 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.650454 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/86d14b48-1706-4ed9-9c5a-c97f6132e702-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bwb97\" (UID: \"86d14b48-1706-4ed9-9c5a-c97f6132e702\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.843451 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.843410 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" Jul 22 21:01:54.880374 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:54.880303 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-52plc" Jul 22 21:01:55.051693 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:55.051392 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97"] Jul 22 21:01:55.054547 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:55.054505 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d14b48_1706_4ed9_9c5a_c97f6132e702.slice/crio-fc988d66dea99ed1117cee09d5d7f6850b2fb93f23aef8c460bcee6020fbd9ea WatchSource:0}: Error finding container fc988d66dea99ed1117cee09d5d7f6850b2fb93f23aef8c460bcee6020fbd9ea: Status 404 returned error can't find the container with id fc988d66dea99ed1117cee09d5d7f6850b2fb93f23aef8c460bcee6020fbd9ea Jul 22 21:01:55.656962 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:55.656925 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:55.660211 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:55.660179 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5616ac0e-f5c3-48fa-9afb-694747dc26f9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-crvhz\" (UID: \"5616ac0e-f5c3-48fa-9afb-694747dc26f9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:55.764754 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:55.764502 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" Jul 22 21:01:55.814142 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:55.814103 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" event={"ID":"86d14b48-1706-4ed9-9c5a-c97f6132e702","Type":"ContainerStarted","Data":"a0bed03067e69f5b21b60b2791504a2ee95da7845a36698ba5a9333e574695c2"} Jul 22 21:01:55.814264 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:55.814176 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" event={"ID":"86d14b48-1706-4ed9-9c5a-c97f6132e702","Type":"ContainerStarted","Data":"64c7b2893e564050e200f56e7a1f9f2f4ef1cd98b052a0cff8730793bc0f08c2"} Jul 22 21:01:55.814264 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:55.814206 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" event={"ID":"86d14b48-1706-4ed9-9c5a-c97f6132e702","Type":"ContainerStarted","Data":"fc988d66dea99ed1117cee09d5d7f6850b2fb93f23aef8c460bcee6020fbd9ea"} Jul 22 21:01:55.815783 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:55.815709 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52plc" event={"ID":"011ce416-92a1-46ff-b0fc-649a7e72921d","Type":"ContainerStarted","Data":"7931eb4a49cb5c8b42587964b3d02e01c06ba89f6c8754e4a72e098824429867"} Jul 22 21:01:56.023283 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.023187 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-crvhz"] Jul 22 21:01:56.026398 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:56.026370 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5616ac0e_f5c3_48fa_9afb_694747dc26f9.slice/crio-49b2926f5250b6b5cf0794587e9055f227b2ea07c0f74593d2913b84504f3730 WatchSource:0}: Error finding container 49b2926f5250b6b5cf0794587e9055f227b2ea07c0f74593d2913b84504f3730: Status 404 returned error can't find the container with id 49b2926f5250b6b5cf0794587e9055f227b2ea07c0f74593d2913b84504f3730 Jul 22 21:01:56.765009 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.764982 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:01:56.766452 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.766412 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:01:56.771956 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.771875 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:01:56.773893 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.773587 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:01:56.785644 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.785623 2557 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 21:01:56.820532 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.820498 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" event={"ID":"5616ac0e-f5c3-48fa-9afb-694747dc26f9","Type":"ContainerStarted","Data":"49b2926f5250b6b5cf0794587e9055f227b2ea07c0f74593d2913b84504f3730"} Jul 22 21:01:56.822994 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.822962 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" event={"ID":"86d14b48-1706-4ed9-9c5a-c97f6132e702","Type":"ContainerStarted","Data":"6723fd32b81784df71387635a8321bd779ec6f7c517c89f1bda63d844aae50fb"} Jul 22 21:01:56.824928 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.824902 2557 generic.go:356] "Generic (PLEG): container finished" podID="011ce416-92a1-46ff-b0fc-649a7e72921d" containerID="3153711e6456bf875df921efbac5db3339b56ba78fa479a7ab82e94e91bcd17a" exitCode=0 Jul 22 21:01:56.825030 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.824940 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52plc" event={"ID":"011ce416-92a1-46ff-b0fc-649a7e72921d","Type":"ContainerDied","Data":"3153711e6456bf875df921efbac5db3339b56ba78fa479a7ab82e94e91bcd17a"} Jul 22 21:01:56.848505 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.848453 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwb97" podStartSLOduration=2.391464561 podStartE2EDuration="3.848405252s" totalImagesPullingTime="1.456940691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:56.847241949 +0000 UTC m=+300.386750252" watchObservedRunningTime="2026-07-22 21:01:56.848405252 +0000 UTC m=+300.387913557" Jul 22 21:01:56.947487 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.946823 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5699cfc5fc-4whsb"] Jul 22 21:01:56.952792 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.952769 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:56.955975 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.955951 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 22 21:01:56.956169 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.956151 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 22 21:01:56.956366 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.956349 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 22 21:01:56.956909 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.956594 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hz2cx\"" Jul 22 21:01:56.956909 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.956785 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bi0qtsqfhnj6n\"" Jul 22 21:01:56.957088 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.956970 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 22 21:01:56.957088 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.957024 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 22 21:01:56.971483 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.969839 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:56.971483 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.969875 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:56.971483 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.969903 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-tls\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:56.971483 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.969954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:56.971483 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.970000 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:56.971483 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.970031 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-grpc-tls\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:56.971483 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.970075 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-metrics-client-ca\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:56.971483 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.970129 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh7t2\" (UniqueName: \"kubernetes.io/projected/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-kube-api-access-zh7t2\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:56.978154 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:56.978124 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5699cfc5fc-4whsb"] Jul 22 21:01:57.070877 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.070839 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-tls\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.071027 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.070908 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.071027 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.070950 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.071027 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.070979 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-grpc-tls\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.071027 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.071019 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-metrics-client-ca\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.071234 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.071062 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh7t2\" (UniqueName: \"kubernetes.io/projected/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-kube-api-access-zh7t2\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.071234 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.071105 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.071234 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.071130 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.072174 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.071856 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-metrics-client-ca\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.074000 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.073976 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-tls\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.076724 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.076681 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-grpc-tls\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.076825 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.076723 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.077042 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.076981 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.077459 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.077393 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.077861 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.077841 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.080857 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.080833 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh7t2\" (UniqueName: \"kubernetes.io/projected/2fa21246-d00c-4d9c-8b46-80f9b9bb5562-kube-api-access-zh7t2\") pod \"thanos-querier-5699cfc5fc-4whsb\" (UID: \"2fa21246-d00c-4d9c-8b46-80f9b9bb5562\") " pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.285250 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.285120 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:01:57.452594 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.452555 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5699cfc5fc-4whsb"] Jul 22 21:01:57.792515 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:57.792418 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa21246_d00c_4d9c_8b46_80f9b9bb5562.slice/crio-c1ffa9e9b9013e2bb23efa4291fac6fb22f87f77e83c8407bfe6bc4dd67a8f7b WatchSource:0}: Error finding container c1ffa9e9b9013e2bb23efa4291fac6fb22f87f77e83c8407bfe6bc4dd67a8f7b: Status 404 returned error can't find the container with id c1ffa9e9b9013e2bb23efa4291fac6fb22f87f77e83c8407bfe6bc4dd67a8f7b Jul 22 21:01:57.830781 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.830749 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" event={"ID":"2fa21246-d00c-4d9c-8b46-80f9b9bb5562","Type":"ContainerStarted","Data":"c1ffa9e9b9013e2bb23efa4291fac6fb22f87f77e83c8407bfe6bc4dd67a8f7b"} Jul 22 21:01:57.833573 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.833544 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52plc" event={"ID":"011ce416-92a1-46ff-b0fc-649a7e72921d","Type":"ContainerStarted","Data":"789b696945915672d05584db23d67a737fc831eb8306a2f96cf80dc38d5dea44"} Jul 22 21:01:57.833690 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.833598 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52plc" event={"ID":"011ce416-92a1-46ff-b0fc-649a7e72921d","Type":"ContainerStarted","Data":"235aeff2657f7d01a6deb376e51a67cdc827b85f48f49de29b6d1ee16d86b0ad"} Jul 22 21:01:57.854218 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:57.854170 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-52plc" podStartSLOduration=3.7392787419999998 podStartE2EDuration="4.854155868s" totalImagesPullingTime="1.032645497s" totalInitContainerRuntime="82.231629ms" isStatefulPod=true podCreationTimestamp="2026-07-22 21:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:57.853473595 +0000 UTC m=+301.392981910" watchObservedRunningTime="2026-07-22 21:01:57.854155868 +0000 UTC m=+301.393664221" Jul 22 21:01:58.334324 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.334211 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-598987cddf-nw7s4"] Jul 22 21:01:58.337836 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.337810 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.344879 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.344855 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 22 21:01:58.345162 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.345050 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dvfv2603h0udt\"" Jul 22 21:01:58.346106 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.346081 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 22 21:01:58.346386 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.346242 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 22 21:01:58.346386 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.346299 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jxnqs\"" Jul 22 21:01:58.346589 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.346513 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 22 21:01:58.353421 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.353360 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-598987cddf-nw7s4"] Jul 22 21:01:58.384675 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.384636 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9330859d-8dfb-42da-aa88-8542d8662222-secret-metrics-server-tls\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.384862 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.384704 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9330859d-8dfb-42da-aa88-8542d8662222-audit-log\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.384862 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.384743 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9330859d-8dfb-42da-aa88-8542d8662222-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.384862 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.384765 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9330859d-8dfb-42da-aa88-8542d8662222-client-ca-bundle\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.384862 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.384842 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9330859d-8dfb-42da-aa88-8542d8662222-metrics-server-audit-profiles\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.385121 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.384919 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9330859d-8dfb-42da-aa88-8542d8662222-secret-metrics-server-client-certs\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.385121 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.384973 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw8bk\" (UniqueName: \"kubernetes.io/projected/9330859d-8dfb-42da-aa88-8542d8662222-kube-api-access-rw8bk\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.485717 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.485679 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9330859d-8dfb-42da-aa88-8542d8662222-audit-log\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.485897 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.485736 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9330859d-8dfb-42da-aa88-8542d8662222-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.485897 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.485774 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9330859d-8dfb-42da-aa88-8542d8662222-client-ca-bundle\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.485897 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.485828 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9330859d-8dfb-42da-aa88-8542d8662222-metrics-server-audit-profiles\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.485897 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.485864 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9330859d-8dfb-42da-aa88-8542d8662222-secret-metrics-server-client-certs\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.486105 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.485923 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw8bk\" (UniqueName: \"kubernetes.io/projected/9330859d-8dfb-42da-aa88-8542d8662222-kube-api-access-rw8bk\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.486105 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.485975 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9330859d-8dfb-42da-aa88-8542d8662222-secret-metrics-server-tls\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.486187 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.486145 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9330859d-8dfb-42da-aa88-8542d8662222-audit-log\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.486850 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.486821 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9330859d-8dfb-42da-aa88-8542d8662222-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.487523 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.487499 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9330859d-8dfb-42da-aa88-8542d8662222-metrics-server-audit-profiles\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.489389 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.489340 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9330859d-8dfb-42da-aa88-8542d8662222-secret-metrics-server-tls\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.489653 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.489633 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9330859d-8dfb-42da-aa88-8542d8662222-secret-metrics-server-client-certs\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.489959 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.489939 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9330859d-8dfb-42da-aa88-8542d8662222-client-ca-bundle\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.494382 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.494357 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw8bk\" (UniqueName: \"kubernetes.io/projected/9330859d-8dfb-42da-aa88-8542d8662222-kube-api-access-rw8bk\") pod \"metrics-server-598987cddf-nw7s4\" (UID: \"9330859d-8dfb-42da-aa88-8542d8662222\") " pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.651453 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.651147 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:01:58.706174 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.706140 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2"] Jul 22 21:01:58.710784 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.710759 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:01:58.714893 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.714111 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 22 21:01:58.714893 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.714259 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8pzpd\"" Jul 22 21:01:58.725869 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.725824 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2"] Jul 22 21:01:58.789383 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.789151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dca96186-f5ee-435b-9a7d-734214916869-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vl7p2\" (UID: \"dca96186-f5ee-435b-9a7d-734214916869\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:01:58.789383 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.789226 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p24gq\" (UniqueName: \"kubernetes.io/projected/dca96186-f5ee-435b-9a7d-734214916869-kube-api-access-p24gq\") pod \"monitoring-plugin-7b7b7bc8bf-vl7p2\" (UID: \"dca96186-f5ee-435b-9a7d-734214916869\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:01:58.838388 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.838303 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-598987cddf-nw7s4"] Jul 22 21:01:58.842424 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.842298 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" event={"ID":"5616ac0e-f5c3-48fa-9afb-694747dc26f9","Type":"ContainerStarted","Data":"3ea4c10e9be1df8d9cc5cbbd367f0150fc33350317bee856b4f5411a2b5afc9c"} Jul 22 21:01:58.842424 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.842368 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" event={"ID":"5616ac0e-f5c3-48fa-9afb-694747dc26f9","Type":"ContainerStarted","Data":"a3bd6ade68930523792c6645e2aadaf81f7ea6f0b86611e43bb8cd6aceb990a6"} Jul 22 21:01:58.842424 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.842391 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" event={"ID":"5616ac0e-f5c3-48fa-9afb-694747dc26f9","Type":"ContainerStarted","Data":"300ff746fdd3d76e190d24eb1c3f57718d8e3e4848c4a1f3590a3e2e4b603767"} Jul 22 21:01:58.847836 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:01:58.847811 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9330859d_8dfb_42da_aa88_8542d8662222.slice/crio-cbfdda5aa606bbeaa5280d0044339a9d9f57163c3b1b89cd4b9fa88258453fdd WatchSource:0}: Error finding container cbfdda5aa606bbeaa5280d0044339a9d9f57163c3b1b89cd4b9fa88258453fdd: Status 404 returned error can't find the container with id cbfdda5aa606bbeaa5280d0044339a9d9f57163c3b1b89cd4b9fa88258453fdd Jul 22 21:01:58.850086 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.850067 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 21:01:58.865313 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.865262 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-crvhz" podStartSLOduration=4.054650719 podStartE2EDuration="5.86524115s" totalImagesPullingTime="1.810590431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:58.863530912 +0000 UTC m=+302.403039218" watchObservedRunningTime="2026-07-22 21:01:58.86524115 +0000 UTC m=+302.404749454" Jul 22 21:01:58.867900 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.867623 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 21:01:58.891071 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.890639 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dca96186-f5ee-435b-9a7d-734214916869-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vl7p2\" (UID: \"dca96186-f5ee-435b-9a7d-734214916869\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:01:58.891071 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.890739 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p24gq\" (UniqueName: \"kubernetes.io/projected/dca96186-f5ee-435b-9a7d-734214916869-kube-api-access-p24gq\") pod \"monitoring-plugin-7b7b7bc8bf-vl7p2\" (UID: \"dca96186-f5ee-435b-9a7d-734214916869\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:01:58.891071 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:58.891038 2557 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 22 21:01:58.891335 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:58.891106 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca96186-f5ee-435b-9a7d-734214916869-monitoring-plugin-cert podName:dca96186-f5ee-435b-9a7d-734214916869 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:59.39109055 +0000 UTC m=+302.930598830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/dca96186-f5ee-435b-9a7d-734214916869-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-vl7p2" (UID: "dca96186-f5ee-435b-9a7d-734214916869") : secret "monitoring-plugin-cert" not found Jul 22 21:01:58.900915 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:58.900890 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p24gq\" (UniqueName: \"kubernetes.io/projected/dca96186-f5ee-435b-9a7d-734214916869-kube-api-access-p24gq\") pod \"monitoring-plugin-7b7b7bc8bf-vl7p2\" (UID: \"dca96186-f5ee-435b-9a7d-734214916869\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:01:59.395542 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.395508 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dca96186-f5ee-435b-9a7d-734214916869-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vl7p2\" (UID: \"dca96186-f5ee-435b-9a7d-734214916869\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:01:59.395711 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:59.395685 2557 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 22 21:01:59.395771 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:01:59.395757 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca96186-f5ee-435b-9a7d-734214916869-monitoring-plugin-cert podName:dca96186-f5ee-435b-9a7d-734214916869 nodeName:}" failed. No retries permitted until 2026-07-22 21:02:00.395740197 +0000 UTC m=+303.935248490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/dca96186-f5ee-435b-9a7d-734214916869-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-vl7p2" (UID: "dca96186-f5ee-435b-9a7d-734214916869") : secret "monitoring-plugin-cert" not found Jul 22 21:01:59.561574 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.561221 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78f9f5cbd-vhv4v"] Jul 22 21:01:59.565620 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.565573 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.571719 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.571345 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 21:01:59.571719 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.571513 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 21:01:59.571719 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.571519 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 21:01:59.572082 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.571766 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-256jf\"" Jul 22 21:01:59.572082 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.571948 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 21:01:59.572788 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.572617 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 21:01:59.576366 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.576306 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f9f5cbd-vhv4v"] Jul 22 21:01:59.597919 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.597569 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-oauth-serving-cert\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.597919 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.597606 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-service-ca\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.597919 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.597630 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85tsd\" (UniqueName: \"kubernetes.io/projected/debc39e7-d983-42cf-af0a-6817791bdc46-kube-api-access-85tsd\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.597919 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.597659 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-oauth-config\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.597919 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.597724 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-serving-cert\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.597919 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.597778 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-console-config\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.698955 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.698878 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-serving-cert\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.699097 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.698964 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-console-config\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.699097 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.699034 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-oauth-serving-cert\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.699097 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.699063 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-service-ca\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.699256 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.699106 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85tsd\" (UniqueName: \"kubernetes.io/projected/debc39e7-d983-42cf-af0a-6817791bdc46-kube-api-access-85tsd\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.699256 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.699137 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-oauth-config\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.700294 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.700268 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-oauth-serving-cert\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.701204 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.701179 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-console-config\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.701772 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.701743 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-service-ca\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.706224 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.706183 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-serving-cert\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.708195 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.708166 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-oauth-config\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.726147 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.726098 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85tsd\" (UniqueName: \"kubernetes.io/projected/debc39e7-d983-42cf-af0a-6817791bdc46-kube-api-access-85tsd\") pod \"console-78f9f5cbd-vhv4v\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:01:59.848126 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.848045 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" event={"ID":"9330859d-8dfb-42da-aa88-8542d8662222","Type":"ContainerStarted","Data":"cbfdda5aa606bbeaa5280d0044339a9d9f57163c3b1b89cd4b9fa88258453fdd"} Jul 22 21:01:59.880480 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:01:59.880450 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:02:00.406942 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:00.406697 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dca96186-f5ee-435b-9a7d-734214916869-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vl7p2\" (UID: \"dca96186-f5ee-435b-9a7d-734214916869\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:02:00.409822 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:00.409792 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dca96186-f5ee-435b-9a7d-734214916869-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vl7p2\" (UID: \"dca96186-f5ee-435b-9a7d-734214916869\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:02:00.523663 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:00.523626 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:02:01.131616 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:01.131595 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2"] Jul 22 21:02:01.134984 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:02:01.134952 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca96186_f5ee_435b_9a7d_734214916869.slice/crio-258fa3045907b127bb51cd77fdc48e24215229f431cfd5349cacd8d6c9f6eeaf WatchSource:0}: Error finding container 258fa3045907b127bb51cd77fdc48e24215229f431cfd5349cacd8d6c9f6eeaf: Status 404 returned error can't find the container with id 258fa3045907b127bb51cd77fdc48e24215229f431cfd5349cacd8d6c9f6eeaf Jul 22 21:02:01.146804 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:01.146736 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f9f5cbd-vhv4v"] Jul 22 21:02:01.152056 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:02:01.152029 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddebc39e7_d983_42cf_af0a_6817791bdc46.slice/crio-5ec93e11d13193fc7287e3dab977aea2b3426694c8ddbafc2d05d37f94ccff8d WatchSource:0}: Error finding container 5ec93e11d13193fc7287e3dab977aea2b3426694c8ddbafc2d05d37f94ccff8d: Status 404 returned error can't find the container with id 5ec93e11d13193fc7287e3dab977aea2b3426694c8ddbafc2d05d37f94ccff8d Jul 22 21:02:01.858846 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:01.858804 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" event={"ID":"dca96186-f5ee-435b-9a7d-734214916869","Type":"ContainerStarted","Data":"258fa3045907b127bb51cd77fdc48e24215229f431cfd5349cacd8d6c9f6eeaf"} Jul 22 21:02:01.860653 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:01.860622 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" event={"ID":"9330859d-8dfb-42da-aa88-8542d8662222","Type":"ContainerStarted","Data":"18e4d9219234d4dfa83f76bb2bf79415fdb2a2f6085f3e2143c45691a612cc71"} Jul 22 21:02:01.863979 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:01.863952 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" event={"ID":"2fa21246-d00c-4d9c-8b46-80f9b9bb5562","Type":"ContainerStarted","Data":"a11c4e7419bf78740dba35f6b83e68a408f46893fc28790257c9152cd84382f0"} Jul 22 21:02:01.864094 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:01.864026 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" event={"ID":"2fa21246-d00c-4d9c-8b46-80f9b9bb5562","Type":"ContainerStarted","Data":"b013ee8964888d9ede298d5b0e53fa1164afa5b5cace507f3872c1747278597b"} Jul 22 21:02:01.864094 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:01.864066 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" event={"ID":"2fa21246-d00c-4d9c-8b46-80f9b9bb5562","Type":"ContainerStarted","Data":"807709cdbc2505a1182c6f76de700f9744f8cd1a780917579711bd1beb8fb0bd"} Jul 22 21:02:01.865499 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:01.865469 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f9f5cbd-vhv4v" event={"ID":"debc39e7-d983-42cf-af0a-6817791bdc46","Type":"ContainerStarted","Data":"5ec93e11d13193fc7287e3dab977aea2b3426694c8ddbafc2d05d37f94ccff8d"} Jul 22 21:02:01.884753 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:01.884706 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" podStartSLOduration=1.8238346669999999 podStartE2EDuration="3.884686978s" totalImagesPullingTime="2.060852311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:02:01.882258636 +0000 UTC m=+305.421766951" watchObservedRunningTime="2026-07-22 21:02:01.884686978 +0000 UTC m=+305.424195282" Jul 22 21:02:03.877868 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:03.877826 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" event={"ID":"dca96186-f5ee-435b-9a7d-734214916869","Type":"ContainerStarted","Data":"d2727581cab6316a22e31fb01f2ab15bf13eadce6f5baf53beddfbf8c01441af"} Jul 22 21:02:03.878309 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:03.877996 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:02:03.881597 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:03.881567 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" event={"ID":"2fa21246-d00c-4d9c-8b46-80f9b9bb5562","Type":"ContainerStarted","Data":"ced99fdd2ee011be9c7def9f34f928afd7e23072928c4daceedd92fdd5a7d556"} Jul 22 21:02:03.881735 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:03.881638 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" event={"ID":"2fa21246-d00c-4d9c-8b46-80f9b9bb5562","Type":"ContainerStarted","Data":"434406962f03aa59bc9388f9f6cac7b65ff23332774fffac8b0dcb6094fdaa84"} Jul 22 21:02:03.881735 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:03.881677 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" event={"ID":"2fa21246-d00c-4d9c-8b46-80f9b9bb5562","Type":"ContainerStarted","Data":"80718819812bfd919aa9d63a1c4d900de6d0a10c4efeed52766f7786a0dda3f7"} Jul 22 21:02:03.881850 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:03.881758 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:02:03.884008 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:03.883986 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" Jul 22 21:02:03.896594 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:03.896546 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vl7p2" podStartSLOduration=4.177267902 podStartE2EDuration="5.896527795s" totalImagesPullingTime="1.719259893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:02:03.895366209 +0000 UTC m=+307.434874523" watchObservedRunningTime="2026-07-22 21:02:03.896527795 +0000 UTC m=+307.436036098" Jul 22 21:02:03.919317 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:03.919270 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" podStartSLOduration=3.192101653 podStartE2EDuration="7.919251657s" totalImagesPullingTime="4.727150004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:02:03.918511027 +0000 UTC m=+307.458019331" watchObservedRunningTime="2026-07-22 21:02:03.919251657 +0000 UTC m=+307.458759962" Jul 22 21:02:09.894640 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:09.894610 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5699cfc5fc-4whsb" Jul 22 21:02:12.924326 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:12.924268 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-j688d" event={"ID":"dc5f4ccd-270a-485b-a7bf-4d3d022da1ea","Type":"ContainerStarted","Data":"2f3dc2e92165cff606152032c2c9d99b09c6f5e2d90e5e1619c97054c36febbd"} Jul 22 21:02:12.924785 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:12.924462 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-j688d" Jul 22 21:02:12.926060 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:12.926038 2557 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-j688d container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" start-of-body= Jul 22 21:02:12.926186 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:12.926081 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-j688d" podUID="dc5f4ccd-270a-485b-a7bf-4d3d022da1ea" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" Jul 22 21:02:12.926719 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:12.926691 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f9f5cbd-vhv4v" event={"ID":"debc39e7-d983-42cf-af0a-6817791bdc46","Type":"ContainerStarted","Data":"c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8"} Jul 22 21:02:12.967546 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:12.967425 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78f9f5cbd-vhv4v" podStartSLOduration=2.410622923 podStartE2EDuration="13.967408078s" totalImagesPullingTime="11.556785155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:02:12.966968761 +0000 UTC m=+316.506477068" watchObservedRunningTime="2026-07-22 21:02:12.967408078 +0000 UTC m=+316.506916447" Jul 22 21:02:12.968033 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:12.967996 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-j688d" podStartSLOduration=0.730211304 podStartE2EDuration="21.967987548s" totalImagesPullingTime="21.237776244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:02:12.945949609 +0000 UTC m=+316.485457911" watchObservedRunningTime="2026-07-22 21:02:12.967987548 +0000 UTC m=+316.507495921" Jul 22 21:02:13.946135 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:13.946103 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-j688d" Jul 22 21:02:18.651278 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:18.651230 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:02:18.651788 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:18.651297 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:02:19.881152 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:19.881113 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:02:19.881627 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:19.881181 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:02:19.887091 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:19.887061 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:02:19.972523 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:19.972491 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:02:20.257280 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:20.257203 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f9f5cbd-vhv4v"] Jul 22 21:02:21.978945 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:21.978868 2557 generic.go:356] "Generic (PLEG): container finished" podID="c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1" containerID="fbc1cf30669c140efc09eb38515cf3b1f5de93d4c29ca27b68ca43efee664dd0" exitCode=0 Jul 22 21:02:21.979395 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:21.978954 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-bw9fb" event={"ID":"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1","Type":"ContainerDied","Data":"fbc1cf30669c140efc09eb38515cf3b1f5de93d4c29ca27b68ca43efee664dd0"} Jul 22 21:02:21.979502 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:21.979411 2557 scope.go:117] "RemoveContainer" containerID="fbc1cf30669c140efc09eb38515cf3b1f5de93d4c29ca27b68ca43efee664dd0" Jul 22 21:02:22.632253 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:22.632217 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c69f9dccb-qd97j_252c0d53-08ac-4f77-b716-489cc651023d/router/0.log" Jul 22 21:02:22.647629 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:22.647606 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jz77h_2861d068-fec4-432f-b35e-3d9c9f81154d/serve-healthcheck-canary/0.log" Jul 22 21:02:22.983958 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:22.983873 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-bw9fb" event={"ID":"c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1","Type":"ContainerStarted","Data":"160b7c3c6956b4828ef36c99144ef7ef642733d9e1c9d642a8b4924d88ce2b8a"} Jul 22 21:02:23.991022 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:23.989531 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" event={"ID":"472c551d-bdfe-4ec3-910e-49ba89267ecf","Type":"ContainerDied","Data":"00a70f420cfe1fec24be530e5469422b35ba85945fc249d9cdd5aaea0338143c"} Jul 22 21:02:23.991022 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:23.990049 2557 scope.go:117] "RemoveContainer" containerID="00a70f420cfe1fec24be530e5469422b35ba85945fc249d9cdd5aaea0338143c" Jul 22 21:02:23.991022 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:23.989495 2557 generic.go:356] "Generic (PLEG): container finished" podID="472c551d-bdfe-4ec3-910e-49ba89267ecf" containerID="00a70f420cfe1fec24be530e5469422b35ba85945fc249d9cdd5aaea0338143c" exitCode=0 Jul 22 21:02:24.996007 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:24.995975 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-csx4s" event={"ID":"472c551d-bdfe-4ec3-910e-49ba89267ecf","Type":"ContainerStarted","Data":"a7f796f1f741abf12a8c4b940f4abbbc618de9fb9090cd053a1771735e57e484"} Jul 22 21:02:38.656968 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:38.656936 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:02:38.660738 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:38.660713 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-598987cddf-nw7s4" Jul 22 21:02:47.004475 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.004401 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78f9f5cbd-vhv4v" podUID="debc39e7-d983-42cf-af0a-6817791bdc46" containerName="console" containerID="cri-o://c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8" gracePeriod=15 Jul 22 21:02:47.281877 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.281816 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:02:47.325298 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.325271 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-oauth-config\") pod \"debc39e7-d983-42cf-af0a-6817791bdc46\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " Jul 22 21:02:47.325455 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.325307 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-service-ca\") pod \"debc39e7-d983-42cf-af0a-6817791bdc46\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " Jul 22 21:02:47.325455 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.325349 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85tsd\" (UniqueName: \"kubernetes.io/projected/debc39e7-d983-42cf-af0a-6817791bdc46-kube-api-access-85tsd\") pod \"debc39e7-d983-42cf-af0a-6817791bdc46\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " Jul 22 21:02:47.325455 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.325382 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-serving-cert\") pod \"debc39e7-d983-42cf-af0a-6817791bdc46\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " Jul 22 21:02:47.325455 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.325428 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-oauth-serving-cert\") pod \"debc39e7-d983-42cf-af0a-6817791bdc46\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " Jul 22 21:02:47.325607 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.325512 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-console-config\") pod \"debc39e7-d983-42cf-af0a-6817791bdc46\" (UID: \"debc39e7-d983-42cf-af0a-6817791bdc46\") " Jul 22 21:02:47.325840 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.325808 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-service-ca" (OuterVolumeSpecName: "service-ca") pod "debc39e7-d983-42cf-af0a-6817791bdc46" (UID: "debc39e7-d983-42cf-af0a-6817791bdc46"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:02:47.325975 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.325856 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "debc39e7-d983-42cf-af0a-6817791bdc46" (UID: "debc39e7-d983-42cf-af0a-6817791bdc46"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:02:47.325975 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.325941 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-console-config" (OuterVolumeSpecName: "console-config") pod "debc39e7-d983-42cf-af0a-6817791bdc46" (UID: "debc39e7-d983-42cf-af0a-6817791bdc46"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:02:47.327872 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.327846 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "debc39e7-d983-42cf-af0a-6817791bdc46" (UID: "debc39e7-d983-42cf-af0a-6817791bdc46"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 21:02:47.328049 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.327867 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "debc39e7-d983-42cf-af0a-6817791bdc46" (UID: "debc39e7-d983-42cf-af0a-6817791bdc46"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 21:02:47.328049 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.327878 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/debc39e7-d983-42cf-af0a-6817791bdc46-kube-api-access-85tsd" (OuterVolumeSpecName: "kube-api-access-85tsd") pod "debc39e7-d983-42cf-af0a-6817791bdc46" (UID: "debc39e7-d983-42cf-af0a-6817791bdc46"). InnerVolumeSpecName "kube-api-access-85tsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:02:47.426898 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.426872 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-oauth-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:02:47.426898 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.426895 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:02:47.427045 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.426905 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85tsd\" (UniqueName: \"kubernetes.io/projected/debc39e7-d983-42cf-af0a-6817791bdc46-kube-api-access-85tsd\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:02:47.427045 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.426914 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/debc39e7-d983-42cf-af0a-6817791bdc46-console-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:02:47.427045 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.426923 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-oauth-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:02:47.427045 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:47.426931 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/debc39e7-d983-42cf-af0a-6817791bdc46-console-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:02:48.100145 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:48.100109 2557 generic.go:356] "Generic (PLEG): container finished" podID="debc39e7-d983-42cf-af0a-6817791bdc46" containerID="c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8" exitCode=0 Jul 22 21:02:48.100640 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:48.100185 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f9f5cbd-vhv4v" Jul 22 21:02:48.100640 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:48.100202 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f9f5cbd-vhv4v" event={"ID":"debc39e7-d983-42cf-af0a-6817791bdc46","Type":"ContainerDied","Data":"c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8"} Jul 22 21:02:48.100640 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:48.100261 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f9f5cbd-vhv4v" event={"ID":"debc39e7-d983-42cf-af0a-6817791bdc46","Type":"ContainerDied","Data":"5ec93e11d13193fc7287e3dab977aea2b3426694c8ddbafc2d05d37f94ccff8d"} Jul 22 21:02:48.100640 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:48.100283 2557 scope.go:117] "RemoveContainer" containerID="c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8" Jul 22 21:02:48.109088 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:48.109065 2557 scope.go:117] "RemoveContainer" containerID="c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8" Jul 22 21:02:48.109379 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:02:48.109361 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8\": container with ID starting with c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8 not found: ID does not exist" containerID="c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8" Jul 22 21:02:48.109447 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:48.109386 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8"} err="failed to get container status \"c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8\": rpc error: code = NotFound desc = could not find container \"c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8\": container with ID starting with c988a57e75bcd6c4ef1cd25478353cb550e3216ff78c81b08be45de23210dee8 not found: ID does not exist" Jul 22 21:02:48.134328 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:48.134304 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f9f5cbd-vhv4v"] Jul 22 21:02:48.146397 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:48.146376 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78f9f5cbd-vhv4v"] Jul 22 21:02:48.874500 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:02:48.874465 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="debc39e7-d983-42cf-af0a-6817791bdc46" path="/var/lib/kubelet/pods/debc39e7-d983-42cf-af0a-6817791bdc46/volumes" Jul 22 21:03:09.814890 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:09.814858 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 21:03:09.817273 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:09.817248 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98e5db-0164-4705-8954-50b7dcb3cc39-metrics-certs\") pod \"network-metrics-daemon-5s2tf\" (UID: \"3b98e5db-0164-4705-8954-50b7dcb3cc39\") " pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 21:03:09.971107 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:09.971080 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j26qm\"" Jul 22 21:03:09.979350 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:09.979324 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5s2tf" Jul 22 21:03:10.116228 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:10.116195 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5s2tf"] Jul 22 21:03:10.119104 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:03:10.119076 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b98e5db_0164_4705_8954_50b7dcb3cc39.slice/crio-4832cc082ddc85bd2ac85ef11b2419c8032729057fcd44fc582862daf34e515a WatchSource:0}: Error finding container 4832cc082ddc85bd2ac85ef11b2419c8032729057fcd44fc582862daf34e515a: Status 404 returned error can't find the container with id 4832cc082ddc85bd2ac85ef11b2419c8032729057fcd44fc582862daf34e515a Jul 22 21:03:10.186617 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:10.186577 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5s2tf" event={"ID":"3b98e5db-0164-4705-8954-50b7dcb3cc39","Type":"ContainerStarted","Data":"4832cc082ddc85bd2ac85ef11b2419c8032729057fcd44fc582862daf34e515a"} Jul 22 21:03:12.196191 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:12.196152 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5s2tf" event={"ID":"3b98e5db-0164-4705-8954-50b7dcb3cc39","Type":"ContainerStarted","Data":"7b82bb4ca9d7ec3eb827876f20da2e01a7ec816de940ee6283a827f3f1ac9e8e"} Jul 22 21:03:12.196580 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:12.196206 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5s2tf" event={"ID":"3b98e5db-0164-4705-8954-50b7dcb3cc39","Type":"ContainerStarted","Data":"ff284d0bc843e60c854d7b4e10b07440acbb03387fe1deebf62f9d669ed58729"} Jul 22 21:03:12.224717 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:12.224673 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5s2tf" podStartSLOduration=375.124770459 podStartE2EDuration="6m16.224659842s" totalImagesPullingTime="1.099889383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:03:12.224233545 +0000 UTC m=+375.763741846" watchObservedRunningTime="2026-07-22 21:03:12.224659842 +0000 UTC m=+375.764168548" Jul 22 21:03:20.499039 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.499004 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-754fb4c769-5gmsd"] Jul 22 21:03:20.499916 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.499887 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="debc39e7-d983-42cf-af0a-6817791bdc46" containerName="console" Jul 22 21:03:20.499916 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.499911 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="debc39e7-d983-42cf-af0a-6817791bdc46" containerName="console" Jul 22 21:03:20.500052 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.499968 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="debc39e7-d983-42cf-af0a-6817791bdc46" containerName="console" Jul 22 21:03:20.501653 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.501633 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.504540 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.504518 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 21:03:20.504540 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.504555 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 21:03:20.505636 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.505617 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 21:03:20.507176 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.507156 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 21:03:20.507291 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.507267 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 21:03:20.508557 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.508526 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-256jf\"" Jul 22 21:03:20.512232 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.512209 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 21:03:20.522342 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.522316 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754fb4c769-5gmsd"] Jul 22 21:03:20.608102 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.608070 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-oauth-config\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.608102 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.608100 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-console-config\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.608281 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.608124 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-service-ca\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.608281 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.608262 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-serving-cert\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.608349 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.608289 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-trusted-ca-bundle\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.608349 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.608310 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-oauth-serving-cert\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.608418 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.608363 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbbkq\" (UniqueName: \"kubernetes.io/projected/fa7168e2-b482-4540-bf14-503c20f8f27f-kube-api-access-gbbkq\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.709037 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.709000 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-serving-cert\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.709037 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.709042 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-trusted-ca-bundle\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.709220 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.709065 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-oauth-serving-cert\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.709220 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.709177 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbbkq\" (UniqueName: \"kubernetes.io/projected/fa7168e2-b482-4540-bf14-503c20f8f27f-kube-api-access-gbbkq\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.709306 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.709218 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-oauth-config\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.709306 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.709238 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-console-config\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.709408 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.709372 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-service-ca\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.710012 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.709924 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-oauth-serving-cert\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.710012 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.710011 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-console-config\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.710191 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.710036 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-trusted-ca-bundle\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.710191 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.710093 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-service-ca\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.711670 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.711639 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-serving-cert\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.711763 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.711707 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-oauth-config\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.719240 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.719212 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbbkq\" (UniqueName: \"kubernetes.io/projected/fa7168e2-b482-4540-bf14-503c20f8f27f-kube-api-access-gbbkq\") pod \"console-754fb4c769-5gmsd\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.812765 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.812682 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:20.954801 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:20.954763 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754fb4c769-5gmsd"] Jul 22 21:03:20.961690 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:03:20.961665 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7168e2_b482_4540_bf14_503c20f8f27f.slice/crio-97f33fa91166230546ead5ff1c5e68976f21ded685be5be041c1386c0725980a WatchSource:0}: Error finding container 97f33fa91166230546ead5ff1c5e68976f21ded685be5be041c1386c0725980a: Status 404 returned error can't find the container with id 97f33fa91166230546ead5ff1c5e68976f21ded685be5be041c1386c0725980a Jul 22 21:03:21.236191 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:21.236159 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754fb4c769-5gmsd" event={"ID":"fa7168e2-b482-4540-bf14-503c20f8f27f","Type":"ContainerStarted","Data":"411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d"} Jul 22 21:03:21.236191 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:21.236207 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754fb4c769-5gmsd" event={"ID":"fa7168e2-b482-4540-bf14-503c20f8f27f","Type":"ContainerStarted","Data":"97f33fa91166230546ead5ff1c5e68976f21ded685be5be041c1386c0725980a"} Jul 22 21:03:21.260073 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:21.260020 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-754fb4c769-5gmsd" podStartSLOduration=1.2600053500000001 podStartE2EDuration="1.26000535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:03:21.257764379 +0000 UTC m=+384.797272683" watchObservedRunningTime="2026-07-22 21:03:21.26000535 +0000 UTC m=+384.799513707" Jul 22 21:03:30.813714 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:30.813680 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:30.814081 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:30.813735 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:30.818253 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:30.818232 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:03:31.280129 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:03:31.280101 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:04:20.672965 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.672882 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm"] Jul 22 21:04:20.676352 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.676335 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:20.679733 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.679711 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 21:04:20.679834 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.679732 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 21:04:20.680795 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.680781 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jmxvf\"" Jul 22 21:04:20.686099 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.686078 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm"] Jul 22 21:04:20.807581 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.807555 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:20.807709 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.807612 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:20.807709 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.807659 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8xh4\" (UniqueName: \"kubernetes.io/projected/6bf18c29-884d-436c-bc3a-e259b51ec973-kube-api-access-q8xh4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:20.908340 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.908314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:20.908520 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.908351 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8xh4\" (UniqueName: \"kubernetes.io/projected/6bf18c29-884d-436c-bc3a-e259b51ec973-kube-api-access-q8xh4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:20.908520 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.908398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:20.908788 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.908771 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:20.908788 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.908776 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:20.917638 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.917612 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8xh4\" (UniqueName: \"kubernetes.io/projected/6bf18c29-884d-436c-bc3a-e259b51ec973-kube-api-access-q8xh4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:20.986544 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:20.986469 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:21.132260 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:21.132170 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm"] Jul 22 21:04:21.134492 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:04:21.134463 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf18c29_884d_436c_bc3a_e259b51ec973.slice/crio-6bc8f4909b3f4ffe9f07a9c426b2af6789bfae93751eba532a6cf436d3ef0f69 WatchSource:0}: Error finding container 6bc8f4909b3f4ffe9f07a9c426b2af6789bfae93751eba532a6cf436d3ef0f69: Status 404 returned error can't find the container with id 6bc8f4909b3f4ffe9f07a9c426b2af6789bfae93751eba532a6cf436d3ef0f69 Jul 22 21:04:21.473728 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:21.473691 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" event={"ID":"6bf18c29-884d-436c-bc3a-e259b51ec973","Type":"ContainerStarted","Data":"6bc8f4909b3f4ffe9f07a9c426b2af6789bfae93751eba532a6cf436d3ef0f69"} Jul 22 21:04:29.509271 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:29.509233 2557 generic.go:356] "Generic (PLEG): container finished" podID="6bf18c29-884d-436c-bc3a-e259b51ec973" containerID="a48ba30066a8ace8db9fd1b49669fb37dd0a599fa0b7ff6173ad6958156d8e39" exitCode=0 Jul 22 21:04:29.509695 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:29.509307 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" event={"ID":"6bf18c29-884d-436c-bc3a-e259b51ec973","Type":"ContainerDied","Data":"a48ba30066a8ace8db9fd1b49669fb37dd0a599fa0b7ff6173ad6958156d8e39"} Jul 22 21:04:32.524003 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:32.523968 2557 generic.go:356] "Generic (PLEG): container finished" podID="6bf18c29-884d-436c-bc3a-e259b51ec973" containerID="37b9e63152b27b5b745d615cf5131992eed8197de1ca81e19df3e3faddbf17ad" exitCode=0 Jul 22 21:04:32.524406 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:32.524011 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" event={"ID":"6bf18c29-884d-436c-bc3a-e259b51ec973","Type":"ContainerDied","Data":"37b9e63152b27b5b745d615cf5131992eed8197de1ca81e19df3e3faddbf17ad"} Jul 22 21:04:42.568655 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:42.568615 2557 generic.go:356] "Generic (PLEG): container finished" podID="6bf18c29-884d-436c-bc3a-e259b51ec973" containerID="26dc7c5eb30d8f743b3026e3d02d23711aa324432466878e0a10c7a5ea00f157" exitCode=0 Jul 22 21:04:42.569012 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:42.568669 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" event={"ID":"6bf18c29-884d-436c-bc3a-e259b51ec973","Type":"ContainerDied","Data":"26dc7c5eb30d8f743b3026e3d02d23711aa324432466878e0a10c7a5ea00f157"} Jul 22 21:04:43.724136 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:43.724108 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:43.811498 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:43.811471 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-util\") pod \"6bf18c29-884d-436c-bc3a-e259b51ec973\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " Jul 22 21:04:43.811636 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:43.811531 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-bundle\") pod \"6bf18c29-884d-436c-bc3a-e259b51ec973\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " Jul 22 21:04:43.811636 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:43.811568 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8xh4\" (UniqueName: \"kubernetes.io/projected/6bf18c29-884d-436c-bc3a-e259b51ec973-kube-api-access-q8xh4\") pod \"6bf18c29-884d-436c-bc3a-e259b51ec973\" (UID: \"6bf18c29-884d-436c-bc3a-e259b51ec973\") " Jul 22 21:04:43.812143 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:43.812118 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-bundle" (OuterVolumeSpecName: "bundle") pod "6bf18c29-884d-436c-bc3a-e259b51ec973" (UID: "6bf18c29-884d-436c-bc3a-e259b51ec973"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:04:43.813908 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:43.813883 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bf18c29-884d-436c-bc3a-e259b51ec973-kube-api-access-q8xh4" (OuterVolumeSpecName: "kube-api-access-q8xh4") pod "6bf18c29-884d-436c-bc3a-e259b51ec973" (UID: "6bf18c29-884d-436c-bc3a-e259b51ec973"). InnerVolumeSpecName "kube-api-access-q8xh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:04:43.815616 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:43.815595 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-util" (OuterVolumeSpecName: "util") pod "6bf18c29-884d-436c-bc3a-e259b51ec973" (UID: "6bf18c29-884d-436c-bc3a-e259b51ec973"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:04:43.912553 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:43.912483 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:04:43.912553 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:43.912516 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bf18c29-884d-436c-bc3a-e259b51ec973-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:04:43.912553 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:43.912530 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8xh4\" (UniqueName: \"kubernetes.io/projected/6bf18c29-884d-436c-bc3a-e259b51ec973-kube-api-access-q8xh4\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:04:44.578346 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:44.578310 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" event={"ID":"6bf18c29-884d-436c-bc3a-e259b51ec973","Type":"ContainerDied","Data":"6bc8f4909b3f4ffe9f07a9c426b2af6789bfae93751eba532a6cf436d3ef0f69"} Jul 22 21:04:44.578346 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:44.578347 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvhfm" Jul 22 21:04:44.578566 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:44.578360 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bc8f4909b3f4ffe9f07a9c426b2af6789bfae93751eba532a6cf436d3ef0f69" Jul 22 21:04:52.306584 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.306550 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz"] Jul 22 21:04:52.307053 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.306874 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bf18c29-884d-436c-bc3a-e259b51ec973" containerName="extract" Jul 22 21:04:52.307053 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.306885 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bf18c29-884d-436c-bc3a-e259b51ec973" containerName="extract" Jul 22 21:04:52.307053 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.306899 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bf18c29-884d-436c-bc3a-e259b51ec973" containerName="pull" Jul 22 21:04:52.307053 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.306906 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bf18c29-884d-436c-bc3a-e259b51ec973" containerName="pull" Jul 22 21:04:52.307053 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.306914 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bf18c29-884d-436c-bc3a-e259b51ec973" containerName="util" Jul 22 21:04:52.307053 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.306920 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bf18c29-884d-436c-bc3a-e259b51ec973" containerName="util" Jul 22 21:04:52.307053 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.306978 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bf18c29-884d-436c-bc3a-e259b51ec973" containerName="extract" Jul 22 21:04:52.309747 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.309729 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz" Jul 22 21:04:52.312487 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.312465 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 22 21:04:52.312574 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.312508 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rpgrk\"" Jul 22 21:04:52.313094 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.313073 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 22 21:04:52.328213 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.328188 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz"] Jul 22 21:04:52.382087 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.382060 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/964993ac-09fe-4199-91f9-90434840c188-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7jlwz\" (UID: \"964993ac-09fe-4199-91f9-90434840c188\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz" Jul 22 21:04:52.382228 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.382090 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glst6\" (UniqueName: \"kubernetes.io/projected/964993ac-09fe-4199-91f9-90434840c188-kube-api-access-glst6\") pod \"cert-manager-operator-controller-manager-55c444bf86-7jlwz\" (UID: \"964993ac-09fe-4199-91f9-90434840c188\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz" Jul 22 21:04:52.483382 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.483350 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/964993ac-09fe-4199-91f9-90434840c188-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7jlwz\" (UID: \"964993ac-09fe-4199-91f9-90434840c188\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz" Jul 22 21:04:52.483568 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.483386 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glst6\" (UniqueName: \"kubernetes.io/projected/964993ac-09fe-4199-91f9-90434840c188-kube-api-access-glst6\") pod \"cert-manager-operator-controller-manager-55c444bf86-7jlwz\" (UID: \"964993ac-09fe-4199-91f9-90434840c188\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz" Jul 22 21:04:52.483760 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.483740 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/964993ac-09fe-4199-91f9-90434840c188-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7jlwz\" (UID: \"964993ac-09fe-4199-91f9-90434840c188\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz" Jul 22 21:04:52.492803 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.492775 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glst6\" (UniqueName: \"kubernetes.io/projected/964993ac-09fe-4199-91f9-90434840c188-kube-api-access-glst6\") pod \"cert-manager-operator-controller-manager-55c444bf86-7jlwz\" (UID: \"964993ac-09fe-4199-91f9-90434840c188\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz" Jul 22 21:04:52.618393 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.618366 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz" Jul 22 21:04:52.756278 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:52.756230 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz"] Jul 22 21:04:52.758951 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:04:52.758924 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964993ac_09fe_4199_91f9_90434840c188.slice/crio-bded0dfc5ba7d21ebfe83f7c3e5779b3ff1725a115089f848d3c78d3a994e62c WatchSource:0}: Error finding container bded0dfc5ba7d21ebfe83f7c3e5779b3ff1725a115089f848d3c78d3a994e62c: Status 404 returned error can't find the container with id bded0dfc5ba7d21ebfe83f7c3e5779b3ff1725a115089f848d3c78d3a994e62c Jul 22 21:04:53.618716 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:53.618678 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz" event={"ID":"964993ac-09fe-4199-91f9-90434840c188","Type":"ContainerStarted","Data":"bded0dfc5ba7d21ebfe83f7c3e5779b3ff1725a115089f848d3c78d3a994e62c"} Jul 22 21:04:55.628939 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:55.628905 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz" event={"ID":"964993ac-09fe-4199-91f9-90434840c188","Type":"ContainerStarted","Data":"3291ec15fc8dfbe33b2189bc86af3d13dc3c934d89619afd307dbe23b065e11d"} Jul 22 21:04:55.661241 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:55.661196 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7jlwz" podStartSLOduration=1.83585128 podStartE2EDuration="3.661180484s" totalImagesPullingTime="1.825329204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:04:55.65891462 +0000 UTC m=+479.198422920" watchObservedRunningTime="2026-07-22 21:04:55.661180484 +0000 UTC m=+479.200688784" Jul 22 21:04:56.890918 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:56.890892 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rnnsj"] Jul 22 21:04:56.894143 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:56.894127 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" Jul 22 21:04:56.897019 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:56.896996 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 21:04:56.897225 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:56.897212 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 21:04:56.919943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:56.919923 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rnnsj"] Jul 22 21:04:57.020955 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:57.020929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2sw9\" (UniqueName: \"kubernetes.io/projected/2fbf3d6f-ff83-4935-98f3-ca6ecbed6230-kube-api-access-d2sw9\") pod \"cert-manager-webhook-6486ffd997-rnnsj\" (UID: \"2fbf3d6f-ff83-4935-98f3-ca6ecbed6230\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" Jul 22 21:04:57.021054 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:57.020968 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fbf3d6f-ff83-4935-98f3-ca6ecbed6230-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rnnsj\" (UID: \"2fbf3d6f-ff83-4935-98f3-ca6ecbed6230\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" Jul 22 21:04:57.121661 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:57.121634 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2sw9\" (UniqueName: \"kubernetes.io/projected/2fbf3d6f-ff83-4935-98f3-ca6ecbed6230-kube-api-access-d2sw9\") pod \"cert-manager-webhook-6486ffd997-rnnsj\" (UID: \"2fbf3d6f-ff83-4935-98f3-ca6ecbed6230\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" Jul 22 21:04:57.121738 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:57.121673 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fbf3d6f-ff83-4935-98f3-ca6ecbed6230-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rnnsj\" (UID: \"2fbf3d6f-ff83-4935-98f3-ca6ecbed6230\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" Jul 22 21:04:57.132080 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:57.132055 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2sw9\" (UniqueName: \"kubernetes.io/projected/2fbf3d6f-ff83-4935-98f3-ca6ecbed6230-kube-api-access-d2sw9\") pod \"cert-manager-webhook-6486ffd997-rnnsj\" (UID: \"2fbf3d6f-ff83-4935-98f3-ca6ecbed6230\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" Jul 22 21:04:57.132157 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:57.132116 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fbf3d6f-ff83-4935-98f3-ca6ecbed6230-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rnnsj\" (UID: \"2fbf3d6f-ff83-4935-98f3-ca6ecbed6230\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" Jul 22 21:04:57.215429 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:57.215363 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" Jul 22 21:04:57.353115 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:57.353086 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rnnsj"] Jul 22 21:04:57.639985 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:04:57.639951 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" event={"ID":"2fbf3d6f-ff83-4935-98f3-ca6ecbed6230","Type":"ContainerStarted","Data":"1e79b9980ea4a4968156d9695544ee8e3b8233150f85a8863edf213958be4f80"} Jul 22 21:05:00.658189 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:00.658148 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" event={"ID":"2fbf3d6f-ff83-4935-98f3-ca6ecbed6230","Type":"ContainerStarted","Data":"e8f33073252699c29dff4196227782e47d33687a1206a84b98b1a59947b0757d"} Jul 22 21:05:00.658583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:00.658233 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" Jul 22 21:05:00.677681 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:00.677640 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" podStartSLOduration=2.008577486 podStartE2EDuration="4.677624636s" totalImagesPullingTime="2.66904715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:04:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:00.675700703 +0000 UTC m=+484.215209005" watchObservedRunningTime="2026-07-22 21:05:00.677624636 +0000 UTC m=+484.217132937" Jul 22 21:05:03.454274 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.454232 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5"] Jul 22 21:05:03.457878 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.457856 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:03.460674 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.460652 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 21:05:03.460793 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.460652 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jmxvf\"" Jul 22 21:05:03.461556 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.461539 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 21:05:03.476677 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.476656 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5"] Jul 22 21:05:03.574561 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.574538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlx55\" (UniqueName: \"kubernetes.io/projected/e1c2eb64-1b89-48f9-a379-f312581aae12-kube-api-access-mlx55\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:03.574663 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.574568 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:03.574663 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.574588 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:03.674868 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.674836 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlx55\" (UniqueName: \"kubernetes.io/projected/e1c2eb64-1b89-48f9-a379-f312581aae12-kube-api-access-mlx55\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:03.674984 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.674879 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:03.674984 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.674905 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:03.675266 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.675248 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:03.675321 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.675272 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:03.688774 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.688755 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlx55\" (UniqueName: \"kubernetes.io/projected/e1c2eb64-1b89-48f9-a379-f312581aae12-kube-api-access-mlx55\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:03.766931 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.766880 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:03.925667 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:03.925634 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5"] Jul 22 21:05:03.926902 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:05:03.926877 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c2eb64_1b89_48f9_a379_f312581aae12.slice/crio-7929f7ac4419495c2c55896f0e54865a1e43a49650401ca48309b1b82c66f720 WatchSource:0}: Error finding container 7929f7ac4419495c2c55896f0e54865a1e43a49650401ca48309b1b82c66f720: Status 404 returned error can't find the container with id 7929f7ac4419495c2c55896f0e54865a1e43a49650401ca48309b1b82c66f720 Jul 22 21:05:04.684900 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:04.684862 2557 generic.go:356] "Generic (PLEG): container finished" podID="e1c2eb64-1b89-48f9-a379-f312581aae12" containerID="8eba23b18df57fe17409b716aa508e3969c47beae471e6276d3da3f72f3caeaf" exitCode=0 Jul 22 21:05:04.685423 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:04.684947 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" event={"ID":"e1c2eb64-1b89-48f9-a379-f312581aae12","Type":"ContainerDied","Data":"8eba23b18df57fe17409b716aa508e3969c47beae471e6276d3da3f72f3caeaf"} Jul 22 21:05:04.685423 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:04.684994 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" event={"ID":"e1c2eb64-1b89-48f9-a379-f312581aae12","Type":"ContainerStarted","Data":"7929f7ac4419495c2c55896f0e54865a1e43a49650401ca48309b1b82c66f720"} Jul 22 21:05:06.665921 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:06.665893 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rnnsj" Jul 22 21:05:07.701889 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:07.701853 2557 generic.go:356] "Generic (PLEG): container finished" podID="e1c2eb64-1b89-48f9-a379-f312581aae12" containerID="339d76336197ef7d1d6a5d75d24fb7a834c3a7065633cdbf1afb6e8226a6f164" exitCode=0 Jul 22 21:05:07.702322 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:07.701934 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" event={"ID":"e1c2eb64-1b89-48f9-a379-f312581aae12","Type":"ContainerDied","Data":"339d76336197ef7d1d6a5d75d24fb7a834c3a7065633cdbf1afb6e8226a6f164"} Jul 22 21:05:08.708514 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:08.708477 2557 generic.go:356] "Generic (PLEG): container finished" podID="e1c2eb64-1b89-48f9-a379-f312581aae12" containerID="6177a19c56cb9a25dd5f0a48acb082e967a79079cdde51cd4d2d9c38c79bef7f" exitCode=0 Jul 22 21:05:08.708913 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:08.708523 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" event={"ID":"e1c2eb64-1b89-48f9-a379-f312581aae12","Type":"ContainerDied","Data":"6177a19c56cb9a25dd5f0a48acb082e967a79079cdde51cd4d2d9c38c79bef7f"} Jul 22 21:05:09.842142 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:09.842121 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:09.924253 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:09.924230 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-bundle\") pod \"e1c2eb64-1b89-48f9-a379-f312581aae12\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " Jul 22 21:05:09.924361 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:09.924275 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlx55\" (UniqueName: \"kubernetes.io/projected/e1c2eb64-1b89-48f9-a379-f312581aae12-kube-api-access-mlx55\") pod \"e1c2eb64-1b89-48f9-a379-f312581aae12\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " Jul 22 21:05:09.924361 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:09.924335 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-util\") pod \"e1c2eb64-1b89-48f9-a379-f312581aae12\" (UID: \"e1c2eb64-1b89-48f9-a379-f312581aae12\") " Jul 22 21:05:09.924670 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:09.924635 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-bundle" (OuterVolumeSpecName: "bundle") pod "e1c2eb64-1b89-48f9-a379-f312581aae12" (UID: "e1c2eb64-1b89-48f9-a379-f312581aae12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:05:09.926417 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:09.926390 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1c2eb64-1b89-48f9-a379-f312581aae12-kube-api-access-mlx55" (OuterVolumeSpecName: "kube-api-access-mlx55") pod "e1c2eb64-1b89-48f9-a379-f312581aae12" (UID: "e1c2eb64-1b89-48f9-a379-f312581aae12"). InnerVolumeSpecName "kube-api-access-mlx55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:05:09.929057 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:09.929033 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-util" (OuterVolumeSpecName: "util") pod "e1c2eb64-1b89-48f9-a379-f312581aae12" (UID: "e1c2eb64-1b89-48f9-a379-f312581aae12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:05:10.025065 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:10.024994 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:05:10.025065 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:10.025015 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlx55\" (UniqueName: \"kubernetes.io/projected/e1c2eb64-1b89-48f9-a379-f312581aae12-kube-api-access-mlx55\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:05:10.025065 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:10.025025 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1c2eb64-1b89-48f9-a379-f312581aae12-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:05:10.718227 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:10.718189 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" event={"ID":"e1c2eb64-1b89-48f9-a379-f312581aae12","Type":"ContainerDied","Data":"7929f7ac4419495c2c55896f0e54865a1e43a49650401ca48309b1b82c66f720"} Jul 22 21:05:10.718227 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:10.718217 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvxdd5" Jul 22 21:05:10.718227 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:10.718232 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7929f7ac4419495c2c55896f0e54865a1e43a49650401ca48309b1b82c66f720" Jul 22 21:05:16.350617 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.350577 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn"] Jul 22 21:05:16.351118 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.351044 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1c2eb64-1b89-48f9-a379-f312581aae12" containerName="util" Jul 22 21:05:16.351118 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.351061 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1c2eb64-1b89-48f9-a379-f312581aae12" containerName="util" Jul 22 21:05:16.351118 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.351075 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1c2eb64-1b89-48f9-a379-f312581aae12" containerName="extract" Jul 22 21:05:16.351118 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.351083 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1c2eb64-1b89-48f9-a379-f312581aae12" containerName="extract" Jul 22 21:05:16.351118 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.351098 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1c2eb64-1b89-48f9-a379-f312581aae12" containerName="pull" Jul 22 21:05:16.351118 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.351106 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1c2eb64-1b89-48f9-a379-f312581aae12" containerName="pull" Jul 22 21:05:16.351392 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.351187 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1c2eb64-1b89-48f9-a379-f312581aae12" containerName="extract" Jul 22 21:05:16.353673 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.353653 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn" Jul 22 21:05:16.356430 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.356407 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 21:05:16.357651 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.357630 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2v5lp\"" Jul 22 21:05:16.357651 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.357647 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 21:05:16.363634 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.363612 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn"] Jul 22 21:05:16.475022 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.474996 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mctbx\" (UniqueName: \"kubernetes.io/projected/76bcf0d0-9273-41cb-b98f-fdc26d27d9d7-kube-api-access-mctbx\") pod \"openshift-lws-operator-fd8ccff4c-jbqbn\" (UID: \"76bcf0d0-9273-41cb-b98f-fdc26d27d9d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn" Jul 22 21:05:16.475133 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.475036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76bcf0d0-9273-41cb-b98f-fdc26d27d9d7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jbqbn\" (UID: \"76bcf0d0-9273-41cb-b98f-fdc26d27d9d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn" Jul 22 21:05:16.575495 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.575470 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mctbx\" (UniqueName: \"kubernetes.io/projected/76bcf0d0-9273-41cb-b98f-fdc26d27d9d7-kube-api-access-mctbx\") pod \"openshift-lws-operator-fd8ccff4c-jbqbn\" (UID: \"76bcf0d0-9273-41cb-b98f-fdc26d27d9d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn" Jul 22 21:05:16.575599 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.575532 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76bcf0d0-9273-41cb-b98f-fdc26d27d9d7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jbqbn\" (UID: \"76bcf0d0-9273-41cb-b98f-fdc26d27d9d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn" Jul 22 21:05:16.575899 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.575876 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76bcf0d0-9273-41cb-b98f-fdc26d27d9d7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jbqbn\" (UID: \"76bcf0d0-9273-41cb-b98f-fdc26d27d9d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn" Jul 22 21:05:16.585902 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.585883 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mctbx\" (UniqueName: \"kubernetes.io/projected/76bcf0d0-9273-41cb-b98f-fdc26d27d9d7-kube-api-access-mctbx\") pod \"openshift-lws-operator-fd8ccff4c-jbqbn\" (UID: \"76bcf0d0-9273-41cb-b98f-fdc26d27d9d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn" Jul 22 21:05:16.663349 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.663289 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn" Jul 22 21:05:16.792051 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:16.792020 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn"] Jul 22 21:05:16.793210 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:05:16.793185 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76bcf0d0_9273_41cb_b98f_fdc26d27d9d7.slice/crio-709fdc45605bcc906feba683d6621df00d84447c6a4fd6dea1aa24607403639f WatchSource:0}: Error finding container 709fdc45605bcc906feba683d6621df00d84447c6a4fd6dea1aa24607403639f: Status 404 returned error can't find the container with id 709fdc45605bcc906feba683d6621df00d84447c6a4fd6dea1aa24607403639f Jul 22 21:05:17.750231 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:17.750193 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn" event={"ID":"76bcf0d0-9273-41cb-b98f-fdc26d27d9d7","Type":"ContainerStarted","Data":"709fdc45605bcc906feba683d6621df00d84447c6a4fd6dea1aa24607403639f"} Jul 22 21:05:20.765860 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:20.765826 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn" event={"ID":"76bcf0d0-9273-41cb-b98f-fdc26d27d9d7","Type":"ContainerStarted","Data":"ebe29de940660dc36f4a9d1ccd6ed385f62ae0d7478a02877ad3bc1bfec73fd9"} Jul 22 21:05:20.784162 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:20.784113 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jbqbn" podStartSLOduration=1.024357213 podStartE2EDuration="4.784099497s" totalImagesPullingTime="3.759742284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:20.782337002 +0000 UTC m=+504.321845304" watchObservedRunningTime="2026-07-22 21:05:20.784099497 +0000 UTC m=+504.323607797" Jul 22 21:05:23.121992 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.121950 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54"] Jul 22 21:05:23.125785 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.125764 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:23.128704 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.128686 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 21:05:23.129791 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.129772 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jmxvf\"" Jul 22 21:05:23.129791 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.129782 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 21:05:23.134705 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.134682 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54"] Jul 22 21:05:23.226545 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.226520 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:23.226672 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.226552 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlx5f\" (UniqueName: \"kubernetes.io/projected/984cdef1-091a-4f8a-9fac-e97d3ac495c7-kube-api-access-vlx5f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:23.226672 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.226612 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:23.327823 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.327796 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:23.327919 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.327830 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlx5f\" (UniqueName: \"kubernetes.io/projected/984cdef1-091a-4f8a-9fac-e97d3ac495c7-kube-api-access-vlx5f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:23.327919 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.327889 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:23.328144 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.328125 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:23.328212 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.328150 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:23.336917 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.336893 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlx5f\" (UniqueName: \"kubernetes.io/projected/984cdef1-091a-4f8a-9fac-e97d3ac495c7-kube-api-access-vlx5f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:23.434580 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.434507 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:23.577354 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.577324 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54"] Jul 22 21:05:23.580361 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:05:23.580335 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984cdef1_091a_4f8a_9fac_e97d3ac495c7.slice/crio-52003e85782f4a93db3bbc6dda7a6f8b0d80a1ab9fe7994441b719dc6ab9ad9c WatchSource:0}: Error finding container 52003e85782f4a93db3bbc6dda7a6f8b0d80a1ab9fe7994441b719dc6ab9ad9c: Status 404 returned error can't find the container with id 52003e85782f4a93db3bbc6dda7a6f8b0d80a1ab9fe7994441b719dc6ab9ad9c Jul 22 21:05:23.781136 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.781101 2557 generic.go:356] "Generic (PLEG): container finished" podID="984cdef1-091a-4f8a-9fac-e97d3ac495c7" containerID="b7293e5b66ea9b0ddea20678444c459ce79b5d72c60f74470c59fa56d8aed55b" exitCode=0 Jul 22 21:05:23.781256 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.781190 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" event={"ID":"984cdef1-091a-4f8a-9fac-e97d3ac495c7","Type":"ContainerDied","Data":"b7293e5b66ea9b0ddea20678444c459ce79b5d72c60f74470c59fa56d8aed55b"} Jul 22 21:05:23.781314 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:23.781286 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" event={"ID":"984cdef1-091a-4f8a-9fac-e97d3ac495c7","Type":"ContainerStarted","Data":"52003e85782f4a93db3bbc6dda7a6f8b0d80a1ab9fe7994441b719dc6ab9ad9c"} Jul 22 21:05:24.787350 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:24.787275 2557 generic.go:356] "Generic (PLEG): container finished" podID="984cdef1-091a-4f8a-9fac-e97d3ac495c7" containerID="b223445218f23a887d50ae5ac2d27b05d912618da2dd7a2eb6ba440d908171b1" exitCode=0 Jul 22 21:05:24.787350 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:24.787310 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" event={"ID":"984cdef1-091a-4f8a-9fac-e97d3ac495c7","Type":"ContainerDied","Data":"b223445218f23a887d50ae5ac2d27b05d912618da2dd7a2eb6ba440d908171b1"} Jul 22 21:05:25.794236 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:25.794203 2557 generic.go:356] "Generic (PLEG): container finished" podID="984cdef1-091a-4f8a-9fac-e97d3ac495c7" containerID="873700888e33721aea7adef43132cd2bd475ff1cab326781806de20fd2d76728" exitCode=0 Jul 22 21:05:25.794617 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:25.794292 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" event={"ID":"984cdef1-091a-4f8a-9fac-e97d3ac495c7","Type":"ContainerDied","Data":"873700888e33721aea7adef43132cd2bd475ff1cab326781806de20fd2d76728"} Jul 22 21:05:26.926240 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:26.926213 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:27.056136 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.056073 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-util\") pod \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " Jul 22 21:05:27.056249 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.056178 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlx5f\" (UniqueName: \"kubernetes.io/projected/984cdef1-091a-4f8a-9fac-e97d3ac495c7-kube-api-access-vlx5f\") pod \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " Jul 22 21:05:27.056249 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.056213 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-bundle\") pod \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\" (UID: \"984cdef1-091a-4f8a-9fac-e97d3ac495c7\") " Jul 22 21:05:27.057091 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.057043 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-bundle" (OuterVolumeSpecName: "bundle") pod "984cdef1-091a-4f8a-9fac-e97d3ac495c7" (UID: "984cdef1-091a-4f8a-9fac-e97d3ac495c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:05:27.058308 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.058287 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/984cdef1-091a-4f8a-9fac-e97d3ac495c7-kube-api-access-vlx5f" (OuterVolumeSpecName: "kube-api-access-vlx5f") pod "984cdef1-091a-4f8a-9fac-e97d3ac495c7" (UID: "984cdef1-091a-4f8a-9fac-e97d3ac495c7"). InnerVolumeSpecName "kube-api-access-vlx5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:05:27.061403 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.061384 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-util" (OuterVolumeSpecName: "util") pod "984cdef1-091a-4f8a-9fac-e97d3ac495c7" (UID: "984cdef1-091a-4f8a-9fac-e97d3ac495c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:05:27.156729 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.156705 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:05:27.156729 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.156724 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/984cdef1-091a-4f8a-9fac-e97d3ac495c7-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:05:27.156729 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.156732 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlx5f\" (UniqueName: \"kubernetes.io/projected/984cdef1-091a-4f8a-9fac-e97d3ac495c7-kube-api-access-vlx5f\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:05:27.805142 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.805110 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" event={"ID":"984cdef1-091a-4f8a-9fac-e97d3ac495c7","Type":"ContainerDied","Data":"52003e85782f4a93db3bbc6dda7a6f8b0d80a1ab9fe7994441b719dc6ab9ad9c"} Jul 22 21:05:27.805142 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.805134 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8hk54" Jul 22 21:05:27.805329 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:27.805154 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52003e85782f4a93db3bbc6dda7a6f8b0d80a1ab9fe7994441b719dc6ab9ad9c" Jul 22 21:05:37.340600 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.340569 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb"] Jul 22 21:05:37.341067 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.341048 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="984cdef1-091a-4f8a-9fac-e97d3ac495c7" containerName="extract" Jul 22 21:05:37.341152 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.341071 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="984cdef1-091a-4f8a-9fac-e97d3ac495c7" containerName="extract" Jul 22 21:05:37.341152 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.341089 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="984cdef1-091a-4f8a-9fac-e97d3ac495c7" containerName="util" Jul 22 21:05:37.341152 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.341096 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="984cdef1-091a-4f8a-9fac-e97d3ac495c7" containerName="util" Jul 22 21:05:37.341152 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.341108 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="984cdef1-091a-4f8a-9fac-e97d3ac495c7" containerName="pull" Jul 22 21:05:37.341152 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.341116 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="984cdef1-091a-4f8a-9fac-e97d3ac495c7" containerName="pull" Jul 22 21:05:37.341385 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.341227 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="984cdef1-091a-4f8a-9fac-e97d3ac495c7" containerName="extract" Jul 22 21:05:37.347598 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.347577 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.350776 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.350755 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 21:05:37.351087 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.351067 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 21:05:37.351390 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.351376 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 21:05:37.351483 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.351416 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wglmk\"" Jul 22 21:05:37.351613 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.351599 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 21:05:37.371853 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.371831 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb"] Jul 22 21:05:37.433723 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.433695 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294931d0-fe19-4bc4-9f30-e85b7d5d7742-tmp\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.433822 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.433741 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/294931d0-fe19-4bc4-9f30-e85b7d5d7742-webhook-cert\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.433822 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.433774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/294931d0-fe19-4bc4-9f30-e85b7d5d7742-manifests\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.433822 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.433796 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/294931d0-fe19-4bc4-9f30-e85b7d5d7742-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.433822 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.433815 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj4qc\" (UniqueName: \"kubernetes.io/projected/294931d0-fe19-4bc4-9f30-e85b7d5d7742-kube-api-access-xj4qc\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.534858 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.534833 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294931d0-fe19-4bc4-9f30-e85b7d5d7742-tmp\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.534953 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.534874 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/294931d0-fe19-4bc4-9f30-e85b7d5d7742-webhook-cert\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.534953 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.534910 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/294931d0-fe19-4bc4-9f30-e85b7d5d7742-manifests\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.534953 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.534930 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/294931d0-fe19-4bc4-9f30-e85b7d5d7742-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.535070 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.535049 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj4qc\" (UniqueName: \"kubernetes.io/projected/294931d0-fe19-4bc4-9f30-e85b7d5d7742-kube-api-access-xj4qc\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.535303 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.535285 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/294931d0-fe19-4bc4-9f30-e85b7d5d7742-manifests\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.537265 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.537241 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294931d0-fe19-4bc4-9f30-e85b7d5d7742-tmp\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.537475 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.537455 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/294931d0-fe19-4bc4-9f30-e85b7d5d7742-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.537747 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.537721 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/294931d0-fe19-4bc4-9f30-e85b7d5d7742-webhook-cert\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.551083 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.551061 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj4qc\" (UniqueName: \"kubernetes.io/projected/294931d0-fe19-4bc4-9f30-e85b7d5d7742-kube-api-access-xj4qc\") pod \"opendatahub-operator-controller-manager-846644596-mgmtb\" (UID: \"294931d0-fe19-4bc4-9f30-e85b7d5d7742\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.658316 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.658253 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:37.808079 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.808037 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb"] Jul 22 21:05:37.810258 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:05:37.810233 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294931d0_fe19_4bc4_9f30_e85b7d5d7742.slice/crio-70a250d11cada2589d6e220462e89588ace50542825158a19ccaa3b958593118 WatchSource:0}: Error finding container 70a250d11cada2589d6e220462e89588ace50542825158a19ccaa3b958593118: Status 404 returned error can't find the container with id 70a250d11cada2589d6e220462e89588ace50542825158a19ccaa3b958593118 Jul 22 21:05:37.851662 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:37.851632 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" event={"ID":"294931d0-fe19-4bc4-9f30-e85b7d5d7742","Type":"ContainerStarted","Data":"70a250d11cada2589d6e220462e89588ace50542825158a19ccaa3b958593118"} Jul 22 21:05:44.887362 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:44.887324 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" event={"ID":"294931d0-fe19-4bc4-9f30-e85b7d5d7742","Type":"ContainerStarted","Data":"4839a7992017398d46dee0e998fcd157fbeaa55f02fbddef589477179bf9cc18"} Jul 22 21:05:45.893590 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:45.893552 2557 generic.go:356] "Generic (PLEG): container finished" podID="294931d0-fe19-4bc4-9f30-e85b7d5d7742" containerID="4839a7992017398d46dee0e998fcd157fbeaa55f02fbddef589477179bf9cc18" exitCode=0 Jul 22 21:05:45.894002 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:45.893636 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" event={"ID":"294931d0-fe19-4bc4-9f30-e85b7d5d7742","Type":"ContainerDied","Data":"4839a7992017398d46dee0e998fcd157fbeaa55f02fbddef589477179bf9cc18"} Jul 22 21:05:46.899801 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:46.899769 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" event={"ID":"294931d0-fe19-4bc4-9f30-e85b7d5d7742","Type":"ContainerStarted","Data":"c7d3422b4a49df6564a4f24aedd1f8e933b71ee6869baa03e9fa7d802f4601f5"} Jul 22 21:05:46.900289 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:46.899879 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:46.925999 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:46.925948 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" podStartSLOduration=2.315684113 podStartE2EDuration="9.925931838s" totalImagesPullingTime="6.535913742s" totalInitContainerRuntime="1.074333983s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:46.923901683 +0000 UTC m=+530.463409995" watchObservedRunningTime="2026-07-22 21:05:46.925931838 +0000 UTC m=+530.465440138" Jul 22 21:05:56.265392 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.265358 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52"] Jul 22 21:05:56.273286 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.273257 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.277751 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.277720 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 21:05:56.277751 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.277734 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 21:05:56.277751 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.277720 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rl6dp\"" Jul 22 21:05:56.277959 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.277722 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 21:05:56.282448 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.282413 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52"] Jul 22 21:05:56.384334 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.384306 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsnsq\" (UniqueName: \"kubernetes.io/projected/3136f806-3e7e-4f99-a7fd-b6856e4b480f-kube-api-access-fsnsq\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.384514 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.384343 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3136f806-3e7e-4f99-a7fd-b6856e4b480f-metrics-cert\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.384514 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.384406 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3136f806-3e7e-4f99-a7fd-b6856e4b480f-manager-config\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.384514 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.384421 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3136f806-3e7e-4f99-a7fd-b6856e4b480f-cert\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.485474 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.485424 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3136f806-3e7e-4f99-a7fd-b6856e4b480f-metrics-cert\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.485612 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.485513 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3136f806-3e7e-4f99-a7fd-b6856e4b480f-manager-config\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.485612 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.485541 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3136f806-3e7e-4f99-a7fd-b6856e4b480f-cert\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.485612 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.485605 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsnsq\" (UniqueName: \"kubernetes.io/projected/3136f806-3e7e-4f99-a7fd-b6856e4b480f-kube-api-access-fsnsq\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.486193 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.486168 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3136f806-3e7e-4f99-a7fd-b6856e4b480f-manager-config\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.488175 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.488152 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3136f806-3e7e-4f99-a7fd-b6856e4b480f-cert\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.488245 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.488226 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3136f806-3e7e-4f99-a7fd-b6856e4b480f-metrics-cert\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.494685 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.494649 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsnsq\" (UniqueName: \"kubernetes.io/projected/3136f806-3e7e-4f99-a7fd-b6856e4b480f-kube-api-access-fsnsq\") pod \"lws-controller-manager-7dc9694985-9kq52\" (UID: \"3136f806-3e7e-4f99-a7fd-b6856e4b480f\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.583068 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.583045 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:56.721781 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.721756 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52"] Jul 22 21:05:56.723597 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:05:56.723562 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3136f806_3e7e_4f99_a7fd_b6856e4b480f.slice/crio-19ec3476140e0099989f997e23d58f02a19e6634f668486561b766b701781c85 WatchSource:0}: Error finding container 19ec3476140e0099989f997e23d58f02a19e6634f668486561b766b701781c85: Status 404 returned error can't find the container with id 19ec3476140e0099989f997e23d58f02a19e6634f668486561b766b701781c85 Jul 22 21:05:56.950536 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:56.950469 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" event={"ID":"3136f806-3e7e-4f99-a7fd-b6856e4b480f","Type":"ContainerStarted","Data":"19ec3476140e0099989f997e23d58f02a19e6634f668486561b766b701781c85"} Jul 22 21:05:57.907173 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:57.907144 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-846644596-mgmtb" Jul 22 21:05:58.962817 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:58.962781 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" event={"ID":"3136f806-3e7e-4f99-a7fd-b6856e4b480f","Type":"ContainerStarted","Data":"28c4bd9ec7e4381761a5822eb12346a653a2b728fafe40e0628db360b0df28e4"} Jul 22 21:05:58.963263 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:58.962964 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:05:58.983131 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:05:58.983085 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" podStartSLOduration=1.445692616 podStartE2EDuration="2.983070533s" totalImagesPullingTime="1.537377917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:58.980987473 +0000 UTC m=+542.520495776" watchObservedRunningTime="2026-07-22 21:05:58.983070533 +0000 UTC m=+542.522578834" Jul 22 21:06:09.970167 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:09.970138 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-9kq52" Jul 22 21:06:11.447764 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.447728 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v"] Jul 22 21:06:11.451326 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.451309 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" Jul 22 21:06:11.457864 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.457844 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-v9bvm\"" Jul 22 21:06:11.458876 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.458852 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 22 21:06:11.467500 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.467478 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v"] Jul 22 21:06:11.614020 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.613984 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9047eaa-a1d6-4123-a1f3-d67c4af7b03f-cert\") pod \"kserve-controller-manager-d6f4b65b8-n2d7v\" (UID: \"d9047eaa-a1d6-4123-a1f3-d67c4af7b03f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" Jul 22 21:06:11.614195 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.614033 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq9dj\" (UniqueName: \"kubernetes.io/projected/d9047eaa-a1d6-4123-a1f3-d67c4af7b03f-kube-api-access-bq9dj\") pod \"kserve-controller-manager-d6f4b65b8-n2d7v\" (UID: \"d9047eaa-a1d6-4123-a1f3-d67c4af7b03f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" Jul 22 21:06:11.714818 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.714736 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9047eaa-a1d6-4123-a1f3-d67c4af7b03f-cert\") pod \"kserve-controller-manager-d6f4b65b8-n2d7v\" (UID: \"d9047eaa-a1d6-4123-a1f3-d67c4af7b03f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" Jul 22 21:06:11.714818 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.714778 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq9dj\" (UniqueName: \"kubernetes.io/projected/d9047eaa-a1d6-4123-a1f3-d67c4af7b03f-kube-api-access-bq9dj\") pod \"kserve-controller-manager-d6f4b65b8-n2d7v\" (UID: \"d9047eaa-a1d6-4123-a1f3-d67c4af7b03f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" Jul 22 21:06:11.717329 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.717309 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9047eaa-a1d6-4123-a1f3-d67c4af7b03f-cert\") pod \"kserve-controller-manager-d6f4b65b8-n2d7v\" (UID: \"d9047eaa-a1d6-4123-a1f3-d67c4af7b03f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" Jul 22 21:06:11.724871 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.724848 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq9dj\" (UniqueName: \"kubernetes.io/projected/d9047eaa-a1d6-4123-a1f3-d67c4af7b03f-kube-api-access-bq9dj\") pod \"kserve-controller-manager-d6f4b65b8-n2d7v\" (UID: \"d9047eaa-a1d6-4123-a1f3-d67c4af7b03f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" Jul 22 21:06:11.761935 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.761899 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" Jul 22 21:06:11.909844 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:11.909821 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v"] Jul 22 21:06:11.911334 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:06:11.911313 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9047eaa_a1d6_4123_a1f3_d67c4af7b03f.slice/crio-28752a5900d376e0a3776b6400be759540a48a0611d76041135b731e230351df WatchSource:0}: Error finding container 28752a5900d376e0a3776b6400be759540a48a0611d76041135b731e230351df: Status 404 returned error can't find the container with id 28752a5900d376e0a3776b6400be759540a48a0611d76041135b731e230351df Jul 22 21:06:12.029541 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:12.029431 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" event={"ID":"d9047eaa-a1d6-4123-a1f3-d67c4af7b03f","Type":"ContainerStarted","Data":"28752a5900d376e0a3776b6400be759540a48a0611d76041135b731e230351df"} Jul 22 21:06:13.400227 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.400193 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv"] Jul 22 21:06:13.407643 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.407621 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.410753 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.410729 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 21:06:13.410856 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.410753 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8qpg8\"" Jul 22 21:06:13.427697 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.427671 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv"] Jul 22 21:06:13.531910 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.531870 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.532098 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.531953 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.532098 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.531974 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ddec1d-3275-433e-8111-e4d100a641fa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.532098 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.532036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch6ww\" (UniqueName: \"kubernetes.io/projected/b8ddec1d-3275-433e-8111-e4d100a641fa-kube-api-access-ch6ww\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.532098 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.532086 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.532308 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.532166 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.532308 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.532216 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.532308 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.532250 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.532308 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.532276 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.633447 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.633411 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.633635 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.633465 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.633635 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.633487 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.633635 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.633524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.633635 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.633539 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ddec1d-3275-433e-8111-e4d100a641fa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.633635 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.633587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6ww\" (UniqueName: \"kubernetes.io/projected/b8ddec1d-3275-433e-8111-e4d100a641fa-kube-api-access-ch6ww\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.633635 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.633623 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.633941 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.633833 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.633941 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.633853 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.634043 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.633944 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.634043 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.634023 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.634320 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.634299 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.634397 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.634299 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ddec1d-3275-433e-8111-e4d100a641fa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.634473 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.634364 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.636410 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.636389 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.636716 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.636699 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.648539 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.648513 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch6ww\" (UniqueName: \"kubernetes.io/projected/b8ddec1d-3275-433e-8111-e4d100a641fa-kube-api-access-ch6ww\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.662482 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.662408 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ddec1d-3275-433e-8111-e4d100a641fa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vr5bv\" (UID: \"b8ddec1d-3275-433e-8111-e4d100a641fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.718693 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.718654 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:13.918344 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:13.918310 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv"] Jul 22 21:06:13.918599 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:06:13.918573 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ddec1d_3275_433e_8111_e4d100a641fa.slice/crio-8bf750613ca172f4b69e8d19955ef244a79c356e874e5dee613f8b64277a839d WatchSource:0}: Error finding container 8bf750613ca172f4b69e8d19955ef244a79c356e874e5dee613f8b64277a839d: Status 404 returned error can't find the container with id 8bf750613ca172f4b69e8d19955ef244a79c356e874e5dee613f8b64277a839d Jul 22 21:06:14.050519 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:14.050481 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" event={"ID":"b8ddec1d-3275-433e-8111-e4d100a641fa","Type":"ContainerStarted","Data":"8bf750613ca172f4b69e8d19955ef244a79c356e874e5dee613f8b64277a839d"} Jul 22 21:06:15.058369 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:15.058283 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" event={"ID":"d9047eaa-a1d6-4123-a1f3-d67c4af7b03f","Type":"ContainerStarted","Data":"2de047b3fb538177298f0f49fd77d9a89da3ea73c7ffa7d886959be6f9517b81"} Jul 22 21:06:15.058856 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:15.058478 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" Jul 22 21:06:15.080810 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:15.080758 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" podStartSLOduration=1.356670157 podStartE2EDuration="4.080737843s" totalImagesPullingTime="2.724067686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:15.078894663 +0000 UTC m=+558.618402964" watchObservedRunningTime="2026-07-22 21:06:15.080737843 +0000 UTC m=+558.620246147" Jul 22 21:06:16.743968 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:16.743934 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 22 21:06:16.744264 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:16.743999 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 22 21:06:16.744264 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:16.744024 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 22 21:06:17.070521 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:17.070405 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" event={"ID":"b8ddec1d-3275-433e-8111-e4d100a641fa","Type":"ContainerStarted","Data":"478e66dbbd410f29a734ed05a3d0b198d047f12306e5dbea344e45161014b44c"} Jul 22 21:06:17.098637 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:17.098576 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" podStartSLOduration=1.275737162 podStartE2EDuration="4.098560662s" totalImagesPullingTime="2.8228235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:17.095795243 +0000 UTC m=+560.635303569" watchObservedRunningTime="2026-07-22 21:06:17.098560662 +0000 UTC m=+560.638068964" Jul 22 21:06:17.719454 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:17.719405 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:17.723936 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:17.723913 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:18.075479 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:18.075377 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:18.076331 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:18.076310 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vr5bv" Jul 22 21:06:46.068979 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:46.068943 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2d7v" Jul 22 21:06:56.807346 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:56.807314 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:06:56.807856 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:56.807825 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:06:56.811831 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:56.811812 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:06:56.812309 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:06:56.812293 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:07:01.472965 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.472932 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88plp"] Jul 22 21:07:01.476218 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.476197 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88plp" Jul 22 21:07:01.479477 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.479451 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-w5gls\"" Jul 22 21:07:01.480536 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.480515 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 21:07:01.480640 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.480523 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 21:07:01.491162 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.491138 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88plp"] Jul 22 21:07:01.541852 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.541817 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jj4v\" (UniqueName: \"kubernetes.io/projected/e1815d03-8fdd-4f3e-9306-c007934765f1-kube-api-access-8jj4v\") pod \"kuadrant-operator-catalog-88plp\" (UID: \"e1815d03-8fdd-4f3e-9306-c007934765f1\") " pod="kuadrant-system/kuadrant-operator-catalog-88plp" Jul 22 21:07:01.643307 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.643272 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jj4v\" (UniqueName: \"kubernetes.io/projected/e1815d03-8fdd-4f3e-9306-c007934765f1-kube-api-access-8jj4v\") pod \"kuadrant-operator-catalog-88plp\" (UID: \"e1815d03-8fdd-4f3e-9306-c007934765f1\") " pod="kuadrant-system/kuadrant-operator-catalog-88plp" Jul 22 21:07:01.658931 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.658900 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jj4v\" (UniqueName: \"kubernetes.io/projected/e1815d03-8fdd-4f3e-9306-c007934765f1-kube-api-access-8jj4v\") pod \"kuadrant-operator-catalog-88plp\" (UID: \"e1815d03-8fdd-4f3e-9306-c007934765f1\") " pod="kuadrant-system/kuadrant-operator-catalog-88plp" Jul 22 21:07:01.786513 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.786423 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88plp" Jul 22 21:07:01.838736 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.838704 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88plp"] Jul 22 21:07:01.932839 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.932800 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88plp"] Jul 22 21:07:01.934268 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:07:01.934244 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1815d03_8fdd_4f3e_9306_c007934765f1.slice/crio-bcf93c734aeb5e054a5a9a1d2b3013fc20c2dcdae60c42c9582ef5fd3bfeb65b WatchSource:0}: Error finding container bcf93c734aeb5e054a5a9a1d2b3013fc20c2dcdae60c42c9582ef5fd3bfeb65b: Status 404 returned error can't find the container with id bcf93c734aeb5e054a5a9a1d2b3013fc20c2dcdae60c42c9582ef5fd3bfeb65b Jul 22 21:07:01.935814 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:01.935795 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 21:07:02.049967 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:02.049890 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sht78"] Jul 22 21:07:02.054055 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:02.054035 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sht78" Jul 22 21:07:02.065119 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:02.065095 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sht78"] Jul 22 21:07:02.147997 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:02.147970 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv96z\" (UniqueName: \"kubernetes.io/projected/4d1049c2-1457-4e21-8033-321ccd84c4e9-kube-api-access-tv96z\") pod \"kuadrant-operator-catalog-sht78\" (UID: \"4d1049c2-1457-4e21-8033-321ccd84c4e9\") " pod="kuadrant-system/kuadrant-operator-catalog-sht78" Jul 22 21:07:02.248738 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:02.248709 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv96z\" (UniqueName: \"kubernetes.io/projected/4d1049c2-1457-4e21-8033-321ccd84c4e9-kube-api-access-tv96z\") pod \"kuadrant-operator-catalog-sht78\" (UID: \"4d1049c2-1457-4e21-8033-321ccd84c4e9\") " pod="kuadrant-system/kuadrant-operator-catalog-sht78" Jul 22 21:07:02.259274 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:02.259246 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv96z\" (UniqueName: \"kubernetes.io/projected/4d1049c2-1457-4e21-8033-321ccd84c4e9-kube-api-access-tv96z\") pod \"kuadrant-operator-catalog-sht78\" (UID: \"4d1049c2-1457-4e21-8033-321ccd84c4e9\") " pod="kuadrant-system/kuadrant-operator-catalog-sht78" Jul 22 21:07:02.292038 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:02.292012 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88plp" event={"ID":"e1815d03-8fdd-4f3e-9306-c007934765f1","Type":"ContainerStarted","Data":"bcf93c734aeb5e054a5a9a1d2b3013fc20c2dcdae60c42c9582ef5fd3bfeb65b"} Jul 22 21:07:02.363215 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:02.363189 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sht78" Jul 22 21:07:02.501703 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:02.501676 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sht78"] Jul 22 21:07:02.503069 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:07:02.503044 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1049c2_1457_4e21_8033_321ccd84c4e9.slice/crio-1bbf93b61c697cce54224efd55c785a5230d55324ff4b96b160d619bffd062bb WatchSource:0}: Error finding container 1bbf93b61c697cce54224efd55c785a5230d55324ff4b96b160d619bffd062bb: Status 404 returned error can't find the container with id 1bbf93b61c697cce54224efd55c785a5230d55324ff4b96b160d619bffd062bb Jul 22 21:07:03.298996 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:03.298954 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sht78" event={"ID":"4d1049c2-1457-4e21-8033-321ccd84c4e9","Type":"ContainerStarted","Data":"1bbf93b61c697cce54224efd55c785a5230d55324ff4b96b160d619bffd062bb"} Jul 22 21:07:05.310493 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:05.310414 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88plp" event={"ID":"e1815d03-8fdd-4f3e-9306-c007934765f1","Type":"ContainerStarted","Data":"a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a"} Jul 22 21:07:05.310980 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:05.310489 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-88plp" podUID="e1815d03-8fdd-4f3e-9306-c007934765f1" containerName="registry-server" containerID="cri-o://a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a" gracePeriod=2 Jul 22 21:07:05.312028 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:05.312003 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sht78" event={"ID":"4d1049c2-1457-4e21-8033-321ccd84c4e9","Type":"ContainerStarted","Data":"2595c13edf770660e270cc7a205f1ff85845d70b0a5c85bde6f2fe0d4379303f"} Jul 22 21:07:05.334538 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:05.334495 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-88plp" podStartSLOduration=1.726412133 podStartE2EDuration="4.334480048s" totalImagesPullingTime="2.608067915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:07:05.333735597 +0000 UTC m=+608.873243911" watchObservedRunningTime="2026-07-22 21:07:05.334480048 +0000 UTC m=+608.873988349" Jul 22 21:07:05.359209 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:05.359162 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sht78" podStartSLOduration=1.316708841 podStartE2EDuration="3.359145737s" totalImagesPullingTime="2.042436896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:07:05.356426464 +0000 UTC m=+608.895934765" watchObservedRunningTime="2026-07-22 21:07:05.359145737 +0000 UTC m=+608.898654039" Jul 22 21:07:05.569039 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:05.568959 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88plp" Jul 22 21:07:05.680692 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:05.680658 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jj4v\" (UniqueName: \"kubernetes.io/projected/e1815d03-8fdd-4f3e-9306-c007934765f1-kube-api-access-8jj4v\") pod \"e1815d03-8fdd-4f3e-9306-c007934765f1\" (UID: \"e1815d03-8fdd-4f3e-9306-c007934765f1\") " Jul 22 21:07:05.683053 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:05.683023 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1815d03-8fdd-4f3e-9306-c007934765f1-kube-api-access-8jj4v" (OuterVolumeSpecName: "kube-api-access-8jj4v") pod "e1815d03-8fdd-4f3e-9306-c007934765f1" (UID: "e1815d03-8fdd-4f3e-9306-c007934765f1"). InnerVolumeSpecName "kube-api-access-8jj4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:07:05.781647 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:05.781607 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jj4v\" (UniqueName: \"kubernetes.io/projected/e1815d03-8fdd-4f3e-9306-c007934765f1-kube-api-access-8jj4v\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:06.318478 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:06.318424 2557 generic.go:356] "Generic (PLEG): container finished" podID="e1815d03-8fdd-4f3e-9306-c007934765f1" containerID="a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a" exitCode=0 Jul 22 21:07:06.318962 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:06.318491 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88plp" Jul 22 21:07:06.318962 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:06.318538 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88plp" event={"ID":"e1815d03-8fdd-4f3e-9306-c007934765f1","Type":"ContainerDied","Data":"a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a"} Jul 22 21:07:06.318962 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:06.318595 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88plp" event={"ID":"e1815d03-8fdd-4f3e-9306-c007934765f1","Type":"ContainerDied","Data":"bcf93c734aeb5e054a5a9a1d2b3013fc20c2dcdae60c42c9582ef5fd3bfeb65b"} Jul 22 21:07:06.318962 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:06.318623 2557 scope.go:117] "RemoveContainer" containerID="a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a" Jul 22 21:07:06.328864 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:06.328846 2557 scope.go:117] "RemoveContainer" containerID="a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a" Jul 22 21:07:06.329127 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:07:06.329105 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a\": container with ID starting with a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a not found: ID does not exist" containerID="a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a" Jul 22 21:07:06.329177 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:06.329136 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a"} err="failed to get container status \"a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a\": rpc error: code = NotFound desc = could not find container \"a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a\": container with ID starting with a4d1a15e44ddbb6642c99e2195390e1e1ea01e9d74dcb087b57c8e34a7d57e7a not found: ID does not exist" Jul 22 21:07:06.339119 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:06.339092 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88plp"] Jul 22 21:07:06.341153 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:06.341129 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88plp"] Jul 22 21:07:06.874451 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:06.874410 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1815d03-8fdd-4f3e-9306-c007934765f1" path="/var/lib/kubelet/pods/e1815d03-8fdd-4f3e-9306-c007934765f1/volumes" Jul 22 21:07:11.344535 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.344485 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ff7d68bdd-nbdct"] Jul 22 21:07:11.345579 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.345553 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1815d03-8fdd-4f3e-9306-c007934765f1" containerName="registry-server" Jul 22 21:07:11.345579 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.345579 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1815d03-8fdd-4f3e-9306-c007934765f1" containerName="registry-server" Jul 22 21:07:11.345820 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.345702 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1815d03-8fdd-4f3e-9306-c007934765f1" containerName="registry-server" Jul 22 21:07:11.350856 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.350828 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.358645 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.358618 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff7d68bdd-nbdct"] Jul 22 21:07:11.430049 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.430013 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-console-config\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.430049 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.430047 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-service-ca\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.430262 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.430110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8506fa63-eef4-4cb5-ac0b-9721010dca6f-console-oauth-config\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.430262 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.430197 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8506fa63-eef4-4cb5-ac0b-9721010dca6f-console-serving-cert\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.430262 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.430224 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-oauth-serving-cert\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.430262 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.430240 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw76n\" (UniqueName: \"kubernetes.io/projected/8506fa63-eef4-4cb5-ac0b-9721010dca6f-kube-api-access-fw76n\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.430262 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.430258 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-trusted-ca-bundle\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.531541 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.531504 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-console-config\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.531541 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.531543 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-service-ca\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.531762 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.531603 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8506fa63-eef4-4cb5-ac0b-9721010dca6f-console-oauth-config\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.531762 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.531663 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8506fa63-eef4-4cb5-ac0b-9721010dca6f-console-serving-cert\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.531762 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.531688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-oauth-serving-cert\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.531762 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.531709 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw76n\" (UniqueName: \"kubernetes.io/projected/8506fa63-eef4-4cb5-ac0b-9721010dca6f-kube-api-access-fw76n\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.531762 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.531736 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-trusted-ca-bundle\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.532456 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.532405 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-console-config\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.532581 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.532424 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-oauth-serving-cert\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.532657 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.532622 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-service-ca\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.532691 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.532679 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8506fa63-eef4-4cb5-ac0b-9721010dca6f-trusted-ca-bundle\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.534272 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.534242 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8506fa63-eef4-4cb5-ac0b-9721010dca6f-console-serving-cert\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.534372 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.534307 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8506fa63-eef4-4cb5-ac0b-9721010dca6f-console-oauth-config\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.540060 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.540038 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw76n\" (UniqueName: \"kubernetes.io/projected/8506fa63-eef4-4cb5-ac0b-9721010dca6f-kube-api-access-fw76n\") pod \"console-6ff7d68bdd-nbdct\" (UID: \"8506fa63-eef4-4cb5-ac0b-9721010dca6f\") " pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.663271 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.663181 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:11.802548 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:11.802521 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff7d68bdd-nbdct"] Jul 22 21:07:11.804413 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:07:11.804390 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8506fa63_eef4_4cb5_ac0b_9721010dca6f.slice/crio-ae61e7cadf362da7799d0b983ed2da4f514b8d40a96565db0d6b07a383a0e837 WatchSource:0}: Error finding container ae61e7cadf362da7799d0b983ed2da4f514b8d40a96565db0d6b07a383a0e837: Status 404 returned error can't find the container with id ae61e7cadf362da7799d0b983ed2da4f514b8d40a96565db0d6b07a383a0e837 Jul 22 21:07:12.357795 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:12.357756 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff7d68bdd-nbdct" event={"ID":"8506fa63-eef4-4cb5-ac0b-9721010dca6f","Type":"ContainerStarted","Data":"a8b63bc7712072acbbe43bd7556c8caa198b7ede57bf4d5b1a3888593d832d74"} Jul 22 21:07:12.358198 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:12.357814 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff7d68bdd-nbdct" event={"ID":"8506fa63-eef4-4cb5-ac0b-9721010dca6f","Type":"ContainerStarted","Data":"ae61e7cadf362da7799d0b983ed2da4f514b8d40a96565db0d6b07a383a0e837"} Jul 22 21:07:12.363277 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:12.363258 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sht78" Jul 22 21:07:12.363378 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:12.363300 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sht78" Jul 22 21:07:12.378777 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:12.378725 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ff7d68bdd-nbdct" podStartSLOduration=1.37870808 podStartE2EDuration="1.37870808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:07:12.376254293 +0000 UTC m=+615.915762597" watchObservedRunningTime="2026-07-22 21:07:12.37870808 +0000 UTC m=+615.918216382" Jul 22 21:07:12.387122 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:12.387096 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sht78" Jul 22 21:07:13.385606 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:13.385577 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sht78" Jul 22 21:07:16.432663 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.432629 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf"] Jul 22 21:07:16.436429 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.436409 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:16.438815 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.438792 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vnlkb\"" Jul 22 21:07:16.444051 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.444024 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf"] Jul 22 21:07:16.580927 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.580875 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:16.580927 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.580923 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:16.581150 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.580988 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r892n\" (UniqueName: \"kubernetes.io/projected/07ecf2e0-3880-4209-a5f4-23ab23286b72-kube-api-access-r892n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:16.682446 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.682405 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:16.682660 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.682484 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:16.682660 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.682535 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r892n\" (UniqueName: \"kubernetes.io/projected/07ecf2e0-3880-4209-a5f4-23ab23286b72-kube-api-access-r892n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:16.682943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.682882 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:16.682943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.682890 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:16.691286 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.691252 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r892n\" (UniqueName: \"kubernetes.io/projected/07ecf2e0-3880-4209-a5f4-23ab23286b72-kube-api-access-r892n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:16.746721 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.746681 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:16.886327 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:16.886299 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf"] Jul 22 21:07:16.889183 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:07:16.889149 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ecf2e0_3880_4209_a5f4_23ab23286b72.slice/crio-685f25492ce6329917bbb275a5a57fd1961ea9a1b7cd3b3d87c00969c751a0fb WatchSource:0}: Error finding container 685f25492ce6329917bbb275a5a57fd1961ea9a1b7cd3b3d87c00969c751a0fb: Status 404 returned error can't find the container with id 685f25492ce6329917bbb275a5a57fd1961ea9a1b7cd3b3d87c00969c751a0fb Jul 22 21:07:17.235411 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.235306 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s"] Jul 22 21:07:17.239055 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.239038 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:17.247585 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.247557 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s"] Jul 22 21:07:17.388190 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.388154 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:17.388496 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.388206 2557 generic.go:356] "Generic (PLEG): container finished" podID="07ecf2e0-3880-4209-a5f4-23ab23286b72" containerID="89c3adfefc04e6c733ed0a1c62c79aaab9e5bb45111048c18df87fb13d3d278f" exitCode=0 Jul 22 21:07:17.388496 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.388273 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqm5m\" (UniqueName: \"kubernetes.io/projected/12293e33-dc6c-4153-a5c0-879e0bb44bed-kube-api-access-qqm5m\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:17.388496 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.388363 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:17.388496 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.388368 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" event={"ID":"07ecf2e0-3880-4209-a5f4-23ab23286b72","Type":"ContainerDied","Data":"89c3adfefc04e6c733ed0a1c62c79aaab9e5bb45111048c18df87fb13d3d278f"} Jul 22 21:07:17.388714 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.388599 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" event={"ID":"07ecf2e0-3880-4209-a5f4-23ab23286b72","Type":"ContainerStarted","Data":"685f25492ce6329917bbb275a5a57fd1961ea9a1b7cd3b3d87c00969c751a0fb"} Jul 22 21:07:17.489585 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.489498 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqm5m\" (UniqueName: \"kubernetes.io/projected/12293e33-dc6c-4153-a5c0-879e0bb44bed-kube-api-access-qqm5m\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:17.489585 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.489569 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:17.489984 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.489589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:17.489984 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.489903 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:17.490048 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.489999 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:17.498572 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.498543 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqm5m\" (UniqueName: \"kubernetes.io/projected/12293e33-dc6c-4153-a5c0-879e0bb44bed-kube-api-access-qqm5m\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:17.549131 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.549092 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:17.689421 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.689388 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s"] Jul 22 21:07:17.690501 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:07:17.690472 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12293e33_dc6c_4153_a5c0_879e0bb44bed.slice/crio-4b2682d4d4a024e7ff56fda9826b35148695ffb56385b307beab17759a1816be WatchSource:0}: Error finding container 4b2682d4d4a024e7ff56fda9826b35148695ffb56385b307beab17759a1816be: Status 404 returned error can't find the container with id 4b2682d4d4a024e7ff56fda9826b35148695ffb56385b307beab17759a1816be Jul 22 21:07:17.828756 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.828710 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz"] Jul 22 21:07:17.832527 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.832500 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:17.839700 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.839670 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz"] Jul 22 21:07:17.993176 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.993138 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkdxt\" (UniqueName: \"kubernetes.io/projected/1e59d299-3730-45e6-8818-861a3b1636d3-kube-api-access-lkdxt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:17.993346 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.993211 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:17.993346 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:17.993251 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:18.094390 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.094355 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdxt\" (UniqueName: \"kubernetes.io/projected/1e59d299-3730-45e6-8818-861a3b1636d3-kube-api-access-lkdxt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:18.094577 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.094414 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:18.094577 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.094474 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:18.094780 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.094762 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:18.094818 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.094792 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:18.103160 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.103129 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdxt\" (UniqueName: \"kubernetes.io/projected/1e59d299-3730-45e6-8818-861a3b1636d3-kube-api-access-lkdxt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:18.160388 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.160354 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:18.231294 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.231253 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc"] Jul 22 21:07:18.235201 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.235177 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:18.243567 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.243289 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc"] Jul 22 21:07:18.396273 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.396245 2557 generic.go:356] "Generic (PLEG): container finished" podID="12293e33-dc6c-4153-a5c0-879e0bb44bed" containerID="ea4e8ec9736cefdea38da0f33fa957c15d5511030e863966b6593d6c74c46143" exitCode=0 Jul 22 21:07:18.396423 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.396326 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" event={"ID":"12293e33-dc6c-4153-a5c0-879e0bb44bed","Type":"ContainerDied","Data":"ea4e8ec9736cefdea38da0f33fa957c15d5511030e863966b6593d6c74c46143"} Jul 22 21:07:18.396423 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.396390 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" event={"ID":"12293e33-dc6c-4153-a5c0-879e0bb44bed","Type":"ContainerStarted","Data":"4b2682d4d4a024e7ff56fda9826b35148695ffb56385b307beab17759a1816be"} Jul 22 21:07:18.398697 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.398675 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:18.398795 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.398722 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncs5k\" (UniqueName: \"kubernetes.io/projected/0341874a-7644-4eb7-a413-9a3ad6763442-kube-api-access-ncs5k\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:18.398795 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.398749 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:18.443185 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.443158 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz"] Jul 22 21:07:18.444178 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:07:18.444152 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e59d299_3730_45e6_8818_861a3b1636d3.slice/crio-6cff3a6496714e64e183dae616f30dac530aeed8bf5978430f1458e95d374035 WatchSource:0}: Error finding container 6cff3a6496714e64e183dae616f30dac530aeed8bf5978430f1458e95d374035: Status 404 returned error can't find the container with id 6cff3a6496714e64e183dae616f30dac530aeed8bf5978430f1458e95d374035 Jul 22 21:07:18.499777 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.499743 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncs5k\" (UniqueName: \"kubernetes.io/projected/0341874a-7644-4eb7-a413-9a3ad6763442-kube-api-access-ncs5k\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:18.500224 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.499784 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:18.500224 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.499937 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:18.500224 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.500209 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:18.500404 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.500253 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:18.508747 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.508723 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncs5k\" (UniqueName: \"kubernetes.io/projected/0341874a-7644-4eb7-a413-9a3ad6763442-kube-api-access-ncs5k\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:18.547360 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.547308 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:18.696166 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:18.696132 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc"] Jul 22 21:07:18.699201 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:07:18.699173 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0341874a_7644_4eb7_a413_9a3ad6763442.slice/crio-13ac2d74e8826ae917b7276fd54d25cd81f5c89c96a2c6ab2f7299622b75f09e WatchSource:0}: Error finding container 13ac2d74e8826ae917b7276fd54d25cd81f5c89c96a2c6ab2f7299622b75f09e: Status 404 returned error can't find the container with id 13ac2d74e8826ae917b7276fd54d25cd81f5c89c96a2c6ab2f7299622b75f09e Jul 22 21:07:19.404387 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:19.404355 2557 generic.go:356] "Generic (PLEG): container finished" podID="0341874a-7644-4eb7-a413-9a3ad6763442" containerID="a39c675c6c02fcbff7cfeec2df527b5762618e86a12d0994ce1e133fdc0ec70f" exitCode=0 Jul 22 21:07:19.404500 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:19.404419 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" event={"ID":"0341874a-7644-4eb7-a413-9a3ad6763442","Type":"ContainerDied","Data":"a39c675c6c02fcbff7cfeec2df527b5762618e86a12d0994ce1e133fdc0ec70f"} Jul 22 21:07:19.404572 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:19.404504 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" event={"ID":"0341874a-7644-4eb7-a413-9a3ad6763442","Type":"ContainerStarted","Data":"13ac2d74e8826ae917b7276fd54d25cd81f5c89c96a2c6ab2f7299622b75f09e"} Jul 22 21:07:19.406511 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:19.406486 2557 generic.go:356] "Generic (PLEG): container finished" podID="07ecf2e0-3880-4209-a5f4-23ab23286b72" containerID="cc91f41b45f4467ada35bfb08a5c87ca3c8e059f239e801bdf1a1a31db50f221" exitCode=0 Jul 22 21:07:19.406611 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:19.406576 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" event={"ID":"07ecf2e0-3880-4209-a5f4-23ab23286b72","Type":"ContainerDied","Data":"cc91f41b45f4467ada35bfb08a5c87ca3c8e059f239e801bdf1a1a31db50f221"} Jul 22 21:07:19.408769 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:19.408747 2557 generic.go:356] "Generic (PLEG): container finished" podID="1e59d299-3730-45e6-8818-861a3b1636d3" containerID="9ddcbd728f7028b90f73918ba039705ae2bbaf8797c41b686abcf3b819f93cd7" exitCode=0 Jul 22 21:07:19.408868 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:19.408782 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" event={"ID":"1e59d299-3730-45e6-8818-861a3b1636d3","Type":"ContainerDied","Data":"9ddcbd728f7028b90f73918ba039705ae2bbaf8797c41b686abcf3b819f93cd7"} Jul 22 21:07:19.408868 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:19.408818 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" event={"ID":"1e59d299-3730-45e6-8818-861a3b1636d3","Type":"ContainerStarted","Data":"6cff3a6496714e64e183dae616f30dac530aeed8bf5978430f1458e95d374035"} Jul 22 21:07:20.423245 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:20.423208 2557 generic.go:356] "Generic (PLEG): container finished" podID="12293e33-dc6c-4153-a5c0-879e0bb44bed" containerID="438317c612391a0f7b95e5c4ce9a0096ad60233c2bc3f3b8981d6b5004cb921f" exitCode=0 Jul 22 21:07:20.423693 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:20.423265 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" event={"ID":"12293e33-dc6c-4153-a5c0-879e0bb44bed","Type":"ContainerDied","Data":"438317c612391a0f7b95e5c4ce9a0096ad60233c2bc3f3b8981d6b5004cb921f"} Jul 22 21:07:20.425187 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:20.425161 2557 generic.go:356] "Generic (PLEG): container finished" podID="0341874a-7644-4eb7-a413-9a3ad6763442" containerID="13769b61882787e5c0fe6f3014ab7fff0a07b8b07a1c2b0ac914a451f078cfe9" exitCode=0 Jul 22 21:07:20.425289 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:20.425241 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" event={"ID":"0341874a-7644-4eb7-a413-9a3ad6763442","Type":"ContainerDied","Data":"13769b61882787e5c0fe6f3014ab7fff0a07b8b07a1c2b0ac914a451f078cfe9"} Jul 22 21:07:20.427233 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:20.427211 2557 generic.go:356] "Generic (PLEG): container finished" podID="07ecf2e0-3880-4209-a5f4-23ab23286b72" containerID="ee830c84730806bace9181783723bcd28a9ba240c1b6ab583aa1ff39b98f9241" exitCode=0 Jul 22 21:07:20.427308 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:20.427251 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" event={"ID":"07ecf2e0-3880-4209-a5f4-23ab23286b72","Type":"ContainerDied","Data":"ee830c84730806bace9181783723bcd28a9ba240c1b6ab583aa1ff39b98f9241"} Jul 22 21:07:21.434287 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.434242 2557 generic.go:356] "Generic (PLEG): container finished" podID="1e59d299-3730-45e6-8818-861a3b1636d3" containerID="790e22e815f32183c7c66a9bbf689a12ebef6e87366b7902c3dd05fd74fe805a" exitCode=0 Jul 22 21:07:21.434772 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.434309 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" event={"ID":"1e59d299-3730-45e6-8818-861a3b1636d3","Type":"ContainerDied","Data":"790e22e815f32183c7c66a9bbf689a12ebef6e87366b7902c3dd05fd74fe805a"} Jul 22 21:07:21.436665 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.436637 2557 generic.go:356] "Generic (PLEG): container finished" podID="12293e33-dc6c-4153-a5c0-879e0bb44bed" containerID="647428e20531b702d25274492dadf0068a1d5d01f80afa48e59827ba32c1850c" exitCode=0 Jul 22 21:07:21.436787 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.436761 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" event={"ID":"12293e33-dc6c-4153-a5c0-879e0bb44bed","Type":"ContainerDied","Data":"647428e20531b702d25274492dadf0068a1d5d01f80afa48e59827ba32c1850c"} Jul 22 21:07:21.438842 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.438814 2557 generic.go:356] "Generic (PLEG): container finished" podID="0341874a-7644-4eb7-a413-9a3ad6763442" containerID="878e5a859fb00a115dc840dcad4dc294c031d1f918384520cd1deee433f91ced" exitCode=0 Jul 22 21:07:21.438951 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.438900 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" event={"ID":"0341874a-7644-4eb7-a413-9a3ad6763442","Type":"ContainerDied","Data":"878e5a859fb00a115dc840dcad4dc294c031d1f918384520cd1deee433f91ced"} Jul 22 21:07:21.586013 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.585254 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:21.630248 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.630215 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r892n\" (UniqueName: \"kubernetes.io/projected/07ecf2e0-3880-4209-a5f4-23ab23286b72-kube-api-access-r892n\") pod \"07ecf2e0-3880-4209-a5f4-23ab23286b72\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " Jul 22 21:07:21.630414 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.630348 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-bundle\") pod \"07ecf2e0-3880-4209-a5f4-23ab23286b72\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " Jul 22 21:07:21.630414 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.630367 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-util\") pod \"07ecf2e0-3880-4209-a5f4-23ab23286b72\" (UID: \"07ecf2e0-3880-4209-a5f4-23ab23286b72\") " Jul 22 21:07:21.630919 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.630889 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-bundle" (OuterVolumeSpecName: "bundle") pod "07ecf2e0-3880-4209-a5f4-23ab23286b72" (UID: "07ecf2e0-3880-4209-a5f4-23ab23286b72"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:07:21.632565 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.632538 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07ecf2e0-3880-4209-a5f4-23ab23286b72-kube-api-access-r892n" (OuterVolumeSpecName: "kube-api-access-r892n") pod "07ecf2e0-3880-4209-a5f4-23ab23286b72" (UID: "07ecf2e0-3880-4209-a5f4-23ab23286b72"). InnerVolumeSpecName "kube-api-access-r892n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:07:21.635986 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.635951 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-util" (OuterVolumeSpecName: "util") pod "07ecf2e0-3880-4209-a5f4-23ab23286b72" (UID: "07ecf2e0-3880-4209-a5f4-23ab23286b72"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:07:21.663761 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.663728 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:21.663910 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.663794 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:21.668473 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.668415 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:21.731612 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.731568 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:21.731612 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.731607 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ecf2e0-3880-4209-a5f4-23ab23286b72-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:21.731903 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:21.731623 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r892n\" (UniqueName: \"kubernetes.io/projected/07ecf2e0-3880-4209-a5f4-23ab23286b72-kube-api-access-r892n\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:22.446550 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.446517 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" Jul 22 21:07:22.447028 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.446513 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf" event={"ID":"07ecf2e0-3880-4209-a5f4-23ab23286b72","Type":"ContainerDied","Data":"685f25492ce6329917bbb275a5a57fd1961ea9a1b7cd3b3d87c00969c751a0fb"} Jul 22 21:07:22.447028 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.446642 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="685f25492ce6329917bbb275a5a57fd1961ea9a1b7cd3b3d87c00969c751a0fb" Jul 22 21:07:22.448799 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.448769 2557 generic.go:356] "Generic (PLEG): container finished" podID="1e59d299-3730-45e6-8818-861a3b1636d3" containerID="9914ebdd951e786018241a9c908f386b1268002d5a37b1eeff58c84630eeb977" exitCode=0 Jul 22 21:07:22.448946 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.448842 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" event={"ID":"1e59d299-3730-45e6-8818-861a3b1636d3","Type":"ContainerDied","Data":"9914ebdd951e786018241a9c908f386b1268002d5a37b1eeff58c84630eeb977"} Jul 22 21:07:22.453529 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.453504 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ff7d68bdd-nbdct" Jul 22 21:07:22.522325 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.520666 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754fb4c769-5gmsd"] Jul 22 21:07:22.627265 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.627231 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:22.639746 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.639717 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-util\") pod \"0341874a-7644-4eb7-a413-9a3ad6763442\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " Jul 22 21:07:22.639886 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.639762 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-bundle\") pod \"0341874a-7644-4eb7-a413-9a3ad6763442\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " Jul 22 21:07:22.639886 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.639867 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncs5k\" (UniqueName: \"kubernetes.io/projected/0341874a-7644-4eb7-a413-9a3ad6763442-kube-api-access-ncs5k\") pod \"0341874a-7644-4eb7-a413-9a3ad6763442\" (UID: \"0341874a-7644-4eb7-a413-9a3ad6763442\") " Jul 22 21:07:22.640297 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.640275 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-bundle" (OuterVolumeSpecName: "bundle") pod "0341874a-7644-4eb7-a413-9a3ad6763442" (UID: "0341874a-7644-4eb7-a413-9a3ad6763442"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:07:22.642125 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.642100 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0341874a-7644-4eb7-a413-9a3ad6763442-kube-api-access-ncs5k" (OuterVolumeSpecName: "kube-api-access-ncs5k") pod "0341874a-7644-4eb7-a413-9a3ad6763442" (UID: "0341874a-7644-4eb7-a413-9a3ad6763442"). InnerVolumeSpecName "kube-api-access-ncs5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:07:22.647545 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.647499 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-util" (OuterVolumeSpecName: "util") pod "0341874a-7644-4eb7-a413-9a3ad6763442" (UID: "0341874a-7644-4eb7-a413-9a3ad6763442"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:07:22.653222 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.653192 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:22.741034 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.740991 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-util\") pod \"12293e33-dc6c-4153-a5c0-879e0bb44bed\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " Jul 22 21:07:22.741034 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.741034 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-bundle\") pod \"12293e33-dc6c-4153-a5c0-879e0bb44bed\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " Jul 22 21:07:22.741241 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.741092 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqm5m\" (UniqueName: \"kubernetes.io/projected/12293e33-dc6c-4153-a5c0-879e0bb44bed-kube-api-access-qqm5m\") pod \"12293e33-dc6c-4153-a5c0-879e0bb44bed\" (UID: \"12293e33-dc6c-4153-a5c0-879e0bb44bed\") " Jul 22 21:07:22.741302 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.741262 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncs5k\" (UniqueName: \"kubernetes.io/projected/0341874a-7644-4eb7-a413-9a3ad6763442-kube-api-access-ncs5k\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:22.741302 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.741281 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:22.741302 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.741293 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0341874a-7644-4eb7-a413-9a3ad6763442-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:22.741558 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.741533 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-bundle" (OuterVolumeSpecName: "bundle") pod "12293e33-dc6c-4153-a5c0-879e0bb44bed" (UID: "12293e33-dc6c-4153-a5c0-879e0bb44bed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:07:22.743393 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.743362 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12293e33-dc6c-4153-a5c0-879e0bb44bed-kube-api-access-qqm5m" (OuterVolumeSpecName: "kube-api-access-qqm5m") pod "12293e33-dc6c-4153-a5c0-879e0bb44bed" (UID: "12293e33-dc6c-4153-a5c0-879e0bb44bed"). InnerVolumeSpecName "kube-api-access-qqm5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:07:22.746723 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.746700 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-util" (OuterVolumeSpecName: "util") pod "12293e33-dc6c-4153-a5c0-879e0bb44bed" (UID: "12293e33-dc6c-4153-a5c0-879e0bb44bed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:07:22.842182 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.842146 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqm5m\" (UniqueName: \"kubernetes.io/projected/12293e33-dc6c-4153-a5c0-879e0bb44bed-kube-api-access-qqm5m\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:22.842182 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.842179 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:22.842386 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:22.842193 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12293e33-dc6c-4153-a5c0-879e0bb44bed-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:23.456626 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.456596 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" Jul 22 21:07:23.457061 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.456622 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s" event={"ID":"12293e33-dc6c-4153-a5c0-879e0bb44bed","Type":"ContainerDied","Data":"4b2682d4d4a024e7ff56fda9826b35148695ffb56385b307beab17759a1816be"} Jul 22 21:07:23.457061 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.456718 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b2682d4d4a024e7ff56fda9826b35148695ffb56385b307beab17759a1816be" Jul 22 21:07:23.458872 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.458849 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" Jul 22 21:07:23.458997 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.458930 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc" event={"ID":"0341874a-7644-4eb7-a413-9a3ad6763442","Type":"ContainerDied","Data":"13ac2d74e8826ae917b7276fd54d25cd81f5c89c96a2c6ab2f7299622b75f09e"} Jul 22 21:07:23.458997 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.458976 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13ac2d74e8826ae917b7276fd54d25cd81f5c89c96a2c6ab2f7299622b75f09e" Jul 22 21:07:23.599665 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.599630 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:23.648924 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.648890 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkdxt\" (UniqueName: \"kubernetes.io/projected/1e59d299-3730-45e6-8818-861a3b1636d3-kube-api-access-lkdxt\") pod \"1e59d299-3730-45e6-8818-861a3b1636d3\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " Jul 22 21:07:23.649093 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.648954 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-util\") pod \"1e59d299-3730-45e6-8818-861a3b1636d3\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " Jul 22 21:07:23.649093 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.648984 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-bundle\") pod \"1e59d299-3730-45e6-8818-861a3b1636d3\" (UID: \"1e59d299-3730-45e6-8818-861a3b1636d3\") " Jul 22 21:07:23.649571 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.649540 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-bundle" (OuterVolumeSpecName: "bundle") pod "1e59d299-3730-45e6-8818-861a3b1636d3" (UID: "1e59d299-3730-45e6-8818-861a3b1636d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:07:23.651242 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.651217 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e59d299-3730-45e6-8818-861a3b1636d3-kube-api-access-lkdxt" (OuterVolumeSpecName: "kube-api-access-lkdxt") pod "1e59d299-3730-45e6-8818-861a3b1636d3" (UID: "1e59d299-3730-45e6-8818-861a3b1636d3"). InnerVolumeSpecName "kube-api-access-lkdxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:07:23.654284 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.654259 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-util" (OuterVolumeSpecName: "util") pod "1e59d299-3730-45e6-8818-861a3b1636d3" (UID: "1e59d299-3730-45e6-8818-861a3b1636d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:07:23.750529 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.750409 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkdxt\" (UniqueName: \"kubernetes.io/projected/1e59d299-3730-45e6-8818-861a3b1636d3-kube-api-access-lkdxt\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:23.750529 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.750478 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:23.750529 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:23.750489 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e59d299-3730-45e6-8818-861a3b1636d3-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:24.466991 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:24.466964 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" Jul 22 21:07:24.467378 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:24.467000 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz" event={"ID":"1e59d299-3730-45e6-8818-861a3b1636d3","Type":"ContainerDied","Data":"6cff3a6496714e64e183dae616f30dac530aeed8bf5978430f1458e95d374035"} Jul 22 21:07:24.467378 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:24.467048 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cff3a6496714e64e183dae616f30dac530aeed8bf5978430f1458e95d374035" Jul 22 21:07:32.803813 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.803776 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm"] Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804137 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12293e33-dc6c-4153-a5c0-879e0bb44bed" containerName="util" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804147 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="12293e33-dc6c-4153-a5c0-879e0bb44bed" containerName="util" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804156 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e59d299-3730-45e6-8818-861a3b1636d3" containerName="pull" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804162 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e59d299-3730-45e6-8818-861a3b1636d3" containerName="pull" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804170 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ecf2e0-3880-4209-a5f4-23ab23286b72" containerName="util" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804176 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ecf2e0-3880-4209-a5f4-23ab23286b72" containerName="util" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804184 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12293e33-dc6c-4153-a5c0-879e0bb44bed" containerName="extract" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804189 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="12293e33-dc6c-4153-a5c0-879e0bb44bed" containerName="extract" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804199 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0341874a-7644-4eb7-a413-9a3ad6763442" containerName="pull" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804203 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0341874a-7644-4eb7-a413-9a3ad6763442" containerName="pull" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804209 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e59d299-3730-45e6-8818-861a3b1636d3" containerName="util" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804213 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e59d299-3730-45e6-8818-861a3b1636d3" containerName="util" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804221 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0341874a-7644-4eb7-a413-9a3ad6763442" containerName="util" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804226 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0341874a-7644-4eb7-a413-9a3ad6763442" containerName="util" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804231 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0341874a-7644-4eb7-a413-9a3ad6763442" containerName="extract" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804235 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0341874a-7644-4eb7-a413-9a3ad6763442" containerName="extract" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804244 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ecf2e0-3880-4209-a5f4-23ab23286b72" containerName="pull" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804249 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ecf2e0-3880-4209-a5f4-23ab23286b72" containerName="pull" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804261 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12293e33-dc6c-4153-a5c0-879e0bb44bed" containerName="pull" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804267 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="12293e33-dc6c-4153-a5c0-879e0bb44bed" containerName="pull" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804274 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ecf2e0-3880-4209-a5f4-23ab23286b72" containerName="extract" Jul 22 21:07:32.804269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804279 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ecf2e0-3880-4209-a5f4-23ab23286b72" containerName="extract" Jul 22 21:07:32.804959 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804284 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e59d299-3730-45e6-8818-861a3b1636d3" containerName="extract" Jul 22 21:07:32.804959 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804289 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e59d299-3730-45e6-8818-861a3b1636d3" containerName="extract" Jul 22 21:07:32.804959 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804355 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="07ecf2e0-3880-4209-a5f4-23ab23286b72" containerName="extract" Jul 22 21:07:32.804959 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804362 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0341874a-7644-4eb7-a413-9a3ad6763442" containerName="extract" Jul 22 21:07:32.804959 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804369 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="12293e33-dc6c-4153-a5c0-879e0bb44bed" containerName="extract" Jul 22 21:07:32.804959 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.804373 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e59d299-3730-45e6-8818-861a3b1636d3" containerName="extract" Jul 22 21:07:32.808623 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.808606 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm" Jul 22 21:07:32.811381 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.811357 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 22 21:07:32.811516 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.811478 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bxdjz\"" Jul 22 21:07:32.819231 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.819205 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm"] Jul 22 21:07:32.831355 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.831323 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbcld\" (UniqueName: \"kubernetes.io/projected/ed826065-7e17-44f5-ad1d-26bc8cf21bc3-kube-api-access-pbcld\") pod \"dns-operator-controller-manager-864dd78c4c-6nrvm\" (UID: \"ed826065-7e17-44f5-ad1d-26bc8cf21bc3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm" Jul 22 21:07:32.932564 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.932526 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbcld\" (UniqueName: \"kubernetes.io/projected/ed826065-7e17-44f5-ad1d-26bc8cf21bc3-kube-api-access-pbcld\") pod \"dns-operator-controller-manager-864dd78c4c-6nrvm\" (UID: \"ed826065-7e17-44f5-ad1d-26bc8cf21bc3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm" Jul 22 21:07:32.949401 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:32.949365 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbcld\" (UniqueName: \"kubernetes.io/projected/ed826065-7e17-44f5-ad1d-26bc8cf21bc3-kube-api-access-pbcld\") pod \"dns-operator-controller-manager-864dd78c4c-6nrvm\" (UID: \"ed826065-7e17-44f5-ad1d-26bc8cf21bc3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm" Jul 22 21:07:33.119573 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:33.119530 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm" Jul 22 21:07:33.265618 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:33.265584 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm"] Jul 22 21:07:33.267188 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:07:33.267163 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded826065_7e17_44f5_ad1d_26bc8cf21bc3.slice/crio-89c0d07a37efcf14b5eee94748f4d736afecc30133c7ef2622c7710d5bbcc980 WatchSource:0}: Error finding container 89c0d07a37efcf14b5eee94748f4d736afecc30133c7ef2622c7710d5bbcc980: Status 404 returned error can't find the container with id 89c0d07a37efcf14b5eee94748f4d736afecc30133c7ef2622c7710d5bbcc980 Jul 22 21:07:33.520848 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:33.520752 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm" event={"ID":"ed826065-7e17-44f5-ad1d-26bc8cf21bc3","Type":"ContainerStarted","Data":"89c0d07a37efcf14b5eee94748f4d736afecc30133c7ef2622c7710d5bbcc980"} Jul 22 21:07:35.533598 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:35.533558 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm" event={"ID":"ed826065-7e17-44f5-ad1d-26bc8cf21bc3","Type":"ContainerStarted","Data":"08df6468cf04c63bf6b55a9153e3b8a1f3a8178810320cacdac6fe012b4d4178"} Jul 22 21:07:35.534002 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:35.533663 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm" Jul 22 21:07:35.561754 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:35.561698 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm" podStartSLOduration=1.480022895 podStartE2EDuration="3.56168034s" totalImagesPullingTime="2.081657445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:07:35.558676731 +0000 UTC m=+639.098185032" watchObservedRunningTime="2026-07-22 21:07:35.56168034 +0000 UTC m=+639.101188641" Jul 22 21:07:41.129425 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:41.129383 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92"] Jul 22 21:07:41.137118 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:41.137088 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:41.139915 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:41.139883 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6r8fg\"" Jul 22 21:07:41.145662 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:41.145634 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92"] Jul 22 21:07:41.215326 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:41.215269 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp7fs\" (UniqueName: \"kubernetes.io/projected/77e5fed6-14f3-467e-819f-296ca266f9e3-kube-api-access-vp7fs\") pod \"limitador-operator-controller-manager-859d7b78bd-49n92\" (UID: \"77e5fed6-14f3-467e-819f-296ca266f9e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:41.316212 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:41.316171 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp7fs\" (UniqueName: \"kubernetes.io/projected/77e5fed6-14f3-467e-819f-296ca266f9e3-kube-api-access-vp7fs\") pod \"limitador-operator-controller-manager-859d7b78bd-49n92\" (UID: \"77e5fed6-14f3-467e-819f-296ca266f9e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:41.326999 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:41.326956 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp7fs\" (UniqueName: \"kubernetes.io/projected/77e5fed6-14f3-467e-819f-296ca266f9e3-kube-api-access-vp7fs\") pod \"limitador-operator-controller-manager-859d7b78bd-49n92\" (UID: \"77e5fed6-14f3-467e-819f-296ca266f9e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:41.449969 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:41.449871 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:41.602903 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:41.602873 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92"] Jul 22 21:07:41.604656 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:07:41.604621 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e5fed6_14f3_467e_819f_296ca266f9e3.slice/crio-d3373283f9267f1e94211070e34b095fa6cab72e6060f30619939cfdfc4371c6 WatchSource:0}: Error finding container d3373283f9267f1e94211070e34b095fa6cab72e6060f30619939cfdfc4371c6: Status 404 returned error can't find the container with id d3373283f9267f1e94211070e34b095fa6cab72e6060f30619939cfdfc4371c6 Jul 22 21:07:42.575355 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:42.575280 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" event={"ID":"77e5fed6-14f3-467e-819f-296ca266f9e3","Type":"ContainerStarted","Data":"d3373283f9267f1e94211070e34b095fa6cab72e6060f30619939cfdfc4371c6"} Jul 22 21:07:44.590362 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:44.590326 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" event={"ID":"77e5fed6-14f3-467e-819f-296ca266f9e3","Type":"ContainerStarted","Data":"4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8"} Jul 22 21:07:44.590854 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:44.590413 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:44.611025 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:44.610972 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" podStartSLOduration=1.465770226 podStartE2EDuration="3.610952208s" totalImagesPullingTime="2.145181982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:07:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:07:44.610457239 +0000 UTC m=+648.149965533" watchObservedRunningTime="2026-07-22 21:07:44.610952208 +0000 UTC m=+648.150460512" Jul 22 21:07:46.541946 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:46.541912 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6nrvm" Jul 22 21:07:47.556688 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.556644 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-754fb4c769-5gmsd" podUID="fa7168e2-b482-4540-bf14-503c20f8f27f" containerName="console" containerID="cri-o://411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d" gracePeriod=15 Jul 22 21:07:47.818056 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.817986 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:07:47.886964 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.886929 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-oauth-config\") pod \"fa7168e2-b482-4540-bf14-503c20f8f27f\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " Jul 22 21:07:47.887149 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.886996 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-serving-cert\") pod \"fa7168e2-b482-4540-bf14-503c20f8f27f\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " Jul 22 21:07:47.887149 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.887018 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-trusted-ca-bundle\") pod \"fa7168e2-b482-4540-bf14-503c20f8f27f\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " Jul 22 21:07:47.887149 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.887061 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-console-config\") pod \"fa7168e2-b482-4540-bf14-503c20f8f27f\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " Jul 22 21:07:47.887149 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.887077 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-oauth-serving-cert\") pod \"fa7168e2-b482-4540-bf14-503c20f8f27f\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " Jul 22 21:07:47.887149 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.887112 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbbkq\" (UniqueName: \"kubernetes.io/projected/fa7168e2-b482-4540-bf14-503c20f8f27f-kube-api-access-gbbkq\") pod \"fa7168e2-b482-4540-bf14-503c20f8f27f\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " Jul 22 21:07:47.887409 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.887189 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-service-ca\") pod \"fa7168e2-b482-4540-bf14-503c20f8f27f\" (UID: \"fa7168e2-b482-4540-bf14-503c20f8f27f\") " Jul 22 21:07:47.887525 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.887497 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fa7168e2-b482-4540-bf14-503c20f8f27f" (UID: "fa7168e2-b482-4540-bf14-503c20f8f27f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:07:47.887592 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.887531 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-console-config" (OuterVolumeSpecName: "console-config") pod "fa7168e2-b482-4540-bf14-503c20f8f27f" (UID: "fa7168e2-b482-4540-bf14-503c20f8f27f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:07:47.887788 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.887752 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-service-ca" (OuterVolumeSpecName: "service-ca") pod "fa7168e2-b482-4540-bf14-503c20f8f27f" (UID: "fa7168e2-b482-4540-bf14-503c20f8f27f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:07:47.887788 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.887776 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fa7168e2-b482-4540-bf14-503c20f8f27f" (UID: "fa7168e2-b482-4540-bf14-503c20f8f27f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:07:47.889378 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.889357 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fa7168e2-b482-4540-bf14-503c20f8f27f" (UID: "fa7168e2-b482-4540-bf14-503c20f8f27f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 21:07:47.889560 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.889539 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa7168e2-b482-4540-bf14-503c20f8f27f-kube-api-access-gbbkq" (OuterVolumeSpecName: "kube-api-access-gbbkq") pod "fa7168e2-b482-4540-bf14-503c20f8f27f" (UID: "fa7168e2-b482-4540-bf14-503c20f8f27f"). InnerVolumeSpecName "kube-api-access-gbbkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:07:47.889560 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.889551 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fa7168e2-b482-4540-bf14-503c20f8f27f" (UID: "fa7168e2-b482-4540-bf14-503c20f8f27f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 21:07:47.988683 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.988641 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-console-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:47.988683 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.988681 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-oauth-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:47.988907 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.988696 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbbkq\" (UniqueName: \"kubernetes.io/projected/fa7168e2-b482-4540-bf14-503c20f8f27f-kube-api-access-gbbkq\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:47.988907 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.988711 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:47.988907 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.988726 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-oauth-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:47.988907 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.988739 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa7168e2-b482-4540-bf14-503c20f8f27f-console-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:47.988907 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:47.988753 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa7168e2-b482-4540-bf14-503c20f8f27f-trusted-ca-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:48.614068 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:48.614026 2557 generic.go:356] "Generic (PLEG): container finished" podID="fa7168e2-b482-4540-bf14-503c20f8f27f" containerID="411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d" exitCode=0 Jul 22 21:07:48.614576 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:48.614077 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754fb4c769-5gmsd" Jul 22 21:07:48.614576 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:48.614086 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754fb4c769-5gmsd" event={"ID":"fa7168e2-b482-4540-bf14-503c20f8f27f","Type":"ContainerDied","Data":"411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d"} Jul 22 21:07:48.614576 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:48.614134 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754fb4c769-5gmsd" event={"ID":"fa7168e2-b482-4540-bf14-503c20f8f27f","Type":"ContainerDied","Data":"97f33fa91166230546ead5ff1c5e68976f21ded685be5be041c1386c0725980a"} Jul 22 21:07:48.614576 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:48.614155 2557 scope.go:117] "RemoveContainer" containerID="411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d" Jul 22 21:07:48.624300 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:48.624276 2557 scope.go:117] "RemoveContainer" containerID="411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d" Jul 22 21:07:48.624634 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:07:48.624604 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d\": container with ID starting with 411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d not found: ID does not exist" containerID="411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d" Jul 22 21:07:48.624687 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:48.624645 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d"} err="failed to get container status \"411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d\": rpc error: code = NotFound desc = could not find container \"411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d\": container with ID starting with 411423526faba82afb34870ddbd9e7bd1bca9f0631fad763f431f858f83bd48d not found: ID does not exist" Jul 22 21:07:48.639430 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:48.639392 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754fb4c769-5gmsd"] Jul 22 21:07:48.648318 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:48.648288 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-754fb4c769-5gmsd"] Jul 22 21:07:48.874592 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:48.874511 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa7168e2-b482-4540-bf14-503c20f8f27f" path="/var/lib/kubelet/pods/fa7168e2-b482-4540-bf14-503c20f8f27f/volumes" Jul 22 21:07:55.598582 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:55.598551 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:58.100964 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.100928 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92"] Jul 22 21:07:58.101457 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.101181 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" podUID="77e5fed6-14f3-467e-819f-296ca266f9e3" containerName="manager" containerID="cri-o://4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8" gracePeriod=2 Jul 22 21:07:58.106259 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.106226 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd"] Jul 22 21:07:58.106676 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.106659 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa7168e2-b482-4540-bf14-503c20f8f27f" containerName="console" Jul 22 21:07:58.106676 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.106677 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa7168e2-b482-4540-bf14-503c20f8f27f" containerName="console" Jul 22 21:07:58.106809 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.106750 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa7168e2-b482-4540-bf14-503c20f8f27f" containerName="console" Jul 22 21:07:58.109657 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:07:58.109618 2557 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"77e5fed6-14f3-467e-819f-296ca266f9e3\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-49n92\": pods \"limitador-operator-controller-manager-859d7b78bd-49n92\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:58.111473 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.111450 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:07:58.111725 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.111539 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92"] Jul 22 21:07:58.114398 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.114377 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tj6rc\"" Jul 22 21:07:58.127567 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.127528 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd"] Jul 22 21:07:58.134101 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.134063 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn"] Jul 22 21:07:58.134564 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.134545 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77e5fed6-14f3-467e-819f-296ca266f9e3" containerName="manager" Jul 22 21:07:58.134626 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.134565 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="77e5fed6-14f3-467e-819f-296ca266f9e3" containerName="manager" Jul 22 21:07:58.134664 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.134625 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="77e5fed6-14f3-467e-819f-296ca266f9e3" containerName="manager" Jul 22 21:07:58.137847 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.137821 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn" Jul 22 21:07:58.144271 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:07:58.144232 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-49n92\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="77e5fed6-14f3-467e-819f-296ca266f9e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:58.151465 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.151417 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn"] Jul 22 21:07:58.166455 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:07:58.166388 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-49n92\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="77e5fed6-14f3-467e-819f-296ca266f9e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:58.286063 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.286024 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbvmg\" (UniqueName: \"kubernetes.io/projected/d1774e78-d26f-4168-b107-39e9ded66d46-kube-api-access-mbvmg\") pod \"limitador-operator-controller-manager-859d7b78bd-rkbfn\" (UID: \"d1774e78-d26f-4168-b107-39e9ded66d46\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn" Jul 22 21:07:58.286206 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.286082 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1833425d-0a5c-4c77-a568-d031469db2cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9p9pd\" (UID: \"1833425d-0a5c-4c77-a568-d031469db2cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:07:58.286294 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.286263 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7kn2\" (UniqueName: \"kubernetes.io/projected/1833425d-0a5c-4c77-a568-d031469db2cc-kube-api-access-l7kn2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9p9pd\" (UID: \"1833425d-0a5c-4c77-a568-d031469db2cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:07:58.351533 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.351452 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:58.353971 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:07:58.353940 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-49n92\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="77e5fed6-14f3-467e-819f-296ca266f9e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:58.386818 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.386776 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7kn2\" (UniqueName: \"kubernetes.io/projected/1833425d-0a5c-4c77-a568-d031469db2cc-kube-api-access-l7kn2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9p9pd\" (UID: \"1833425d-0a5c-4c77-a568-d031469db2cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:07:58.386991 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.386841 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvmg\" (UniqueName: \"kubernetes.io/projected/d1774e78-d26f-4168-b107-39e9ded66d46-kube-api-access-mbvmg\") pod \"limitador-operator-controller-manager-859d7b78bd-rkbfn\" (UID: \"d1774e78-d26f-4168-b107-39e9ded66d46\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn" Jul 22 21:07:58.386991 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.386868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1833425d-0a5c-4c77-a568-d031469db2cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9p9pd\" (UID: \"1833425d-0a5c-4c77-a568-d031469db2cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:07:58.387299 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.387275 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1833425d-0a5c-4c77-a568-d031469db2cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9p9pd\" (UID: \"1833425d-0a5c-4c77-a568-d031469db2cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:07:58.402027 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.401991 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7kn2\" (UniqueName: \"kubernetes.io/projected/1833425d-0a5c-4c77-a568-d031469db2cc-kube-api-access-l7kn2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9p9pd\" (UID: \"1833425d-0a5c-4c77-a568-d031469db2cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:07:58.402027 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.402013 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbvmg\" (UniqueName: \"kubernetes.io/projected/d1774e78-d26f-4168-b107-39e9ded66d46-kube-api-access-mbvmg\") pod \"limitador-operator-controller-manager-859d7b78bd-rkbfn\" (UID: \"d1774e78-d26f-4168-b107-39e9ded66d46\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn" Jul 22 21:07:58.482258 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.482208 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:07:58.487496 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.487466 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn" Jul 22 21:07:58.487654 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.487636 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp7fs\" (UniqueName: \"kubernetes.io/projected/77e5fed6-14f3-467e-819f-296ca266f9e3-kube-api-access-vp7fs\") pod \"77e5fed6-14f3-467e-819f-296ca266f9e3\" (UID: \"77e5fed6-14f3-467e-819f-296ca266f9e3\") " Jul 22 21:07:58.489880 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.489854 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77e5fed6-14f3-467e-819f-296ca266f9e3-kube-api-access-vp7fs" (OuterVolumeSpecName: "kube-api-access-vp7fs") pod "77e5fed6-14f3-467e-819f-296ca266f9e3" (UID: "77e5fed6-14f3-467e-819f-296ca266f9e3"). InnerVolumeSpecName "kube-api-access-vp7fs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:07:58.589326 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.589268 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp7fs\" (UniqueName: \"kubernetes.io/projected/77e5fed6-14f3-467e-819f-296ca266f9e3-kube-api-access-vp7fs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:07:58.636574 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.636546 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd"] Jul 22 21:07:58.640467 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:07:58.640417 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1833425d_0a5c_4c77_a568_d031469db2cc.slice/crio-e902646d5e0d3be181a065b41f137b610102d6c59131c40a590310559e3062a6 WatchSource:0}: Error finding container e902646d5e0d3be181a065b41f137b610102d6c59131c40a590310559e3062a6: Status 404 returned error can't find the container with id e902646d5e0d3be181a065b41f137b610102d6c59131c40a590310559e3062a6 Jul 22 21:07:58.662544 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.662514 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn"] Jul 22 21:07:58.663763 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:07:58.663736 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1774e78_d26f_4168_b107_39e9ded66d46.slice/crio-ccb6f1cccf0b8d44648d698b8660177c642988ed9990c14eaf9d5d935849fe4c WatchSource:0}: Error finding container ccb6f1cccf0b8d44648d698b8660177c642988ed9990c14eaf9d5d935849fe4c: Status 404 returned error can't find the container with id ccb6f1cccf0b8d44648d698b8660177c642988ed9990c14eaf9d5d935849fe4c Jul 22 21:07:58.676269 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.676246 2557 generic.go:356] "Generic (PLEG): container finished" podID="77e5fed6-14f3-467e-819f-296ca266f9e3" containerID="4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8" exitCode=0 Jul 22 21:07:58.676389 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.676308 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:58.676389 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.676334 2557 scope.go:117] "RemoveContainer" containerID="4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8" Jul 22 21:07:58.678068 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.678039 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" event={"ID":"1833425d-0a5c-4c77-a568-d031469db2cc","Type":"ContainerStarted","Data":"e902646d5e0d3be181a065b41f137b610102d6c59131c40a590310559e3062a6"} Jul 22 21:07:58.678683 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:07:58.678655 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-49n92\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="77e5fed6-14f3-467e-819f-296ca266f9e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:58.679602 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.679577 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn" event={"ID":"d1774e78-d26f-4168-b107-39e9ded66d46","Type":"ContainerStarted","Data":"ccb6f1cccf0b8d44648d698b8660177c642988ed9990c14eaf9d5d935849fe4c"} Jul 22 21:07:58.686741 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.686716 2557 scope.go:117] "RemoveContainer" containerID="4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8" Jul 22 21:07:58.687056 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:07:58.687037 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8\": container with ID starting with 4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8 not found: ID does not exist" containerID="4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8" Jul 22 21:07:58.687122 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.687066 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8"} err="failed to get container status \"4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8\": rpc error: code = NotFound desc = could not find container \"4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8\": container with ID starting with 4b27889237635c2423c9f09cfb4c645c1c8b82fb3d31fe972fffacba149531e8 not found: ID does not exist" Jul 22 21:07:58.688597 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:07:58.688567 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-49n92\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="77e5fed6-14f3-467e-819f-296ca266f9e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-49n92" Jul 22 21:07:58.874167 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:58.874082 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77e5fed6-14f3-467e-819f-296ca266f9e3" path="/var/lib/kubelet/pods/77e5fed6-14f3-467e-819f-296ca266f9e3/volumes" Jul 22 21:07:59.689121 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:59.689076 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn" event={"ID":"d1774e78-d26f-4168-b107-39e9ded66d46","Type":"ContainerStarted","Data":"ed2895b38d751340d846dfdbfe20c6e0f2dee1b4684a3a415597ec2be9db784e"} Jul 22 21:07:59.689575 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:59.689213 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn" Jul 22 21:07:59.712331 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:07:59.712257 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn" podStartSLOduration=1.7122416569999999 podStartE2EDuration="1.712241657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:07:59.710880588 +0000 UTC m=+663.250388891" watchObservedRunningTime="2026-07-22 21:07:59.712241657 +0000 UTC m=+663.251749958" Jul 22 21:08:03.716019 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:03.715983 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" event={"ID":"1833425d-0a5c-4c77-a568-d031469db2cc","Type":"ContainerStarted","Data":"3d5a26332451dfb91df93171f648de0c9a651e93e069c429a6beea7733acbdb5"} Jul 22 21:08:03.716648 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:03.716123 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:08:03.744559 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:03.744503 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" podStartSLOduration=1.121672707 podStartE2EDuration="5.744486785s" totalImagesPullingTime="4.622814078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:08:03.741607512 +0000 UTC m=+667.281115815" watchObservedRunningTime="2026-07-22 21:08:03.744486785 +0000 UTC m=+667.283995078" Jul 22 21:08:10.525313 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:10.525274 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd"] Jul 22 21:08:10.525906 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:10.525478 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" podUID="1833425d-0a5c-4c77-a568-d031469db2cc" containerName="manager" containerID="cri-o://3d5a26332451dfb91df93171f648de0c9a651e93e069c429a6beea7733acbdb5" gracePeriod=10 Jul 22 21:08:10.527053 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:10.527029 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:08:10.699365 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:10.699329 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rkbfn" Jul 22 21:08:10.759592 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:10.759562 2557 generic.go:356] "Generic (PLEG): container finished" podID="1833425d-0a5c-4c77-a568-d031469db2cc" containerID="3d5a26332451dfb91df93171f648de0c9a651e93e069c429a6beea7733acbdb5" exitCode=0 Jul 22 21:08:10.759751 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:10.759636 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" event={"ID":"1833425d-0a5c-4c77-a568-d031469db2cc","Type":"ContainerDied","Data":"3d5a26332451dfb91df93171f648de0c9a651e93e069c429a6beea7733acbdb5"} Jul 22 21:08:10.789092 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:10.789017 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:08:10.901178 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:10.901140 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7kn2\" (UniqueName: \"kubernetes.io/projected/1833425d-0a5c-4c77-a568-d031469db2cc-kube-api-access-l7kn2\") pod \"1833425d-0a5c-4c77-a568-d031469db2cc\" (UID: \"1833425d-0a5c-4c77-a568-d031469db2cc\") " Jul 22 21:08:10.901366 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:10.901192 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1833425d-0a5c-4c77-a568-d031469db2cc-extensions-socket-volume\") pod \"1833425d-0a5c-4c77-a568-d031469db2cc\" (UID: \"1833425d-0a5c-4c77-a568-d031469db2cc\") " Jul 22 21:08:10.901787 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:10.901740 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1833425d-0a5c-4c77-a568-d031469db2cc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1833425d-0a5c-4c77-a568-d031469db2cc" (UID: "1833425d-0a5c-4c77-a568-d031469db2cc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 21:08:10.903629 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:10.903599 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1833425d-0a5c-4c77-a568-d031469db2cc-kube-api-access-l7kn2" (OuterVolumeSpecName: "kube-api-access-l7kn2") pod "1833425d-0a5c-4c77-a568-d031469db2cc" (UID: "1833425d-0a5c-4c77-a568-d031469db2cc"). InnerVolumeSpecName "kube-api-access-l7kn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:08:11.002642 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:11.002602 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7kn2\" (UniqueName: \"kubernetes.io/projected/1833425d-0a5c-4c77-a568-d031469db2cc-kube-api-access-l7kn2\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:08:11.002642 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:11.002637 2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1833425d-0a5c-4c77-a568-d031469db2cc-extensions-socket-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:08:11.766779 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:11.766745 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" event={"ID":"1833425d-0a5c-4c77-a568-d031469db2cc","Type":"ContainerDied","Data":"e902646d5e0d3be181a065b41f137b610102d6c59131c40a590310559e3062a6"} Jul 22 21:08:11.767204 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:11.766809 2557 scope.go:117] "RemoveContainer" containerID="3d5a26332451dfb91df93171f648de0c9a651e93e069c429a6beea7733acbdb5" Jul 22 21:08:11.767204 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:11.766755 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd" Jul 22 21:08:11.798604 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:11.798560 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd"] Jul 22 21:08:11.802516 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:11.802484 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9p9pd"] Jul 22 21:08:12.874632 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:12.874601 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1833425d-0a5c-4c77-a568-d031469db2cc" path="/var/lib/kubelet/pods/1833425d-0a5c-4c77-a568-d031469db2cc/volumes" Jul 22 21:08:26.823921 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.823868 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm"] Jul 22 21:08:26.824537 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.824517 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1833425d-0a5c-4c77-a568-d031469db2cc" containerName="manager" Jul 22 21:08:26.824537 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.824539 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1833425d-0a5c-4c77-a568-d031469db2cc" containerName="manager" Jul 22 21:08:26.824696 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.824654 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1833425d-0a5c-4c77-a568-d031469db2cc" containerName="manager" Jul 22 21:08:26.827800 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.827774 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:26.830878 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.830857 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-phhhn\"" Jul 22 21:08:26.839549 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.839516 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm"] Jul 22 21:08:26.952922 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.952880 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:26.952922 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.952921 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5hcz\" (UniqueName: \"kubernetes.io/projected/f134018c-a35b-442e-8438-9d865b7a3535-kube-api-access-z5hcz\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:26.953151 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.952956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:26.953151 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.952973 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:26.953151 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.953072 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f134018c-a35b-442e-8438-9d865b7a3535-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:26.953151 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.953110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:26.953151 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.953147 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f134018c-a35b-442e-8438-9d865b7a3535-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:26.953412 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.953254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f134018c-a35b-442e-8438-9d865b7a3535-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:26.953412 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:26.953299 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.054252 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.054214 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f134018c-a35b-442e-8438-9d865b7a3535-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.054252 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.054257 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.054531 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.054282 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f134018c-a35b-442e-8438-9d865b7a3535-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.054531 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.054326 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f134018c-a35b-442e-8438-9d865b7a3535-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.054531 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.054356 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.054531 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.054409 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.054531 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.054468 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hcz\" (UniqueName: \"kubernetes.io/projected/f134018c-a35b-442e-8438-9d865b7a3535-kube-api-access-z5hcz\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.054799 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.054536 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.054799 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.054572 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.054899 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.054814 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.054899 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.054871 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.055100 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.055073 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f134018c-a35b-442e-8438-9d865b7a3535-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.055220 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.055117 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.055220 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.055133 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.057071 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.057046 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f134018c-a35b-442e-8438-9d865b7a3535-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.057230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.057212 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f134018c-a35b-442e-8438-9d865b7a3535-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.062212 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.062192 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5hcz\" (UniqueName: \"kubernetes.io/projected/f134018c-a35b-442e-8438-9d865b7a3535-kube-api-access-z5hcz\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.062321 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.062304 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f134018c-a35b-442e-8438-9d865b7a3535-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dzsxm\" (UID: \"f134018c-a35b-442e-8438-9d865b7a3535\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.140595 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.140559 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:27.290349 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.290312 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm"] Jul 22 21:08:27.292258 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:08:27.292231 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf134018c_a35b_442e_8438_9d865b7a3535.slice/crio-ab5260d13253c28fc6386cb442cdcf5eee4174872d491c8ac938857c3fb6f76d WatchSource:0}: Error finding container ab5260d13253c28fc6386cb442cdcf5eee4174872d491c8ac938857c3fb6f76d: Status 404 returned error can't find the container with id ab5260d13253c28fc6386cb442cdcf5eee4174872d491c8ac938857c3fb6f76d Jul 22 21:08:27.294543 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.294511 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 22 21:08:27.294618 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.294577 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 22 21:08:27.294618 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.294606 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 22 21:08:27.856428 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.856389 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" event={"ID":"f134018c-a35b-442e-8438-9d865b7a3535","Type":"ContainerStarted","Data":"494218b17dad68e555237e9fef2eacdb45707ce78d7477e74029152dffe412a4"} Jul 22 21:08:27.856936 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.856456 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" event={"ID":"f134018c-a35b-442e-8438-9d865b7a3535","Type":"ContainerStarted","Data":"ab5260d13253c28fc6386cb442cdcf5eee4174872d491c8ac938857c3fb6f76d"} Jul 22 21:08:27.876897 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:27.876810 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" podStartSLOduration=1.876787777 podStartE2EDuration="1.876787777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:08:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:08:27.876172185 +0000 UTC m=+691.415680500" watchObservedRunningTime="2026-07-22 21:08:27.876787777 +0000 UTC m=+691.416296080" Jul 22 21:08:28.141455 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:28.141352 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:28.146190 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:28.146162 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:28.862892 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:28.862858 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:28.863851 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:28.863832 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:08:29.256967 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.256868 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:08:29.260616 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.260592 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" Jul 22 21:08:29.262898 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.262869 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 22 21:08:29.263114 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.263099 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vnlkb\"" Jul 22 21:08:29.270406 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.270382 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:08:29.302559 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.302066 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:08:29.376759 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.376718 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf9hx\" (UniqueName: \"kubernetes.io/projected/954c9240-b8e5-4e73-aabf-ed252e8420b3-kube-api-access-tf9hx\") pod \"limitador-limitador-54d6d988d5-d46wh\" (UID: \"954c9240-b8e5-4e73-aabf-ed252e8420b3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" Jul 22 21:08:29.376943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.376856 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/954c9240-b8e5-4e73-aabf-ed252e8420b3-config-file\") pod \"limitador-limitador-54d6d988d5-d46wh\" (UID: \"954c9240-b8e5-4e73-aabf-ed252e8420b3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" Jul 22 21:08:29.477584 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.477532 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/954c9240-b8e5-4e73-aabf-ed252e8420b3-config-file\") pod \"limitador-limitador-54d6d988d5-d46wh\" (UID: \"954c9240-b8e5-4e73-aabf-ed252e8420b3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" Jul 22 21:08:29.477815 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.477617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf9hx\" (UniqueName: \"kubernetes.io/projected/954c9240-b8e5-4e73-aabf-ed252e8420b3-kube-api-access-tf9hx\") pod \"limitador-limitador-54d6d988d5-d46wh\" (UID: \"954c9240-b8e5-4e73-aabf-ed252e8420b3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" Jul 22 21:08:29.478280 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.478252 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/954c9240-b8e5-4e73-aabf-ed252e8420b3-config-file\") pod \"limitador-limitador-54d6d988d5-d46wh\" (UID: \"954c9240-b8e5-4e73-aabf-ed252e8420b3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" Jul 22 21:08:29.486814 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.486786 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf9hx\" (UniqueName: \"kubernetes.io/projected/954c9240-b8e5-4e73-aabf-ed252e8420b3-kube-api-access-tf9hx\") pod \"limitador-limitador-54d6d988d5-d46wh\" (UID: \"954c9240-b8e5-4e73-aabf-ed252e8420b3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" Jul 22 21:08:29.573043 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.572937 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" Jul 22 21:08:29.696759 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.696724 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-v9rv5"] Jul 22 21:08:29.701230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.701202 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v9rv5" Jul 22 21:08:29.703805 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.703776 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kh4qg\"" Jul 22 21:08:29.705425 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.705396 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-v9rv5"] Jul 22 21:08:29.722222 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.722193 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:08:29.725709 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:08:29.725678 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod954c9240_b8e5_4e73_aabf_ed252e8420b3.slice/crio-110fc9859a1471a0b600acf8fd675a9901d8ec31022bbe21589a0c6ef5ab0da2 WatchSource:0}: Error finding container 110fc9859a1471a0b600acf8fd675a9901d8ec31022bbe21589a0c6ef5ab0da2: Status 404 returned error can't find the container with id 110fc9859a1471a0b600acf8fd675a9901d8ec31022bbe21589a0c6ef5ab0da2 Jul 22 21:08:29.780241 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.780199 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js948\" (UniqueName: \"kubernetes.io/projected/62d46152-b2cb-43d3-8fbb-4c084f8659c4-kube-api-access-js948\") pod \"authorino-58cd955675-v9rv5\" (UID: \"62d46152-b2cb-43d3-8fbb-4c084f8659c4\") " pod="kuadrant-system/authorino-58cd955675-v9rv5" Jul 22 21:08:29.870006 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.869971 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" event={"ID":"954c9240-b8e5-4e73-aabf-ed252e8420b3","Type":"ContainerStarted","Data":"110fc9859a1471a0b600acf8fd675a9901d8ec31022bbe21589a0c6ef5ab0da2"} Jul 22 21:08:29.881679 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.881630 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js948\" (UniqueName: \"kubernetes.io/projected/62d46152-b2cb-43d3-8fbb-4c084f8659c4-kube-api-access-js948\") pod \"authorino-58cd955675-v9rv5\" (UID: \"62d46152-b2cb-43d3-8fbb-4c084f8659c4\") " pod="kuadrant-system/authorino-58cd955675-v9rv5" Jul 22 21:08:29.892312 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:29.892282 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js948\" (UniqueName: \"kubernetes.io/projected/62d46152-b2cb-43d3-8fbb-4c084f8659c4-kube-api-access-js948\") pod \"authorino-58cd955675-v9rv5\" (UID: \"62d46152-b2cb-43d3-8fbb-4c084f8659c4\") " pod="kuadrant-system/authorino-58cd955675-v9rv5" Jul 22 21:08:30.013082 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:30.013040 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v9rv5" Jul 22 21:08:30.156452 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:30.156410 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-v9rv5"] Jul 22 21:08:30.158019 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:08:30.157990 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62d46152_b2cb_43d3_8fbb_4c084f8659c4.slice/crio-3de7560cfd4fc6e6826d8d625f237bba11b7277e271e06a7285b9f3c7026a173 WatchSource:0}: Error finding container 3de7560cfd4fc6e6826d8d625f237bba11b7277e271e06a7285b9f3c7026a173: Status 404 returned error can't find the container with id 3de7560cfd4fc6e6826d8d625f237bba11b7277e271e06a7285b9f3c7026a173 Jul 22 21:08:30.882239 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:30.882181 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v9rv5" event={"ID":"62d46152-b2cb-43d3-8fbb-4c084f8659c4","Type":"ContainerStarted","Data":"3de7560cfd4fc6e6826d8d625f237bba11b7277e271e06a7285b9f3c7026a173"} Jul 22 21:08:34.912638 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:34.912593 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v9rv5" event={"ID":"62d46152-b2cb-43d3-8fbb-4c084f8659c4","Type":"ContainerStarted","Data":"f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2"} Jul 22 21:08:34.914219 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:34.914193 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" event={"ID":"954c9240-b8e5-4e73-aabf-ed252e8420b3","Type":"ContainerStarted","Data":"5323ab220e11f7deda93a0f0f9aedb67803044f07341153c4f846ab0aa2aec5c"} Jul 22 21:08:34.914352 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:34.914289 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" Jul 22 21:08:34.989176 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:34.989122 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-v9rv5" podStartSLOduration=1.655162051 podStartE2EDuration="5.989105216s" totalImagesPullingTime="4.333943165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:08:34.985722684 +0000 UTC m=+698.525230982" watchObservedRunningTime="2026-07-22 21:08:34.989105216 +0000 UTC m=+698.528613518" Jul 22 21:08:35.005610 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:35.005547 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" podStartSLOduration=1.2406419419999999 podStartE2EDuration="6.005523344s" totalImagesPullingTime="4.764881402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:08:35.003260318 +0000 UTC m=+698.542768620" watchObservedRunningTime="2026-07-22 21:08:35.005523344 +0000 UTC m=+698.545031647" Jul 22 21:08:35.017788 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:35.017753 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-v9rv5"] Jul 22 21:08:36.925583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:36.925540 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-v9rv5" podUID="62d46152-b2cb-43d3-8fbb-4c084f8659c4" containerName="authorino" containerID="cri-o://f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2" gracePeriod=30 Jul 22 21:08:37.191416 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.191389 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v9rv5" Jul 22 21:08:37.361105 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.361075 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js948\" (UniqueName: \"kubernetes.io/projected/62d46152-b2cb-43d3-8fbb-4c084f8659c4-kube-api-access-js948\") pod \"62d46152-b2cb-43d3-8fbb-4c084f8659c4\" (UID: \"62d46152-b2cb-43d3-8fbb-4c084f8659c4\") " Jul 22 21:08:37.363334 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.363306 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d46152-b2cb-43d3-8fbb-4c084f8659c4-kube-api-access-js948" (OuterVolumeSpecName: "kube-api-access-js948") pod "62d46152-b2cb-43d3-8fbb-4c084f8659c4" (UID: "62d46152-b2cb-43d3-8fbb-4c084f8659c4"). InnerVolumeSpecName "kube-api-access-js948". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:08:37.462137 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.462049 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js948\" (UniqueName: \"kubernetes.io/projected/62d46152-b2cb-43d3-8fbb-4c084f8659c4-kube-api-access-js948\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:08:37.932650 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.932611 2557 generic.go:356] "Generic (PLEG): container finished" podID="62d46152-b2cb-43d3-8fbb-4c084f8659c4" containerID="f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2" exitCode=0 Jul 22 21:08:37.932650 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.932653 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v9rv5" Jul 22 21:08:37.933143 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.932668 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v9rv5" event={"ID":"62d46152-b2cb-43d3-8fbb-4c084f8659c4","Type":"ContainerDied","Data":"f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2"} Jul 22 21:08:37.933143 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.932708 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v9rv5" event={"ID":"62d46152-b2cb-43d3-8fbb-4c084f8659c4","Type":"ContainerDied","Data":"3de7560cfd4fc6e6826d8d625f237bba11b7277e271e06a7285b9f3c7026a173"} Jul 22 21:08:37.933143 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.932732 2557 scope.go:117] "RemoveContainer" containerID="f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2" Jul 22 21:08:37.942129 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.942108 2557 scope.go:117] "RemoveContainer" containerID="f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2" Jul 22 21:08:37.942407 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:08:37.942387 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2\": container with ID starting with f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2 not found: ID does not exist" containerID="f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2" Jul 22 21:08:37.942500 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.942418 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2"} err="failed to get container status \"f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2\": rpc error: code = NotFound desc = could not find container \"f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2\": container with ID starting with f508771cbeba145d573eeea1b13371a5e498d90a98e4a9f65fbf5a9ef113d3e2 not found: ID does not exist" Jul 22 21:08:37.952475 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.952430 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-v9rv5"] Jul 22 21:08:37.955451 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:37.955411 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-v9rv5"] Jul 22 21:08:38.874720 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:38.874676 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62d46152-b2cb-43d3-8fbb-4c084f8659c4" path="/var/lib/kubelet/pods/62d46152-b2cb-43d3-8fbb-4c084f8659c4/volumes" Jul 22 21:08:45.921475 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:08:45.921418 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d46wh" Jul 22 21:09:03.809538 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:03.809500 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-bgn6m"] Jul 22 21:09:03.809928 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:03.809908 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d46152-b2cb-43d3-8fbb-4c084f8659c4" containerName="authorino" Jul 22 21:09:03.809928 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:03.809921 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d46152-b2cb-43d3-8fbb-4c084f8659c4" containerName="authorino" Jul 22 21:09:03.810009 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:03.810000 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="62d46152-b2cb-43d3-8fbb-4c084f8659c4" containerName="authorino" Jul 22 21:09:03.892707 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:03.892642 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-bgn6m"] Jul 22 21:09:03.892895 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:03.892719 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-bgn6m"] Jul 22 21:09:03.892895 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:03.892760 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bgn6m" Jul 22 21:09:03.893273 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:09:03.893246 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-n74x5 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-n74x5 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-bgn6m" podUID="936bf151-5e20-4b70-9a82-e9837e9f037b" Jul 22 21:09:04.020184 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:04.020138 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/936bf151-5e20-4b70-9a82-e9837e9f037b-tls-cert\") pod \"authorino-76877994-bgn6m\" (UID: \"936bf151-5e20-4b70-9a82-e9837e9f037b\") " pod="kuadrant-system/authorino-76877994-bgn6m" Jul 22 21:09:04.020395 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:04.020206 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n74x5\" (UniqueName: \"kubernetes.io/projected/936bf151-5e20-4b70-9a82-e9837e9f037b-kube-api-access-n74x5\") pod \"authorino-76877994-bgn6m\" (UID: \"936bf151-5e20-4b70-9a82-e9837e9f037b\") " pod="kuadrant-system/authorino-76877994-bgn6m" Jul 22 21:09:04.089298 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:04.089267 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bgn6m" Jul 22 21:09:04.114858 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:04.114822 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bgn6m" Jul 22 21:09:04.120985 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:04.120959 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n74x5\" (UniqueName: \"kubernetes.io/projected/936bf151-5e20-4b70-9a82-e9837e9f037b-kube-api-access-n74x5\") pod \"authorino-76877994-bgn6m\" (UID: \"936bf151-5e20-4b70-9a82-e9837e9f037b\") " pod="kuadrant-system/authorino-76877994-bgn6m" Jul 22 21:09:04.121102 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:04.121085 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/936bf151-5e20-4b70-9a82-e9837e9f037b-tls-cert\") pod \"authorino-76877994-bgn6m\" (UID: \"936bf151-5e20-4b70-9a82-e9837e9f037b\") " pod="kuadrant-system/authorino-76877994-bgn6m" Jul 22 21:09:04.121240 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:09:04.121216 2557 secret.go:189] Couldn't get secret kuadrant-system/authorino-server-cert: object "kuadrant-system"/"authorino-server-cert" not registered Jul 22 21:09:04.121289 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:09:04.121280 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/936bf151-5e20-4b70-9a82-e9837e9f037b-tls-cert podName:936bf151-5e20-4b70-9a82-e9837e9f037b nodeName:}" failed. No retries permitted until 2026-07-22 21:09:04.621262113 +0000 UTC m=+728.160770394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/936bf151-5e20-4b70-9a82-e9837e9f037b-tls-cert") pod "authorino-76877994-bgn6m" (UID: "936bf151-5e20-4b70-9a82-e9837e9f037b") : object "kuadrant-system"/"authorino-server-cert" not registered Jul 22 21:09:04.132908 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:04.132878 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n74x5\" (UniqueName: \"kubernetes.io/projected/936bf151-5e20-4b70-9a82-e9837e9f037b-kube-api-access-n74x5\") pod \"authorino-76877994-bgn6m\" (UID: \"936bf151-5e20-4b70-9a82-e9837e9f037b\") " pod="kuadrant-system/authorino-76877994-bgn6m" Jul 22 21:09:04.222323 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:04.222282 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n74x5\" (UniqueName: \"kubernetes.io/projected/936bf151-5e20-4b70-9a82-e9837e9f037b-kube-api-access-n74x5\") pod \"936bf151-5e20-4b70-9a82-e9837e9f037b\" (UID: \"936bf151-5e20-4b70-9a82-e9837e9f037b\") " Jul 22 21:09:04.224576 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:04.224544 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/936bf151-5e20-4b70-9a82-e9837e9f037b-kube-api-access-n74x5" (OuterVolumeSpecName: "kube-api-access-n74x5") pod "936bf151-5e20-4b70-9a82-e9837e9f037b" (UID: "936bf151-5e20-4b70-9a82-e9837e9f037b"). InnerVolumeSpecName "kube-api-access-n74x5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:09:04.323373 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:04.323340 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n74x5\" (UniqueName: \"kubernetes.io/projected/936bf151-5e20-4b70-9a82-e9837e9f037b-kube-api-access-n74x5\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:09:04.627107 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:04.627063 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/936bf151-5e20-4b70-9a82-e9837e9f037b-tls-cert\") pod \"authorino-76877994-bgn6m\" (UID: \"936bf151-5e20-4b70-9a82-e9837e9f037b\") " pod="kuadrant-system/authorino-76877994-bgn6m" Jul 22 21:09:04.627307 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:09:04.627196 2557 secret.go:189] Couldn't get secret kuadrant-system/authorino-server-cert: object "kuadrant-system"/"authorino-server-cert" not registered Jul 22 21:09:04.627307 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:09:04.627262 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/936bf151-5e20-4b70-9a82-e9837e9f037b-tls-cert podName:936bf151-5e20-4b70-9a82-e9837e9f037b nodeName:}" failed. No retries permitted until 2026-07-22 21:09:05.627247078 +0000 UTC m=+729.166755358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/936bf151-5e20-4b70-9a82-e9837e9f037b-tls-cert") pod "authorino-76877994-bgn6m" (UID: "936bf151-5e20-4b70-9a82-e9837e9f037b") : object "kuadrant-system"/"authorino-server-cert" not registered Jul 22 21:09:05.096031 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:05.095999 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bgn6m" Jul 22 21:09:05.124124 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:05.124090 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-bgn6m"] Jul 22 21:09:05.128101 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:05.128070 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-bgn6m"] Jul 22 21:09:05.234115 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:05.234076 2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/936bf151-5e20-4b70-9a82-e9837e9f037b-tls-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:09:06.876008 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:06.875971 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="936bf151-5e20-4b70-9a82-e9837e9f037b" path="/var/lib/kubelet/pods/936bf151-5e20-4b70-9a82-e9837e9f037b/volumes" Jul 22 21:09:48.521552 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:48.521511 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:09:56.389613 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:56.389570 2557 generic.go:356] "Generic (PLEG): container finished" podID="f134018c-a35b-442e-8438-9d865b7a3535" containerID="494218b17dad68e555237e9fef2eacdb45707ce78d7477e74029152dffe412a4" exitCode=0 Jul 22 21:09:56.390018 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:56.389653 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" event={"ID":"f134018c-a35b-442e-8438-9d865b7a3535","Type":"ContainerDied","Data":"494218b17dad68e555237e9fef2eacdb45707ce78d7477e74029152dffe412a4"} Jul 22 21:09:56.390151 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:56.390134 2557 scope.go:117] "RemoveContainer" containerID="494218b17dad68e555237e9fef2eacdb45707ce78d7477e74029152dffe412a4" Jul 22 21:09:56.391217 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:56.391191 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 22 21:09:56.391282 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:56.391264 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 22 21:09:56.391322 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:56.391298 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 22 21:09:57.401692 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:57.401640 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" event={"ID":"f134018c-a35b-442e-8438-9d865b7a3535","Type":"ContainerStarted","Data":"2f9fa2473dc0c1d2a9de81ffe449f37029a3f760b57a016f26d0628a48bea248"} Jul 22 21:09:58.141508 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:58.141467 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:09:58.142817 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:58.142792 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dzsxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 21:09:58.142881 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:58.142852 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" podUID="f134018c-a35b-442e-8438-9d865b7a3535" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 21:09:58.863123 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:58.863084 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:09:59.142035 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:59.141933 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dzsxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 21:09:59.142227 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:09:59.142052 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" podUID="f134018c-a35b-442e-8438-9d865b7a3535" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 21:10:00.141323 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:00.141272 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dzsxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 21:10:00.141861 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:00.141475 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" podUID="f134018c-a35b-442e-8438-9d865b7a3535" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 21:10:01.141034 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:01.140993 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dzsxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 21:10:01.141225 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:01.141074 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" podUID="f134018c-a35b-442e-8438-9d865b7a3535" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 21:10:02.144991 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:02.144954 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:10:02.146043 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:02.146020 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dzsxm" Jul 22 21:10:34.445836 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:34.445794 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:10:46.104154 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:46.104115 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:10:55.497672 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.497630 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-stngq"] Jul 22 21:10:55.501187 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.501166 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.504106 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.504080 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 21:10:55.504258 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.504107 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 21:10:55.504258 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.504081 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s7f6b\"" Jul 22 21:10:55.504258 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.504081 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 22 21:10:55.510569 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.510549 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-stngq"] Jul 22 21:10:55.635658 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.635619 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5hbq\" (UniqueName: \"kubernetes.io/projected/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-kube-api-access-f5hbq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.635658 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.635663 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.635899 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.635684 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.635899 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.635836 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.635899 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.635868 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.636013 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.635936 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.737428 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.737380 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.737673 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.737523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.737673 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.737589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.737673 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.737649 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5hbq\" (UniqueName: \"kubernetes.io/projected/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-kube-api-access-f5hbq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.737847 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.737698 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.737847 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.737719 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.737955 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.737853 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.738008 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.737969 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.738171 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.738149 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.740256 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.740225 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.740394 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.740374 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.746360 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.746327 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5hbq\" (UniqueName: \"kubernetes.io/projected/eb758c2f-2c70-47e1-812b-49e9bbe12cfc-kube-api-access-f5hbq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-stngq\" (UID: \"eb758c2f-2c70-47e1-812b-49e9bbe12cfc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.813876 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.813763 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:10:55.960319 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:55.960286 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-stngq"] Jul 22 21:10:55.961104 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:10:55.961081 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb758c2f_2c70_47e1_812b_49e9bbe12cfc.slice/crio-e32ebe5ca7506b0db1d489f92ed0d8a9fdfdc1b319cb9f848bc8b45b182fbd6f WatchSource:0}: Error finding container e32ebe5ca7506b0db1d489f92ed0d8a9fdfdc1b319cb9f848bc8b45b182fbd6f: Status 404 returned error can't find the container with id e32ebe5ca7506b0db1d489f92ed0d8a9fdfdc1b319cb9f848bc8b45b182fbd6f Jul 22 21:10:56.600972 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:56.600923 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:10:56.752515 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:56.752469 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" event={"ID":"eb758c2f-2c70-47e1-812b-49e9bbe12cfc","Type":"ContainerStarted","Data":"e32ebe5ca7506b0db1d489f92ed0d8a9fdfdc1b319cb9f848bc8b45b182fbd6f"} Jul 22 21:10:57.761030 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:57.760996 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" event={"ID":"eb758c2f-2c70-47e1-812b-49e9bbe12cfc","Type":"ContainerStarted","Data":"7694aa9f2d1b7e4a28c357b33e648e5b52131d9f4049df025f499c6e086e6f4b"} Jul 22 21:10:57.792264 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:10:57.792201 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" podStartSLOduration=1.667175056 podStartE2EDuration="2.79218294s" totalImagesPullingTime="1.125007884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:57.791416174 +0000 UTC m=+841.330924479" watchObservedRunningTime="2026-07-22 21:10:57.79218294 +0000 UTC m=+841.331691242" Jul 22 21:11:05.813992 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:11:05.813951 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:11:05.814659 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:11:05.814028 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:11:05.826698 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:11:05.826669 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:11:06.822878 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:11:06.822845 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-stngq" Jul 22 21:11:10.198830 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:11:10.198794 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:11:23.797577 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:11:23.797539 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:11:41.902521 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:11:41.902482 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:11:56.847911 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:11:56.847820 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:11:56.848739 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:11:56.848715 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:11:56.853084 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:11:56.853062 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:11:56.853843 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:11:56.853823 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:12:42.807751 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:42.807713 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-574555674d-4z27r"] Jul 22 21:12:42.810150 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:42.810131 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574555674d-4z27r" Jul 22 21:12:42.813873 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:42.813848 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 22 21:12:42.813873 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:42.813867 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kh4qg\"" Jul 22 21:12:42.818958 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:42.818933 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574555674d-4z27r"] Jul 22 21:12:42.867082 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:42.867040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a063322-d7a6-481c-9e1b-702b8516e096-tls-cert\") pod \"authorino-574555674d-4z27r\" (UID: \"8a063322-d7a6-481c-9e1b-702b8516e096\") " pod="kuadrant-system/authorino-574555674d-4z27r" Jul 22 21:12:42.867263 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:42.867151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8lkt\" (UniqueName: \"kubernetes.io/projected/8a063322-d7a6-481c-9e1b-702b8516e096-kube-api-access-p8lkt\") pod \"authorino-574555674d-4z27r\" (UID: \"8a063322-d7a6-481c-9e1b-702b8516e096\") " pod="kuadrant-system/authorino-574555674d-4z27r" Jul 22 21:12:42.968314 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:42.968273 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a063322-d7a6-481c-9e1b-702b8516e096-tls-cert\") pod \"authorino-574555674d-4z27r\" (UID: \"8a063322-d7a6-481c-9e1b-702b8516e096\") " pod="kuadrant-system/authorino-574555674d-4z27r" Jul 22 21:12:42.968528 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:42.968419 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8lkt\" (UniqueName: \"kubernetes.io/projected/8a063322-d7a6-481c-9e1b-702b8516e096-kube-api-access-p8lkt\") pod \"authorino-574555674d-4z27r\" (UID: \"8a063322-d7a6-481c-9e1b-702b8516e096\") " pod="kuadrant-system/authorino-574555674d-4z27r" Jul 22 21:12:42.970973 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:42.970950 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a063322-d7a6-481c-9e1b-702b8516e096-tls-cert\") pod \"authorino-574555674d-4z27r\" (UID: \"8a063322-d7a6-481c-9e1b-702b8516e096\") " pod="kuadrant-system/authorino-574555674d-4z27r" Jul 22 21:12:42.976007 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:42.975984 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8lkt\" (UniqueName: \"kubernetes.io/projected/8a063322-d7a6-481c-9e1b-702b8516e096-kube-api-access-p8lkt\") pod \"authorino-574555674d-4z27r\" (UID: \"8a063322-d7a6-481c-9e1b-702b8516e096\") " pod="kuadrant-system/authorino-574555674d-4z27r" Jul 22 21:12:43.121105 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:43.121059 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574555674d-4z27r" Jul 22 21:12:43.266996 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:43.266968 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574555674d-4z27r"] Jul 22 21:12:43.268490 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:12:43.268462 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a063322_d7a6_481c_9e1b_702b8516e096.slice/crio-bbf45697c1de31725ffa74ac8acb3a5ecc9cbfc74d6b02e52de3f44f966f88ef WatchSource:0}: Error finding container bbf45697c1de31725ffa74ac8acb3a5ecc9cbfc74d6b02e52de3f44f966f88ef: Status 404 returned error can't find the container with id bbf45697c1de31725ffa74ac8acb3a5ecc9cbfc74d6b02e52de3f44f966f88ef Jul 22 21:12:43.269826 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:43.269807 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 21:12:43.360823 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:43.360785 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574555674d-4z27r" event={"ID":"8a063322-d7a6-481c-9e1b-702b8516e096","Type":"ContainerStarted","Data":"bbf45697c1de31725ffa74ac8acb3a5ecc9cbfc74d6b02e52de3f44f966f88ef"} Jul 22 21:12:44.369919 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:44.369870 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574555674d-4z27r" event={"ID":"8a063322-d7a6-481c-9e1b-702b8516e096","Type":"ContainerStarted","Data":"83db0bd351ffd54c1dfbdce2b805a8fa2522838883c5939a7c387ef5a899eb21"} Jul 22 21:12:44.391308 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:12:44.391247 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-574555674d-4z27r" podStartSLOduration=2.084152344 podStartE2EDuration="2.391228151s" totalImagesPullingTime="307.075807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:12:44.38959858 +0000 UTC m=+947.929106884" watchObservedRunningTime="2026-07-22 21:12:44.391228151 +0000 UTC m=+947.930736484" Jul 22 21:13:12.901034 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:13:12.900990 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:13:23.201084 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:13:23.200961 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:13:34.396096 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:13:34.396056 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:15:14.989974 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:15:14.989933 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:15:22.896645 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:15:22.896607 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:15:53.602168 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:15:53.602120 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:16:03.592304 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:16:03.592262 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:16:11.897794 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:16:11.897756 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:16:21.099911 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:16:21.099820 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:16:32.212585 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:16:32.212531 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:16:44.031167 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:16:44.031127 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:16:54.402857 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:16:54.402813 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:16:56.888245 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:16:56.888215 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:16:56.890916 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:16:56.890885 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:16:56.893009 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:16:56.892985 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:16:56.895336 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:16:56.895315 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:17:04.096148 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:17:04.096102 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:17:26.904682 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:17:26.904631 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:17:36.795760 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:17:36.795720 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:17:58.602874 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:17:58.602781 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:18:11.000474 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:18:11.000412 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:18:26.704415 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:18:26.704375 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:18:35.809774 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:18:35.809734 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:18:45.201688 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:18:45.201636 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:18:54.098797 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:18:54.098759 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:19:02.613357 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:19:02.613323 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:20:55.503642 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:20:55.503563 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:21:05.995689 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:21:05.995636 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:21:16.496771 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:21:16.496733 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:21:27.300413 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:21:27.300372 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:21:38.893551 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:21:38.893510 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:21:49.398461 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:21:49.398384 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:21:56.934894 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:21:56.934862 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:21:56.936910 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:21:56.936881 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:21:56.939586 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:21:56.939563 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:21:56.941322 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:21:56.941297 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:21:58.492088 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:21:58.492051 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:22:09.196174 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:22:09.196137 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:22:19.293845 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:22:19.293762 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:22:29.199918 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:22:29.199879 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:22:39.902169 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:22:39.902122 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:23:03.901877 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:23:03.901844 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:23:11.407726 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:23:11.407688 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:23:30.898731 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:23:30.898698 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:23:49.894674 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:23:49.894589 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:24:01.100364 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:24:01.100314 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:24:14.793216 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:24:14.793172 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:24:24.404142 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:24:24.404093 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:24:35.495853 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:24:35.495821 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:24:45.904800 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:24:45.904762 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:24:55.595453 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:24:55.595397 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:25:05.899568 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:25:05.899529 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:25:14.703313 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:25:14.703245 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:25:23.897338 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:25:23.897259 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:25:36.008408 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:25:36.008362 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:25:47.308353 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:25:47.308306 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:25:56.596878 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:25:56.596838 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:26:08.405136 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:26:08.405092 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:26:19.006971 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:26:19.006930 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:26:28.236610 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:26:28.236572 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:26:39.937037 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:26:39.936995 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:26:52.015008 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:26:52.014923 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:26:56.983839 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:26:56.983812 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:26:56.984671 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:26:56.984649 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:26:56.988415 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:26:56.988391 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:26:56.989137 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:26:56.989121 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:27:04.815214 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:27:04.815168 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:27:14.347194 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:27:14.347155 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:27:25.101853 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:27:25.101812 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:27:38.040089 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:27:38.040047 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:27:55.002047 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:27:55.002006 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:28:15.870569 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:15.870538 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr"] Jul 22 21:28:15.874039 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:15.874018 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr" Jul 22 21:28:15.876831 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:15.876809 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 21:28:15.876961 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:15.876924 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\"" Jul 22 21:28:15.882550 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:15.882253 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr"] Jul 22 21:28:15.933901 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:15.933866 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2247d109-16b9-49e4-ac21-e5929ae3338e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr\" (UID: \"2247d109-16b9-49e4-ac21-e5929ae3338e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr" Jul 22 21:28:16.035389 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:16.035345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2247d109-16b9-49e4-ac21-e5929ae3338e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr\" (UID: \"2247d109-16b9-49e4-ac21-e5929ae3338e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr" Jul 22 21:28:16.036061 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:16.036035 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2247d109-16b9-49e4-ac21-e5929ae3338e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr\" (UID: \"2247d109-16b9-49e4-ac21-e5929ae3338e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr" Jul 22 21:28:16.187660 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:16.187560 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr" Jul 22 21:28:16.537993 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:16.537965 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr"] Jul 22 21:28:16.540464 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:28:16.540417 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2247d109_16b9_49e4_ac21_e5929ae3338e.slice/crio-e08758ce84b9dd1e724ba2290ecb2235cac9aa3a940627cea9ac7aaeddbfcd69 WatchSource:0}: Error finding container e08758ce84b9dd1e724ba2290ecb2235cac9aa3a940627cea9ac7aaeddbfcd69: Status 404 returned error can't find the container with id e08758ce84b9dd1e724ba2290ecb2235cac9aa3a940627cea9ac7aaeddbfcd69 Jul 22 21:28:16.542795 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:16.542779 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 21:28:16.767029 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:16.766990 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr" event={"ID":"2247d109-16b9-49e4-ac21-e5929ae3338e","Type":"ContainerStarted","Data":"e08758ce84b9dd1e724ba2290ecb2235cac9aa3a940627cea9ac7aaeddbfcd69"} Jul 22 21:28:19.787193 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:19.787094 2557 generic.go:356] "Generic (PLEG): container finished" podID="2247d109-16b9-49e4-ac21-e5929ae3338e" containerID="8f0ebcaef742e91a76da81ad6936209ed9eabf43520b9351bc8625dd5ab15500" exitCode=0 Jul 22 21:28:19.787595 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:19.787185 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr" event={"ID":"2247d109-16b9-49e4-ac21-e5929ae3338e","Type":"ContainerDied","Data":"8f0ebcaef742e91a76da81ad6936209ed9eabf43520b9351bc8625dd5ab15500"} Jul 22 21:28:20.944769 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:20.944735 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr" Jul 22 21:28:21.086692 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:21.086650 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2247d109-16b9-49e4-ac21-e5929ae3338e-maas-api-service-ca\") pod \"2247d109-16b9-49e4-ac21-e5929ae3338e\" (UID: \"2247d109-16b9-49e4-ac21-e5929ae3338e\") " Jul 22 21:28:21.087042 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:21.087020 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2247d109-16b9-49e4-ac21-e5929ae3338e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2247d109-16b9-49e4-ac21-e5929ae3338e" (UID: "2247d109-16b9-49e4-ac21-e5929ae3338e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:28:21.188336 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:21.188291 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2247d109-16b9-49e4-ac21-e5929ae3338e-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:28:21.800753 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:21.800720 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr" Jul 22 21:28:21.800936 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:21.800757 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr" event={"ID":"2247d109-16b9-49e4-ac21-e5929ae3338e","Type":"ContainerDied","Data":"e08758ce84b9dd1e724ba2290ecb2235cac9aa3a940627cea9ac7aaeddbfcd69"} Jul 22 21:28:21.800936 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:21.800807 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e08758ce84b9dd1e724ba2290ecb2235cac9aa3a940627cea9ac7aaeddbfcd69" Jul 22 21:28:29.000876 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:29.000836 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:28:30.941908 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:30.941868 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr"] Jul 22 21:28:30.944649 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:30.944622 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d4a1f8ee-qqwjr"] Jul 22 21:28:32.874127 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:32.874090 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2247d109-16b9-49e4-ac21-e5929ae3338e" path="/var/lib/kubelet/pods/2247d109-16b9-49e4-ac21-e5929ae3338e/volumes" Jul 22 21:28:39.996042 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:39.996007 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:28:59.620909 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.620869 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l"] Jul 22 21:28:59.621516 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.621490 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2247d109-16b9-49e4-ac21-e5929ae3338e" containerName="revoke-keys" Jul 22 21:28:59.621516 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.621517 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2247d109-16b9-49e4-ac21-e5929ae3338e" containerName="revoke-keys" Jul 22 21:28:59.621667 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.621650 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2247d109-16b9-49e4-ac21-e5929ae3338e" containerName="revoke-keys" Jul 22 21:28:59.625195 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.625175 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l" Jul 22 21:28:59.627933 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.627904 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 21:28:59.627933 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.627913 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\"" Jul 22 21:28:59.634668 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.634591 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l"] Jul 22 21:28:59.773961 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.773899 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b9eb71-54ea-4faf-9347-442070a23028-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l\" (UID: \"69b9eb71-54ea-4faf-9347-442070a23028\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l" Jul 22 21:28:59.875112 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.875018 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b9eb71-54ea-4faf-9347-442070a23028-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l\" (UID: \"69b9eb71-54ea-4faf-9347-442070a23028\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l" Jul 22 21:28:59.875682 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.875661 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b9eb71-54ea-4faf-9347-442070a23028-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l\" (UID: \"69b9eb71-54ea-4faf-9347-442070a23028\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l" Jul 22 21:28:59.937537 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:28:59.937502 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l" Jul 22 21:29:00.084370 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:00.084330 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l"] Jul 22 21:29:00.087582 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:29:00.087551 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b9eb71_54ea_4faf_9347_442070a23028.slice/crio-106a25bf88918c76b4048cd11402c19ec1c78f778207ab05670b74ac52429900 WatchSource:0}: Error finding container 106a25bf88918c76b4048cd11402c19ec1c78f778207ab05670b74ac52429900: Status 404 returned error can't find the container with id 106a25bf88918c76b4048cd11402c19ec1c78f778207ab05670b74ac52429900 Jul 22 21:29:01.026452 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:01.026411 2557 generic.go:356] "Generic (PLEG): container finished" podID="69b9eb71-54ea-4faf-9347-442070a23028" containerID="aaabf677b6406bff408ee7ba9b491090b40c1ee91ff477c939f536a0150758a6" exitCode=0 Jul 22 21:29:01.026883 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:01.026504 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l" event={"ID":"69b9eb71-54ea-4faf-9347-442070a23028","Type":"ContainerDied","Data":"aaabf677b6406bff408ee7ba9b491090b40c1ee91ff477c939f536a0150758a6"} Jul 22 21:29:01.026883 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:01.026571 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l" event={"ID":"69b9eb71-54ea-4faf-9347-442070a23028","Type":"ContainerStarted","Data":"106a25bf88918c76b4048cd11402c19ec1c78f778207ab05670b74ac52429900"} Jul 22 21:29:02.173454 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:02.173419 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l" Jul 22 21:29:02.299684 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:02.299591 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b9eb71-54ea-4faf-9347-442070a23028-maas-api-service-ca\") pod \"69b9eb71-54ea-4faf-9347-442070a23028\" (UID: \"69b9eb71-54ea-4faf-9347-442070a23028\") " Jul 22 21:29:02.299966 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:02.299944 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69b9eb71-54ea-4faf-9347-442070a23028-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "69b9eb71-54ea-4faf-9347-442070a23028" (UID: "69b9eb71-54ea-4faf-9347-442070a23028"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:29:02.400374 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:02.400328 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b9eb71-54ea-4faf-9347-442070a23028-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:29:03.040679 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:03.040646 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l" Jul 22 21:29:03.040869 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:03.040652 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l" event={"ID":"69b9eb71-54ea-4faf-9347-442070a23028","Type":"ContainerDied","Data":"106a25bf88918c76b4048cd11402c19ec1c78f778207ab05670b74ac52429900"} Jul 22 21:29:03.040869 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:03.040781 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="106a25bf88918c76b4048cd11402c19ec1c78f778207ab05670b74ac52429900" Jul 22 21:29:13.092970 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:13.092926 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:29:14.692543 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:14.692490 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l"] Jul 22 21:29:14.695414 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:14.695385 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9ab0a8ae-59r8l"] Jul 22 21:29:14.875395 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:14.875357 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69b9eb71-54ea-4faf-9347-442070a23028" path="/var/lib/kubelet/pods/69b9eb71-54ea-4faf-9347-442070a23028/volumes" Jul 22 21:29:23.816944 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:23.816898 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:29:43.526458 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.526396 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp"] Jul 22 21:29:43.527105 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.527080 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b9eb71-54ea-4faf-9347-442070a23028" containerName="revoke-keys" Jul 22 21:29:43.527196 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.527110 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b9eb71-54ea-4faf-9347-442070a23028" containerName="revoke-keys" Jul 22 21:29:43.527261 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.527247 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="69b9eb71-54ea-4faf-9347-442070a23028" containerName="revoke-keys" Jul 22 21:29:43.530647 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.530622 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp" Jul 22 21:29:43.533730 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.533700 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 21:29:43.534325 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.534298 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\"" Jul 22 21:29:43.536963 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.536935 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp"] Jul 22 21:29:43.701951 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.701910 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8544df4-44d5-4c48-b2c9-48637836f783-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp\" (UID: \"c8544df4-44d5-4c48-b2c9-48637836f783\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp" Jul 22 21:29:43.803343 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.803241 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8544df4-44d5-4c48-b2c9-48637836f783-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp\" (UID: \"c8544df4-44d5-4c48-b2c9-48637836f783\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp" Jul 22 21:29:43.803965 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.803945 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8544df4-44d5-4c48-b2c9-48637836f783-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp\" (UID: \"c8544df4-44d5-4c48-b2c9-48637836f783\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp" Jul 22 21:29:43.843396 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.843360 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp" Jul 22 21:29:43.985096 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:43.985068 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp"] Jul 22 21:29:43.986473 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:29:43.986418 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8544df4_44d5_4c48_b2c9_48637836f783.slice/crio-1d591467c195c50fbf588d0b94428d45136098891c51d5f4ccc5b833d021e6bf WatchSource:0}: Error finding container 1d591467c195c50fbf588d0b94428d45136098891c51d5f4ccc5b833d021e6bf: Status 404 returned error can't find the container with id 1d591467c195c50fbf588d0b94428d45136098891c51d5f4ccc5b833d021e6bf Jul 22 21:29:44.287165 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:44.287131 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp" event={"ID":"c8544df4-44d5-4c48-b2c9-48637836f783","Type":"ContainerStarted","Data":"1d591467c195c50fbf588d0b94428d45136098891c51d5f4ccc5b833d021e6bf"} Jul 22 21:29:45.294476 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:45.294410 2557 generic.go:356] "Generic (PLEG): container finished" podID="c8544df4-44d5-4c48-b2c9-48637836f783" containerID="e39cd0a43a43ced3b856d43b4709c488ec6b05513cbe9c98a6a8ca8920e7a8b7" exitCode=0 Jul 22 21:29:45.294882 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:45.294501 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp" event={"ID":"c8544df4-44d5-4c48-b2c9-48637836f783","Type":"ContainerDied","Data":"e39cd0a43a43ced3b856d43b4709c488ec6b05513cbe9c98a6a8ca8920e7a8b7"} Jul 22 21:29:46.441369 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:46.441339 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp" Jul 22 21:29:46.529106 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:46.529070 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8544df4-44d5-4c48-b2c9-48637836f783-maas-api-service-ca\") pod \"c8544df4-44d5-4c48-b2c9-48637836f783\" (UID: \"c8544df4-44d5-4c48-b2c9-48637836f783\") " Jul 22 21:29:46.529496 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:46.529430 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8544df4-44d5-4c48-b2c9-48637836f783-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8544df4-44d5-4c48-b2c9-48637836f783" (UID: "c8544df4-44d5-4c48-b2c9-48637836f783"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:29:46.630168 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:46.630127 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8544df4-44d5-4c48-b2c9-48637836f783-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:29:47.307655 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:47.307549 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp" Jul 22 21:29:47.307655 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:47.307560 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp" event={"ID":"c8544df4-44d5-4c48-b2c9-48637836f783","Type":"ContainerDied","Data":"1d591467c195c50fbf588d0b94428d45136098891c51d5f4ccc5b833d021e6bf"} Jul 22 21:29:47.307655 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:47.307610 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d591467c195c50fbf588d0b94428d45136098891c51d5f4ccc5b833d021e6bf" Jul 22 21:29:56.903694 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:56.903653 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:29:58.601400 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:58.601357 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp"] Jul 22 21:29:58.603720 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:58.603696 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f4291a2-qf9wp"] Jul 22 21:29:58.873945 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:29:58.873862 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8544df4-44d5-4c48-b2c9-48637836f783" path="/var/lib/kubelet/pods/c8544df4-44d5-4c48-b2c9-48637836f783/volumes" Jul 22 21:30:06.701753 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:06.701712 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:30:27.808310 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:27.808274 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8"] Jul 22 21:30:27.808839 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:27.808731 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8544df4-44d5-4c48-b2c9-48637836f783" containerName="revoke-keys" Jul 22 21:30:27.808839 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:27.808744 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8544df4-44d5-4c48-b2c9-48637836f783" containerName="revoke-keys" Jul 22 21:30:27.808839 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:27.808829 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8544df4-44d5-4c48-b2c9-48637836f783" containerName="revoke-keys" Jul 22 21:30:27.812158 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:27.812139 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8" Jul 22 21:30:27.814629 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:27.814594 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\"" Jul 22 21:30:27.814775 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:27.814629 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 21:30:27.819361 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:27.819335 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8"] Jul 22 21:30:27.913993 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:27.913953 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a35371c7-ea98-44d9-81a1-a969ec4ac126-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a5095382-sxqj8\" (UID: \"a35371c7-ea98-44d9-81a1-a969ec4ac126\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8" Jul 22 21:30:28.015412 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:28.015375 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a35371c7-ea98-44d9-81a1-a969ec4ac126-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a5095382-sxqj8\" (UID: \"a35371c7-ea98-44d9-81a1-a969ec4ac126\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8" Jul 22 21:30:28.016034 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:28.016014 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a35371c7-ea98-44d9-81a1-a969ec4ac126-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a5095382-sxqj8\" (UID: \"a35371c7-ea98-44d9-81a1-a969ec4ac126\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8" Jul 22 21:30:28.124934 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:28.124885 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8" Jul 22 21:30:28.263370 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:28.263339 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8"] Jul 22 21:30:28.264084 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:30:28.264051 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35371c7_ea98_44d9_81a1_a969ec4ac126.slice/crio-c8bdd638156c4a1747b03829dd4d179272c68940eebeb27bd74fddec5358c253 WatchSource:0}: Error finding container c8bdd638156c4a1747b03829dd4d179272c68940eebeb27bd74fddec5358c253: Status 404 returned error can't find the container with id c8bdd638156c4a1747b03829dd4d179272c68940eebeb27bd74fddec5358c253 Jul 22 21:30:28.565688 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:28.565649 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8" event={"ID":"a35371c7-ea98-44d9-81a1-a969ec4ac126","Type":"ContainerStarted","Data":"c8bdd638156c4a1747b03829dd4d179272c68940eebeb27bd74fddec5358c253"} Jul 22 21:30:29.573176 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:29.573137 2557 generic.go:356] "Generic (PLEG): container finished" podID="a35371c7-ea98-44d9-81a1-a969ec4ac126" containerID="5355e47957a9e970fc0b6d9607951fbc2be2637bb178d49fc6c80696c49b2c1d" exitCode=0 Jul 22 21:30:29.573658 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:29.573236 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8" event={"ID":"a35371c7-ea98-44d9-81a1-a969ec4ac126","Type":"ContainerDied","Data":"5355e47957a9e970fc0b6d9607951fbc2be2637bb178d49fc6c80696c49b2c1d"} Jul 22 21:30:30.721758 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:30.721732 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8" Jul 22 21:30:30.844922 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:30.844812 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a35371c7-ea98-44d9-81a1-a969ec4ac126-maas-api-service-ca\") pod \"a35371c7-ea98-44d9-81a1-a969ec4ac126\" (UID: \"a35371c7-ea98-44d9-81a1-a969ec4ac126\") " Jul 22 21:30:30.845199 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:30.845176 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a35371c7-ea98-44d9-81a1-a969ec4ac126-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a35371c7-ea98-44d9-81a1-a969ec4ac126" (UID: "a35371c7-ea98-44d9-81a1-a969ec4ac126"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 21:30:30.945910 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:30.945872 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a35371c7-ea98-44d9-81a1-a969ec4ac126-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:30:31.586548 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:31.586513 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8" Jul 22 21:30:31.586741 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:31.586523 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8" event={"ID":"a35371c7-ea98-44d9-81a1-a969ec4ac126","Type":"ContainerDied","Data":"c8bdd638156c4a1747b03829dd4d179272c68940eebeb27bd74fddec5358c253"} Jul 22 21:30:31.586741 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:31.586641 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8bdd638156c4a1747b03829dd4d179272c68940eebeb27bd74fddec5358c253" Jul 22 21:30:41.398057 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:41.398015 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:30:42.881206 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:42.881173 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8"] Jul 22 21:30:42.884621 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:42.884596 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5095382-sxqj8"] Jul 22 21:30:44.874627 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:30:44.874590 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a35371c7-ea98-44d9-81a1-a969ec4ac126" path="/var/lib/kubelet/pods/a35371c7-ea98-44d9-81a1-a969ec4ac126/volumes" Jul 22 21:31:57.022939 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:31:57.022909 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:31:57.024557 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:31:57.024532 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:31:57.027407 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:31:57.027389 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:31:57.028986 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:31:57.028969 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:32:08.544344 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:32:08.544306 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:32:18.708045 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:32:18.708013 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:32:29.796829 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:32:29.796790 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:32:48.006248 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:32:48.006173 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:33:26.502260 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:33:26.502227 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:33:35.706182 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:33:35.706145 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:33:51.206363 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:33:51.206319 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:34:11.205369 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:34:11.205325 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:34:20.896785 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:34:20.896708 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:34:57.070385 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:34:57.070350 2557 scope.go:117] "RemoveContainer" containerID="8f0ebcaef742e91a76da81ad6936209ed9eabf43520b9351bc8625dd5ab15500" Jul 22 21:35:11.501178 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:35:11.501141 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:35:24.313270 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:35:24.313236 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:35:57.090689 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:35:57.090659 2557 scope.go:117] "RemoveContainer" containerID="e39cd0a43a43ced3b856d43b4709c488ec6b05513cbe9c98a6a8ca8920e7a8b7" Jul 22 21:35:57.099117 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:35:57.099100 2557 scope.go:117] "RemoveContainer" containerID="aaabf677b6406bff408ee7ba9b491090b40c1ee91ff477c939f536a0150758a6" Jul 22 21:36:11.408060 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:36:11.408018 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:36:24.294260 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:36:24.294229 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:36:38.003890 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:36:38.003845 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:36:55.500773 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:36:55.500732 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:36:57.060882 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:36:57.060852 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:36:57.063691 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:36:57.063665 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:36:57.065647 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:36:57.065628 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:36:57.068133 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:36:57.068114 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:36:57.123004 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:36:57.122985 2557 scope.go:117] "RemoveContainer" containerID="5355e47957a9e970fc0b6d9607951fbc2be2637bb178d49fc6c80696c49b2c1d" Jul 22 21:37:33.390489 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:37:33.390427 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:37:48.300035 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:37:48.299996 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:38:05.111500 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:38:05.111463 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:38:24.196251 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:38:24.196211 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:38:39.703563 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:38:39.703524 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:38:55.098914 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:38:55.098829 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:39:24.497938 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:39:24.497903 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:39:38.791949 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:39:38.791916 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:39:49.592825 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:39:49.592791 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:40:03.999129 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:40:03.999085 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:40:18.405401 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:40:18.405302 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:40:35.395275 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:40:35.395227 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:40:52.601378 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:40:52.601333 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:41:09.710946 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:41:09.710896 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:41:28.514290 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:41:28.514236 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:41:42.205939 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:41:42.205877 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:41:57.107089 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:41:57.107009 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:41:57.110637 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:41:57.110603 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:41:57.111322 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:41:57.111301 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:41:57.115070 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:41:57.115049 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:42:00.795090 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:42:00.795057 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:42:18.902648 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:42:18.902609 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:42:35.902272 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:42:35.902232 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:43:05.198591 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:43:05.198537 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:43:31.001862 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:43:31.001822 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:43:47.396576 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:43:47.396534 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:44:05.098045 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:44:05.098005 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:44:17.305959 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:44:17.305913 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:45:06.395727 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:06.395638 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:45:29.601425 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:29.601376 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:45:44.894047 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:44.894005 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:45:53.353950 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.353907 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7526-140462285431216"] Jul 22 21:45:53.354543 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.354523 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a35371c7-ea98-44d9-81a1-a969ec4ac126" containerName="revoke-keys" Jul 22 21:45:53.354636 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.354545 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a35371c7-ea98-44d9-81a1-a969ec4ac126" containerName="revoke-keys" Jul 22 21:45:53.354759 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.354675 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a35371c7-ea98-44d9-81a1-a969ec4ac126" containerName="revoke-keys" Jul 22 21:45:53.358145 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.358123 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285431216" Jul 22 21:45:53.361282 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.361077 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w4gdm\"" Jul 22 21:45:53.364571 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.364545 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285431216"] Jul 22 21:45:53.385963 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.385926 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh97p\" (UniqueName: \"kubernetes.io/projected/0206f1cc-3d25-45f2-96b6-c85c87bc4340-kube-api-access-sh97p\") pod \"test-curl-7526-140462285431216\" (UID: \"0206f1cc-3d25-45f2-96b6-c85c87bc4340\") " pod="opendatahub/test-curl-7526-140462285431216" Jul 22 21:45:53.486605 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.486560 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh97p\" (UniqueName: \"kubernetes.io/projected/0206f1cc-3d25-45f2-96b6-c85c87bc4340-kube-api-access-sh97p\") pod \"test-curl-7526-140462285431216\" (UID: \"0206f1cc-3d25-45f2-96b6-c85c87bc4340\") " pod="opendatahub/test-curl-7526-140462285431216" Jul 22 21:45:53.495283 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.495245 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh97p\" (UniqueName: \"kubernetes.io/projected/0206f1cc-3d25-45f2-96b6-c85c87bc4340-kube-api-access-sh97p\") pod \"test-curl-7526-140462285431216\" (UID: \"0206f1cc-3d25-45f2-96b6-c85c87bc4340\") " pod="opendatahub/test-curl-7526-140462285431216" Jul 22 21:45:53.671082 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.670977 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285431216" Jul 22 21:45:53.824303 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.824267 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285431216"] Jul 22 21:45:53.824494 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:45:53.824337 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0206f1cc_3d25_45f2_96b6_c85c87bc4340.slice/crio-de2ba10beb617c7117c81f5ebef4a398a4452195bc6eb53d6e61ec7674b41e0c WatchSource:0}: Error finding container de2ba10beb617c7117c81f5ebef4a398a4452195bc6eb53d6e61ec7674b41e0c: Status 404 returned error can't find the container with id de2ba10beb617c7117c81f5ebef4a398a4452195bc6eb53d6e61ec7674b41e0c Jul 22 21:45:53.825873 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.825852 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 21:45:53.946695 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:53.946608 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285431216" event={"ID":"0206f1cc-3d25-45f2-96b6-c85c87bc4340","Type":"ContainerStarted","Data":"de2ba10beb617c7117c81f5ebef4a398a4452195bc6eb53d6e61ec7674b41e0c"} Jul 22 21:45:54.955003 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:54.954958 2557 generic.go:356] "Generic (PLEG): container finished" podID="0206f1cc-3d25-45f2-96b6-c85c87bc4340" containerID="d7af446fc7dedd53825b9d274c83dc16c6cb50e6bf7fd48a037e08104cc521bc" exitCode=0 Jul 22 21:45:54.955556 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:54.955010 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285431216" event={"ID":"0206f1cc-3d25-45f2-96b6-c85c87bc4340","Type":"ContainerDied","Data":"d7af446fc7dedd53825b9d274c83dc16c6cb50e6bf7fd48a037e08104cc521bc"} Jul 22 21:45:56.114413 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.114384 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285431216" Jul 22 21:45:56.149648 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.149611 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7526-140462285431216_0206f1cc-3d25-45f2-96b6-c85c87bc4340/test-curl-7526-140462285431216/0.log" Jul 22 21:45:56.173110 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.173065 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7526-140462285431216"] Jul 22 21:45:56.176376 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.176339 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7526-140462285431216"] Jul 22 21:45:56.212637 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.212524 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh97p\" (UniqueName: \"kubernetes.io/projected/0206f1cc-3d25-45f2-96b6-c85c87bc4340-kube-api-access-sh97p\") pod \"0206f1cc-3d25-45f2-96b6-c85c87bc4340\" (UID: \"0206f1cc-3d25-45f2-96b6-c85c87bc4340\") " Jul 22 21:45:56.215033 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.214995 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0206f1cc-3d25-45f2-96b6-c85c87bc4340-kube-api-access-sh97p" (OuterVolumeSpecName: "kube-api-access-sh97p") pod "0206f1cc-3d25-45f2-96b6-c85c87bc4340" (UID: "0206f1cc-3d25-45f2-96b6-c85c87bc4340"). InnerVolumeSpecName "kube-api-access-sh97p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:45:56.308799 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.308756 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7526-140462285433648"] Jul 22 21:45:56.309225 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.309211 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0206f1cc-3d25-45f2-96b6-c85c87bc4340" containerName="test-curl-7526-140462285431216" Jul 22 21:45:56.309274 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.309227 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0206f1cc-3d25-45f2-96b6-c85c87bc4340" containerName="test-curl-7526-140462285431216" Jul 22 21:45:56.309316 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.309306 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0206f1cc-3d25-45f2-96b6-c85c87bc4340" containerName="test-curl-7526-140462285431216" Jul 22 21:45:56.312681 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.312661 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285433648" Jul 22 21:45:56.313485 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.313450 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh97p\" (UniqueName: \"kubernetes.io/projected/0206f1cc-3d25-45f2-96b6-c85c87bc4340-kube-api-access-sh97p\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:45:56.318225 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.318197 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285433648"] Jul 22 21:45:56.414770 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.414727 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcchw\" (UniqueName: \"kubernetes.io/projected/86db17af-f33c-4a82-a04f-2f37f1cbfc7c-kube-api-access-hcchw\") pod \"test-curl-7526-140462285433648\" (UID: \"86db17af-f33c-4a82-a04f-2f37f1cbfc7c\") " pod="opendatahub/test-curl-7526-140462285433648" Jul 22 21:45:56.516339 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.516225 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcchw\" (UniqueName: \"kubernetes.io/projected/86db17af-f33c-4a82-a04f-2f37f1cbfc7c-kube-api-access-hcchw\") pod \"test-curl-7526-140462285433648\" (UID: \"86db17af-f33c-4a82-a04f-2f37f1cbfc7c\") " pod="opendatahub/test-curl-7526-140462285433648" Jul 22 21:45:56.524912 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.524873 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcchw\" (UniqueName: \"kubernetes.io/projected/86db17af-f33c-4a82-a04f-2f37f1cbfc7c-kube-api-access-hcchw\") pod \"test-curl-7526-140462285433648\" (UID: \"86db17af-f33c-4a82-a04f-2f37f1cbfc7c\") " pod="opendatahub/test-curl-7526-140462285433648" Jul 22 21:45:56.623579 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.623536 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285433648" Jul 22 21:45:56.778613 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.778584 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285433648"] Jul 22 21:45:56.780568 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:45:56.780534 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86db17af_f33c_4a82_a04f_2f37f1cbfc7c.slice/crio-9582a838cf7beafd6834b9f38b81144854d12309aa80630aa77f484e959f0aa7 WatchSource:0}: Error finding container 9582a838cf7beafd6834b9f38b81144854d12309aa80630aa77f484e959f0aa7: Status 404 returned error can't find the container with id 9582a838cf7beafd6834b9f38b81144854d12309aa80630aa77f484e959f0aa7 Jul 22 21:45:56.883363 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.883325 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0206f1cc-3d25-45f2-96b6-c85c87bc4340" path="/var/lib/kubelet/pods/0206f1cc-3d25-45f2-96b6-c85c87bc4340/volumes" Jul 22 21:45:56.967416 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.967376 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285433648" event={"ID":"86db17af-f33c-4a82-a04f-2f37f1cbfc7c","Type":"ContainerStarted","Data":"9582a838cf7beafd6834b9f38b81144854d12309aa80630aa77f484e959f0aa7"} Jul 22 21:45:56.968661 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.968642 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285431216" Jul 22 21:45:56.968788 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:56.968675 2557 scope.go:117] "RemoveContainer" containerID="d7af446fc7dedd53825b9d274c83dc16c6cb50e6bf7fd48a037e08104cc521bc" Jul 22 21:45:57.977751 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:57.977716 2557 generic.go:356] "Generic (PLEG): container finished" podID="86db17af-f33c-4a82-a04f-2f37f1cbfc7c" containerID="88f49721bd1fec9d4974d7352d511143baffa4d608edb58a0f60f33976a76b92" exitCode=0 Jul 22 21:45:57.978149 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:57.977781 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285433648" event={"ID":"86db17af-f33c-4a82-a04f-2f37f1cbfc7c","Type":"ContainerDied","Data":"88f49721bd1fec9d4974d7352d511143baffa4d608edb58a0f60f33976a76b92"} Jul 22 21:45:59.127603 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.127576 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285433648" Jul 22 21:45:59.138572 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.138532 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcchw\" (UniqueName: \"kubernetes.io/projected/86db17af-f33c-4a82-a04f-2f37f1cbfc7c-kube-api-access-hcchw\") pod \"86db17af-f33c-4a82-a04f-2f37f1cbfc7c\" (UID: \"86db17af-f33c-4a82-a04f-2f37f1cbfc7c\") " Jul 22 21:45:59.140880 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.140850 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86db17af-f33c-4a82-a04f-2f37f1cbfc7c-kube-api-access-hcchw" (OuterVolumeSpecName: "kube-api-access-hcchw") pod "86db17af-f33c-4a82-a04f-2f37f1cbfc7c" (UID: "86db17af-f33c-4a82-a04f-2f37f1cbfc7c"). InnerVolumeSpecName "kube-api-access-hcchw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:45:59.147954 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.147920 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7526-140462285433648_86db17af-f33c-4a82-a04f-2f37f1cbfc7c/test-curl-7526-140462285433648/0.log" Jul 22 21:45:59.174262 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.174222 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7526-140462285433648"] Jul 22 21:45:59.178184 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.178146 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7526-140462285433648"] Jul 22 21:45:59.239578 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.239482 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcchw\" (UniqueName: \"kubernetes.io/projected/86db17af-f33c-4a82-a04f-2f37f1cbfc7c-kube-api-access-hcchw\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:45:59.347907 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.347866 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7526-140462285526048"] Jul 22 21:45:59.348309 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.348295 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86db17af-f33c-4a82-a04f-2f37f1cbfc7c" containerName="test-curl-7526-140462285433648" Jul 22 21:45:59.348355 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.348311 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="86db17af-f33c-4a82-a04f-2f37f1cbfc7c" containerName="test-curl-7526-140462285433648" Jul 22 21:45:59.348398 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.348389 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="86db17af-f33c-4a82-a04f-2f37f1cbfc7c" containerName="test-curl-7526-140462285433648" Jul 22 21:45:59.351537 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.351516 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:45:59.357782 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.357748 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285526048"] Jul 22 21:45:59.440943 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.440901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtrgl\" (UniqueName: \"kubernetes.io/projected/854718a4-52e1-4ce7-8af2-aa135660498b-kube-api-access-vtrgl\") pod \"test-curl-7526-140462285526048\" (UID: \"854718a4-52e1-4ce7-8af2-aa135660498b\") " pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:45:59.541824 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.541724 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtrgl\" (UniqueName: \"kubernetes.io/projected/854718a4-52e1-4ce7-8af2-aa135660498b-kube-api-access-vtrgl\") pod \"test-curl-7526-140462285526048\" (UID: \"854718a4-52e1-4ce7-8af2-aa135660498b\") " pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:45:59.550267 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.550233 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtrgl\" (UniqueName: \"kubernetes.io/projected/854718a4-52e1-4ce7-8af2-aa135660498b-kube-api-access-vtrgl\") pod \"test-curl-7526-140462285526048\" (UID: \"854718a4-52e1-4ce7-8af2-aa135660498b\") " pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:45:59.662673 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.662630 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:45:59.812028 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.811991 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285526048"] Jul 22 21:45:59.813275 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:45:59.813247 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod854718a4_52e1_4ce7_8af2_aa135660498b.slice/crio-ab9538e46a0b70e22e0f2be94da912e548f495360d0a2c65d20b3a198b6f274e WatchSource:0}: Error finding container ab9538e46a0b70e22e0f2be94da912e548f495360d0a2c65d20b3a198b6f274e: Status 404 returned error can't find the container with id ab9538e46a0b70e22e0f2be94da912e548f495360d0a2c65d20b3a198b6f274e Jul 22 21:45:59.990937 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.990906 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285433648" Jul 22 21:45:59.991138 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.990948 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9582a838cf7beafd6834b9f38b81144854d12309aa80630aa77f484e959f0aa7" Jul 22 21:45:59.992204 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:45:59.992175 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285526048" event={"ID":"854718a4-52e1-4ce7-8af2-aa135660498b","Type":"ContainerStarted","Data":"ab9538e46a0b70e22e0f2be94da912e548f495360d0a2c65d20b3a198b6f274e"} Jul 22 21:46:00.001776 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:46:00.001738 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7526-140462285433648\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="86db17af-f33c-4a82-a04f-2f37f1cbfc7c" pod="opendatahub/test-curl-7526-140462285433648" Jul 22 21:46:00.874490 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:00.874421 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86db17af-f33c-4a82-a04f-2f37f1cbfc7c" path="/var/lib/kubelet/pods/86db17af-f33c-4a82-a04f-2f37f1cbfc7c/volumes" Jul 22 21:46:00.999899 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:00.999861 2557 generic.go:356] "Generic (PLEG): container finished" podID="854718a4-52e1-4ce7-8af2-aa135660498b" containerID="d6d7dcf9d2653b4c254a97f1b8f824f671b142986cddb14d9ad6566992baede3" exitCode=0 Jul 22 21:46:01.000068 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:00.999948 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285526048" event={"ID":"854718a4-52e1-4ce7-8af2-aa135660498b","Type":"ContainerDied","Data":"d6d7dcf9d2653b4c254a97f1b8f824f671b142986cddb14d9ad6566992baede3"} Jul 22 21:46:02.151566 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.151536 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:46:02.168912 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.168863 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtrgl\" (UniqueName: \"kubernetes.io/projected/854718a4-52e1-4ce7-8af2-aa135660498b-kube-api-access-vtrgl\") pod \"854718a4-52e1-4ce7-8af2-aa135660498b\" (UID: \"854718a4-52e1-4ce7-8af2-aa135660498b\") " Jul 22 21:46:02.171572 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.171526 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/854718a4-52e1-4ce7-8af2-aa135660498b-kube-api-access-vtrgl" (OuterVolumeSpecName: "kube-api-access-vtrgl") pod "854718a4-52e1-4ce7-8af2-aa135660498b" (UID: "854718a4-52e1-4ce7-8af2-aa135660498b"). InnerVolumeSpecName "kube-api-access-vtrgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:46:02.173454 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.173398 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7526-140462285526048_854718a4-52e1-4ce7-8af2-aa135660498b/test-curl-7526-140462285526048/0.log" Jul 22 21:46:02.200652 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.200611 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7526-140462285526048"] Jul 22 21:46:02.203058 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.203030 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7526-140462285526048"] Jul 22 21:46:02.269834 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.269741 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtrgl\" (UniqueName: \"kubernetes.io/projected/854718a4-52e1-4ce7-8af2-aa135660498b-kube-api-access-vtrgl\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:46:02.329001 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.328963 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7526-140462285526048"] Jul 22 21:46:02.329376 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.329362 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854718a4-52e1-4ce7-8af2-aa135660498b" containerName="test-curl-7526-140462285526048" Jul 22 21:46:02.329422 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.329378 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="854718a4-52e1-4ce7-8af2-aa135660498b" containerName="test-curl-7526-140462285526048" Jul 22 21:46:02.329493 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.329479 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="854718a4-52e1-4ce7-8af2-aa135660498b" containerName="test-curl-7526-140462285526048" Jul 22 21:46:02.332538 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.332519 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:46:02.340900 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.340853 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285526048"] Jul 22 21:46:02.370612 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.370571 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4hfj\" (UniqueName: \"kubernetes.io/projected/85576c5f-df8c-41e6-a767-19c393c08f9e-kube-api-access-v4hfj\") pod \"test-curl-7526-140462285526048\" (UID: \"85576c5f-df8c-41e6-a767-19c393c08f9e\") " pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:46:02.472053 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.472012 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4hfj\" (UniqueName: \"kubernetes.io/projected/85576c5f-df8c-41e6-a767-19c393c08f9e-kube-api-access-v4hfj\") pod \"test-curl-7526-140462285526048\" (UID: \"85576c5f-df8c-41e6-a767-19c393c08f9e\") " pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:46:02.481694 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.481671 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4hfj\" (UniqueName: \"kubernetes.io/projected/85576c5f-df8c-41e6-a767-19c393c08f9e-kube-api-access-v4hfj\") pod \"test-curl-7526-140462285526048\" (UID: \"85576c5f-df8c-41e6-a767-19c393c08f9e\") " pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:46:02.643953 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.643907 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:46:02.788103 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.788078 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285526048"] Jul 22 21:46:02.789976 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:46:02.789950 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85576c5f_df8c_41e6_a767_19c393c08f9e.slice/crio-5239cb16f59b5177d0ac3a3abb24c7a8dd367d708ae3e9df1dde87d60cce71a5 WatchSource:0}: Error finding container 5239cb16f59b5177d0ac3a3abb24c7a8dd367d708ae3e9df1dde87d60cce71a5: Status 404 returned error can't find the container with id 5239cb16f59b5177d0ac3a3abb24c7a8dd367d708ae3e9df1dde87d60cce71a5 Jul 22 21:46:02.874878 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:02.874846 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="854718a4-52e1-4ce7-8af2-aa135660498b" path="/var/lib/kubelet/pods/854718a4-52e1-4ce7-8af2-aa135660498b/volumes" Jul 22 21:46:03.013964 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:03.013838 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285526048" event={"ID":"85576c5f-df8c-41e6-a767-19c393c08f9e","Type":"ContainerStarted","Data":"5239cb16f59b5177d0ac3a3abb24c7a8dd367d708ae3e9df1dde87d60cce71a5"} Jul 22 21:46:03.015221 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:03.015194 2557 scope.go:117] "RemoveContainer" containerID="d6d7dcf9d2653b4c254a97f1b8f824f671b142986cddb14d9ad6566992baede3" Jul 22 21:46:03.015221 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:03.015207 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:46:04.022255 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:04.022219 2557 generic.go:356] "Generic (PLEG): container finished" podID="85576c5f-df8c-41e6-a767-19c393c08f9e" containerID="e855c1d456e812fb23f3196767805d41f36966dee57910268de8cdf41b7debf4" exitCode=0 Jul 22 21:46:04.022690 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:04.022311 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285526048" event={"ID":"85576c5f-df8c-41e6-a767-19c393c08f9e","Type":"ContainerDied","Data":"e855c1d456e812fb23f3196767805d41f36966dee57910268de8cdf41b7debf4"} Jul 22 21:46:04.497770 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:04.497728 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:46:05.169093 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.169063 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:46:05.192369 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.192334 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7526-140462285526048_85576c5f-df8c-41e6-a767-19c393c08f9e/test-curl-7526-140462285526048/0.log" Jul 22 21:46:05.198603 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.198571 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4hfj\" (UniqueName: \"kubernetes.io/projected/85576c5f-df8c-41e6-a767-19c393c08f9e-kube-api-access-v4hfj\") pod \"85576c5f-df8c-41e6-a767-19c393c08f9e\" (UID: \"85576c5f-df8c-41e6-a767-19c393c08f9e\") " Jul 22 21:46:05.200946 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.200921 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85576c5f-df8c-41e6-a767-19c393c08f9e-kube-api-access-v4hfj" (OuterVolumeSpecName: "kube-api-access-v4hfj") pod "85576c5f-df8c-41e6-a767-19c393c08f9e" (UID: "85576c5f-df8c-41e6-a767-19c393c08f9e"). InnerVolumeSpecName "kube-api-access-v4hfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:46:05.214501 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.214467 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7526-140462285526048"] Jul 22 21:46:05.220270 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.220238 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7526-140462285526048"] Jul 22 21:46:05.300197 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.300101 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4hfj\" (UniqueName: \"kubernetes.io/projected/85576c5f-df8c-41e6-a767-19c393c08f9e-kube-api-access-v4hfj\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:46:05.334645 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.334595 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7526-140462285527056"] Jul 22 21:46:05.335044 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.335029 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85576c5f-df8c-41e6-a767-19c393c08f9e" containerName="test-curl-7526-140462285526048" Jul 22 21:46:05.335044 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.335044 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="85576c5f-df8c-41e6-a767-19c393c08f9e" containerName="test-curl-7526-140462285526048" Jul 22 21:46:05.335138 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.335101 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="85576c5f-df8c-41e6-a767-19c393c08f9e" containerName="test-curl-7526-140462285526048" Jul 22 21:46:05.338177 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.338154 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:05.344502 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.344467 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285527056"] Jul 22 21:46:05.401548 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.401509 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9rcp\" (UniqueName: \"kubernetes.io/projected/b7c34605-a7e7-4dde-b125-5c21add674e0-kube-api-access-z9rcp\") pod \"test-curl-7526-140462285527056\" (UID: \"b7c34605-a7e7-4dde-b125-5c21add674e0\") " pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:05.502038 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.501998 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9rcp\" (UniqueName: \"kubernetes.io/projected/b7c34605-a7e7-4dde-b125-5c21add674e0-kube-api-access-z9rcp\") pod \"test-curl-7526-140462285527056\" (UID: \"b7c34605-a7e7-4dde-b125-5c21add674e0\") " pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:05.510900 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.510868 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9rcp\" (UniqueName: \"kubernetes.io/projected/b7c34605-a7e7-4dde-b125-5c21add674e0-kube-api-access-z9rcp\") pod \"test-curl-7526-140462285527056\" (UID: \"b7c34605-a7e7-4dde-b125-5c21add674e0\") " pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:05.649262 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.649222 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:05.795275 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:05.795243 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285527056"] Jul 22 21:46:05.797062 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:46:05.797033 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7c34605_a7e7_4dde_b125_5c21add674e0.slice/crio-61896cb58d97a4f26e7456433a5792bc7189ae539567ede67aea3888bae4c5ac WatchSource:0}: Error finding container 61896cb58d97a4f26e7456433a5792bc7189ae539567ede67aea3888bae4c5ac: Status 404 returned error can't find the container with id 61896cb58d97a4f26e7456433a5792bc7189ae539567ede67aea3888bae4c5ac Jul 22 21:46:06.036553 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:06.036463 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:46:06.036553 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:06.036473 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5239cb16f59b5177d0ac3a3abb24c7a8dd367d708ae3e9df1dde87d60cce71a5" Jul 22 21:46:06.037793 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:06.037767 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285527056" event={"ID":"b7c34605-a7e7-4dde-b125-5c21add674e0","Type":"ContainerStarted","Data":"61896cb58d97a4f26e7456433a5792bc7189ae539567ede67aea3888bae4c5ac"} Jul 22 21:46:06.047912 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:46:06.047877 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7526-140462285526048\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="85576c5f-df8c-41e6-a767-19c393c08f9e" pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:46:06.874020 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:46:06.873983 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7526-140462285526048\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="85576c5f-df8c-41e6-a767-19c393c08f9e" pod="opendatahub/test-curl-7526-140462285526048" Jul 22 21:46:06.875649 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:06.875627 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85576c5f-df8c-41e6-a767-19c393c08f9e" path="/var/lib/kubelet/pods/85576c5f-df8c-41e6-a767-19c393c08f9e/volumes" Jul 22 21:46:07.045052 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:07.045014 2557 generic.go:356] "Generic (PLEG): container finished" podID="b7c34605-a7e7-4dde-b125-5c21add674e0" containerID="eb3d0bc01cb39d52520133f5e822a8394d8b4784f0263fbdfa693b2805b6c5d2" exitCode=0 Jul 22 21:46:07.045251 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:07.045092 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285527056" event={"ID":"b7c34605-a7e7-4dde-b125-5c21add674e0","Type":"ContainerDied","Data":"eb3d0bc01cb39d52520133f5e822a8394d8b4784f0263fbdfa693b2805b6c5d2"} Jul 22 21:46:08.197151 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.197116 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:08.218605 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.218573 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7526-140462285527056_b7c34605-a7e7-4dde-b125-5c21add674e0/test-curl-7526-140462285527056/0.log" Jul 22 21:46:08.226971 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.226934 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9rcp\" (UniqueName: \"kubernetes.io/projected/b7c34605-a7e7-4dde-b125-5c21add674e0-kube-api-access-z9rcp\") pod \"b7c34605-a7e7-4dde-b125-5c21add674e0\" (UID: \"b7c34605-a7e7-4dde-b125-5c21add674e0\") " Jul 22 21:46:08.229355 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.229318 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7c34605-a7e7-4dde-b125-5c21add674e0-kube-api-access-z9rcp" (OuterVolumeSpecName: "kube-api-access-z9rcp") pod "b7c34605-a7e7-4dde-b125-5c21add674e0" (UID: "b7c34605-a7e7-4dde-b125-5c21add674e0"). InnerVolumeSpecName "kube-api-access-z9rcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:46:08.241915 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.241876 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7526-140462285527056"] Jul 22 21:46:08.248073 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.248024 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7526-140462285527056"] Jul 22 21:46:08.328242 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.328206 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9rcp\" (UniqueName: \"kubernetes.io/projected/b7c34605-a7e7-4dde-b125-5c21add674e0-kube-api-access-z9rcp\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:46:08.367299 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.367251 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7526-140462285527056"] Jul 22 21:46:08.367812 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.367792 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7c34605-a7e7-4dde-b125-5c21add674e0" containerName="test-curl-7526-140462285527056" Jul 22 21:46:08.367903 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.367815 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7c34605-a7e7-4dde-b125-5c21add674e0" containerName="test-curl-7526-140462285527056" Jul 22 21:46:08.367985 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.367919 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7c34605-a7e7-4dde-b125-5c21add674e0" containerName="test-curl-7526-140462285527056" Jul 22 21:46:08.371184 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.371149 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:08.378694 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.378636 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285527056"] Jul 22 21:46:08.428929 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.428886 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq228\" (UniqueName: \"kubernetes.io/projected/dec0bcef-8ed3-4ac0-86b3-41516a376d04-kube-api-access-wq228\") pod \"test-curl-7526-140462285527056\" (UID: \"dec0bcef-8ed3-4ac0-86b3-41516a376d04\") " pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:08.530350 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.530300 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq228\" (UniqueName: \"kubernetes.io/projected/dec0bcef-8ed3-4ac0-86b3-41516a376d04-kube-api-access-wq228\") pod \"test-curl-7526-140462285527056\" (UID: \"dec0bcef-8ed3-4ac0-86b3-41516a376d04\") " pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:08.538979 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.538940 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq228\" (UniqueName: \"kubernetes.io/projected/dec0bcef-8ed3-4ac0-86b3-41516a376d04-kube-api-access-wq228\") pod \"test-curl-7526-140462285527056\" (UID: \"dec0bcef-8ed3-4ac0-86b3-41516a376d04\") " pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:08.682412 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.682311 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:08.833774 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.833743 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7526-140462285527056"] Jul 22 21:46:08.835330 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:46:08.835290 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddec0bcef_8ed3_4ac0_86b3_41516a376d04.slice/crio-bc0cae034bb3f833b68f93ab8ebd9616c1922f8276a5915de5230d452f80cd33 WatchSource:0}: Error finding container bc0cae034bb3f833b68f93ab8ebd9616c1922f8276a5915de5230d452f80cd33: Status 404 returned error can't find the container with id bc0cae034bb3f833b68f93ab8ebd9616c1922f8276a5915de5230d452f80cd33 Jul 22 21:46:08.875660 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:08.875624 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7c34605-a7e7-4dde-b125-5c21add674e0" path="/var/lib/kubelet/pods/b7c34605-a7e7-4dde-b125-5c21add674e0/volumes" Jul 22 21:46:09.058887 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:09.058794 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:09.058887 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:09.058807 2557 scope.go:117] "RemoveContainer" containerID="eb3d0bc01cb39d52520133f5e822a8394d8b4784f0263fbdfa693b2805b6c5d2" Jul 22 21:46:09.060265 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:09.060194 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285527056" event={"ID":"dec0bcef-8ed3-4ac0-86b3-41516a376d04","Type":"ContainerStarted","Data":"bc0cae034bb3f833b68f93ab8ebd9616c1922f8276a5915de5230d452f80cd33"} Jul 22 21:46:10.069124 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:10.069084 2557 generic.go:356] "Generic (PLEG): container finished" podID="dec0bcef-8ed3-4ac0-86b3-41516a376d04" containerID="497b5e4ddfb2d063b966c7ededd35743af4083a315497c64cc38f3912f8bd97b" exitCode=0 Jul 22 21:46:10.071602 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:10.069140 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7526-140462285527056" event={"ID":"dec0bcef-8ed3-4ac0-86b3-41516a376d04","Type":"ContainerDied","Data":"497b5e4ddfb2d063b966c7ededd35743af4083a315497c64cc38f3912f8bd97b"} Jul 22 21:46:11.223842 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:11.223805 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:11.244026 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:11.243991 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7526-140462285527056_dec0bcef-8ed3-4ac0-86b3-41516a376d04/test-curl-7526-140462285527056/0.log" Jul 22 21:46:11.253278 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:11.253245 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq228\" (UniqueName: \"kubernetes.io/projected/dec0bcef-8ed3-4ac0-86b3-41516a376d04-kube-api-access-wq228\") pod \"dec0bcef-8ed3-4ac0-86b3-41516a376d04\" (UID: \"dec0bcef-8ed3-4ac0-86b3-41516a376d04\") " Jul 22 21:46:11.255730 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:11.255694 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec0bcef-8ed3-4ac0-86b3-41516a376d04-kube-api-access-wq228" (OuterVolumeSpecName: "kube-api-access-wq228") pod "dec0bcef-8ed3-4ac0-86b3-41516a376d04" (UID: "dec0bcef-8ed3-4ac0-86b3-41516a376d04"). InnerVolumeSpecName "kube-api-access-wq228". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 21:46:11.266978 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:11.266933 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7526-140462285527056"] Jul 22 21:46:11.270273 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:11.270238 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7526-140462285527056"] Jul 22 21:46:11.354084 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:11.354050 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq228\" (UniqueName: \"kubernetes.io/projected/dec0bcef-8ed3-4ac0-86b3-41516a376d04-kube-api-access-wq228\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 22 21:46:12.082811 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:12.082781 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:12.083007 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:12.082821 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc0cae034bb3f833b68f93ab8ebd9616c1922f8276a5915de5230d452f80cd33" Jul 22 21:46:12.092855 ip-10-0-141-215 kubenswrapper[2557]: E0722 21:46:12.092820 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7526-140462285527056\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="dec0bcef-8ed3-4ac0-86b3-41516a376d04" pod="opendatahub/test-curl-7526-140462285527056" Jul 22 21:46:12.875508 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:12.875462 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dec0bcef-8ed3-4ac0-86b3-41516a376d04" path="/var/lib/kubelet/pods/dec0bcef-8ed3-4ac0-86b3-41516a376d04/volumes" Jul 22 21:46:25.195587 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:25.195551 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:46:46.501576 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:46.501535 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d46wh"] Jul 22 21:46:55.881393 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:55.881351 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574555674d-4z27r_8a063322-d7a6-481c-9e1b-702b8516e096/authorino/0.log" Jul 22 21:46:57.145843 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:57.145807 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:46:57.150623 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:57.150592 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:46:57.152090 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:57.152066 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:46:57.156946 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:46:57.156921 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-swcmh_b06ebac5-6877-4ec2-acd3-5d30adc0a66f/ovn-acl-logging/0.log" Jul 22 21:47:01.357769 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:01.357733 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-n2d7v_d9047eaa-a1d6-4123-a1f3-d67c4af7b03f/manager/0.log" Jul 22 21:47:01.941985 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:01.941959 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846644596-mgmtb_294931d0-fe19-4bc4-9f30-e85b7d5d7742/copy-manifests/0.log" Jul 22 21:47:01.949589 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:01.949556 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846644596-mgmtb_294931d0-fe19-4bc4-9f30-e85b7d5d7742/manager/0.log" Jul 22 21:47:03.805129 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:03.805096 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s_12293e33-dc6c-4153-a5c0-879e0bb44bed/util/0.log" Jul 22 21:47:03.811358 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:03.811333 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s_12293e33-dc6c-4153-a5c0-879e0bb44bed/pull/0.log" Jul 22 21:47:03.817364 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:03.817342 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s_12293e33-dc6c-4153-a5c0-879e0bb44bed/extract/0.log" Jul 22 21:47:03.927115 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:03.927084 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc_0341874a-7644-4eb7-a413-9a3ad6763442/pull/0.log" Jul 22 21:47:03.933541 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:03.933511 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc_0341874a-7644-4eb7-a413-9a3ad6763442/extract/0.log" Jul 22 21:47:03.939509 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:03.939492 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc_0341874a-7644-4eb7-a413-9a3ad6763442/util/0.log" Jul 22 21:47:04.052095 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:04.052064 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz_1e59d299-3730-45e6-8818-861a3b1636d3/extract/0.log" Jul 22 21:47:04.058406 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:04.058339 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz_1e59d299-3730-45e6-8818-861a3b1636d3/util/0.log" Jul 22 21:47:04.065732 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:04.065710 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz_1e59d299-3730-45e6-8818-861a3b1636d3/pull/0.log" Jul 22 21:47:04.177141 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:04.177114 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf_07ecf2e0-3880-4209-a5f4-23ab23286b72/util/0.log" Jul 22 21:47:04.184176 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:04.184153 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf_07ecf2e0-3880-4209-a5f4-23ab23286b72/pull/0.log" Jul 22 21:47:04.191288 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:04.191261 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf_07ecf2e0-3880-4209-a5f4-23ab23286b72/extract/0.log" Jul 22 21:47:04.318139 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:04.318050 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574555674d-4z27r_8a063322-d7a6-481c-9e1b-702b8516e096/authorino/0.log" Jul 22 21:47:04.554682 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:04.554652 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6nrvm_ed826065-7e17-44f5-ad1d-26bc8cf21bc3/manager/0.log" Jul 22 21:47:04.793776 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:04.793738 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sht78_4d1049c2-1457-4e21-8033-321ccd84c4e9/registry-server/0.log" Jul 22 21:47:05.025275 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:05.025248 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d46wh_954c9240-b8e5-4e73-aabf-ed252e8420b3/limitador/0.log" Jul 22 21:47:05.149810 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:05.149770 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rkbfn_d1774e78-d26f-4168-b107-39e9ded66d46/manager/0.log" Jul 22 21:47:05.497391 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:05.497310 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vr5bv_b8ddec1d-3275-433e-8111-e4d100a641fa/istio-proxy/0.log" Jul 22 21:47:05.958793 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:05.958758 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dzsxm_f134018c-a35b-442e-8438-9d865b7a3535/istio-proxy/1.log" Jul 22 21:47:06.299192 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:06.299100 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c69f9dccb-qd97j_252c0d53-08ac-4f77-b716-489cc651023d/router/0.log" Jul 22 21:47:06.876392 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:06.876365 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-stngq_eb758c2f-2c70-47e1-812b-49e9bbe12cfc/main/0.log" Jul 22 21:47:12.692393 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.692360 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rv7sd/must-gather-vd7b9"] Jul 22 21:47:12.692985 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.692963 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec0bcef-8ed3-4ac0-86b3-41516a376d04" containerName="test-curl-7526-140462285527056" Jul 22 21:47:12.693068 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.692988 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec0bcef-8ed3-4ac0-86b3-41516a376d04" containerName="test-curl-7526-140462285527056" Jul 22 21:47:12.693114 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.693090 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dec0bcef-8ed3-4ac0-86b3-41516a376d04" containerName="test-curl-7526-140462285527056" Jul 22 21:47:12.696359 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.696344 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rv7sd/must-gather-vd7b9" Jul 22 21:47:12.698795 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.698761 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rv7sd\"/\"default-dockercfg-cpdmh\"" Jul 22 21:47:12.698925 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.698788 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rv7sd\"/\"openshift-service-ca.crt\"" Jul 22 21:47:12.698925 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.698889 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rv7sd\"/\"kube-root-ca.crt\"" Jul 22 21:47:12.706953 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.706925 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rv7sd/must-gather-vd7b9"] Jul 22 21:47:12.852987 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.852951 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjsj4\" (UniqueName: \"kubernetes.io/projected/fa8dafa1-f6c6-4027-9f93-d63e387b9bb0-kube-api-access-tjsj4\") pod \"must-gather-vd7b9\" (UID: \"fa8dafa1-f6c6-4027-9f93-d63e387b9bb0\") " pod="openshift-must-gather-rv7sd/must-gather-vd7b9" Jul 22 21:47:12.853195 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.853043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fa8dafa1-f6c6-4027-9f93-d63e387b9bb0-must-gather-output\") pod \"must-gather-vd7b9\" (UID: \"fa8dafa1-f6c6-4027-9f93-d63e387b9bb0\") " pod="openshift-must-gather-rv7sd/must-gather-vd7b9" Jul 22 21:47:12.954502 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.954407 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjsj4\" (UniqueName: \"kubernetes.io/projected/fa8dafa1-f6c6-4027-9f93-d63e387b9bb0-kube-api-access-tjsj4\") pod \"must-gather-vd7b9\" (UID: \"fa8dafa1-f6c6-4027-9f93-d63e387b9bb0\") " pod="openshift-must-gather-rv7sd/must-gather-vd7b9" Jul 22 21:47:12.954680 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.954528 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fa8dafa1-f6c6-4027-9f93-d63e387b9bb0-must-gather-output\") pod \"must-gather-vd7b9\" (UID: \"fa8dafa1-f6c6-4027-9f93-d63e387b9bb0\") " pod="openshift-must-gather-rv7sd/must-gather-vd7b9" Jul 22 21:47:12.954881 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.954861 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fa8dafa1-f6c6-4027-9f93-d63e387b9bb0-must-gather-output\") pod \"must-gather-vd7b9\" (UID: \"fa8dafa1-f6c6-4027-9f93-d63e387b9bb0\") " pod="openshift-must-gather-rv7sd/must-gather-vd7b9" Jul 22 21:47:12.962465 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:12.962413 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjsj4\" (UniqueName: \"kubernetes.io/projected/fa8dafa1-f6c6-4027-9f93-d63e387b9bb0-kube-api-access-tjsj4\") pod \"must-gather-vd7b9\" (UID: \"fa8dafa1-f6c6-4027-9f93-d63e387b9bb0\") " pod="openshift-must-gather-rv7sd/must-gather-vd7b9" Jul 22 21:47:13.007225 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:13.007188 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rv7sd/must-gather-vd7b9" Jul 22 21:47:13.153985 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:13.153959 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rv7sd/must-gather-vd7b9"] Jul 22 21:47:13.155834 ip-10-0-141-215 kubenswrapper[2557]: W0722 21:47:13.155803 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa8dafa1_f6c6_4027_9f93_d63e387b9bb0.slice/crio-48f98e2c02af60e2dfd3ae69445bcb9920aeb1074c0829c59e92d52c0f70a2c3 WatchSource:0}: Error finding container 48f98e2c02af60e2dfd3ae69445bcb9920aeb1074c0829c59e92d52c0f70a2c3: Status 404 returned error can't find the container with id 48f98e2c02af60e2dfd3ae69445bcb9920aeb1074c0829c59e92d52c0f70a2c3 Jul 22 21:47:13.451742 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:13.451700 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rv7sd/must-gather-vd7b9" event={"ID":"fa8dafa1-f6c6-4027-9f93-d63e387b9bb0","Type":"ContainerStarted","Data":"48f98e2c02af60e2dfd3ae69445bcb9920aeb1074c0829c59e92d52c0f70a2c3"} Jul 22 21:47:14.462783 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:14.462731 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rv7sd/must-gather-vd7b9" event={"ID":"fa8dafa1-f6c6-4027-9f93-d63e387b9bb0","Type":"ContainerStarted","Data":"ac1410a7e5f35ac8b4c7285ccc6ef466c3ca35bd96bdcf4e27635e8dc214505d"} Jul 22 21:47:15.476624 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:15.476582 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rv7sd/must-gather-vd7b9" event={"ID":"fa8dafa1-f6c6-4027-9f93-d63e387b9bb0","Type":"ContainerStarted","Data":"9ac9488aa11cdf8129e66c590d058a64bc15fdc7d03bcbe21064911c108e7edc"} Jul 22 21:47:15.492019 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:15.491946 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rv7sd/must-gather-vd7b9" podStartSLOduration=2.369079604 podStartE2EDuration="3.491921677s" totalImagesPullingTime="1.122842073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:47:15.490576135 +0000 UTC m=+3019.030084453" watchObservedRunningTime="2026-07-22 21:47:15.491921677 +0000 UTC m=+3019.031429979" Jul 22 21:47:16.004391 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:16.004336 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fmkq4_75dc5369-9597-4d82-9dee-89ad4a855dbe/global-pull-secret-syncer/0.log" Jul 22 21:47:16.123758 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:16.123697 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xp7dn_f9adb415-0104-487d-80a4-5a3e9811efee/konnectivity-agent/0.log" Jul 22 21:47:16.191184 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:16.191145 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-215.ec2.internal_d3282c041206637c42d4d82945b902f9/haproxy/0.log" Jul 22 21:47:21.321423 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.321376 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s_12293e33-dc6c-4153-a5c0-879e0bb44bed/extract/0.log" Jul 22 21:47:21.340860 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.340821 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s_12293e33-dc6c-4153-a5c0-879e0bb44bed/util/0.log" Jul 22 21:47:21.366220 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.366182 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ms7s_12293e33-dc6c-4153-a5c0-879e0bb44bed/pull/0.log" Jul 22 21:47:21.394572 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.394535 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc_0341874a-7644-4eb7-a413-9a3ad6763442/extract/0.log" Jul 22 21:47:21.416203 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.416168 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc_0341874a-7644-4eb7-a413-9a3ad6763442/util/0.log" Jul 22 21:47:21.438583 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.438541 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r2qhc_0341874a-7644-4eb7-a413-9a3ad6763442/pull/0.log" Jul 22 21:47:21.464201 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.464080 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz_1e59d299-3730-45e6-8818-861a3b1636d3/extract/0.log" Jul 22 21:47:21.486000 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.485974 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz_1e59d299-3730-45e6-8818-861a3b1636d3/util/0.log" Jul 22 21:47:21.508060 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.508027 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f2hfz_1e59d299-3730-45e6-8818-861a3b1636d3/pull/0.log" Jul 22 21:47:21.538687 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.538609 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf_07ecf2e0-3880-4209-a5f4-23ab23286b72/extract/0.log" Jul 22 21:47:21.563260 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.563213 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf_07ecf2e0-3880-4209-a5f4-23ab23286b72/util/0.log" Jul 22 21:47:21.586554 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:21.586523 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7mqf_07ecf2e0-3880-4209-a5f4-23ab23286b72/pull/0.log" Jul 22 21:47:22.052566 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:22.051145 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574555674d-4z27r_8a063322-d7a6-481c-9e1b-702b8516e096/authorino/0.log" Jul 22 21:47:22.153169 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:22.153143 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6nrvm_ed826065-7e17-44f5-ad1d-26bc8cf21bc3/manager/0.log" Jul 22 21:47:22.253107 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:22.253073 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sht78_4d1049c2-1457-4e21-8033-321ccd84c4e9/registry-server/0.log" Jul 22 21:47:22.417395 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:22.417365 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d46wh_954c9240-b8e5-4e73-aabf-ed252e8420b3/limitador/0.log" Jul 22 21:47:22.500973 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:22.500810 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rkbfn_d1774e78-d26f-4168-b107-39e9ded66d46/manager/0.log" Jul 22 21:47:24.276780 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.276652 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-l6w64_ea28784d-6539-4974-8542-ce1ce879d129/cluster-monitoring-operator/0.log" Jul 22 21:47:24.315742 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.315709 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-crvhz_5616ac0e-f5c3-48fa-9afb-694747dc26f9/kube-state-metrics/0.log" Jul 22 21:47:24.336662 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.336629 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-crvhz_5616ac0e-f5c3-48fa-9afb-694747dc26f9/kube-rbac-proxy-main/0.log" Jul 22 21:47:24.363772 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.363737 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-crvhz_5616ac0e-f5c3-48fa-9afb-694747dc26f9/kube-rbac-proxy-self/0.log" Jul 22 21:47:24.399230 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.399140 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-598987cddf-nw7s4_9330859d-8dfb-42da-aa88-8542d8662222/metrics-server/0.log" Jul 22 21:47:24.426168 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.426108 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-vl7p2_dca96186-f5ee-435b-9a7d-734214916869/monitoring-plugin/0.log" Jul 22 21:47:24.462168 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.462124 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-52plc_011ce416-92a1-46ff-b0fc-649a7e72921d/node-exporter/0.log" Jul 22 21:47:24.493868 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.493838 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-52plc_011ce416-92a1-46ff-b0fc-649a7e72921d/kube-rbac-proxy/0.log" Jul 22 21:47:24.519678 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.519650 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-52plc_011ce416-92a1-46ff-b0fc-649a7e72921d/init-textfile/0.log" Jul 22 21:47:24.699364 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.699295 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bwb97_86d14b48-1706-4ed9-9c5a-c97f6132e702/kube-rbac-proxy-main/0.log" Jul 22 21:47:24.722973 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.722943 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bwb97_86d14b48-1706-4ed9-9c5a-c97f6132e702/kube-rbac-proxy-self/0.log" Jul 22 21:47:24.745288 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.745256 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bwb97_86d14b48-1706-4ed9-9c5a-c97f6132e702/openshift-state-metrics/0.log" Jul 22 21:47:24.942804 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.942750 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-dlsxp_d398a525-7df4-4296-bc1b-f06acab23842/prometheus-operator/0.log" Jul 22 21:47:24.960246 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.960133 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-dlsxp_d398a525-7df4-4296-bc1b-f06acab23842/kube-rbac-proxy/0.log" Jul 22 21:47:24.987945 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:24.987888 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-fm9ml_16085d6b-cade-4b0b-894e-b2663dac12d2/prometheus-operator-admission-webhook/0.log" Jul 22 21:47:25.092244 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:25.092214 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5699cfc5fc-4whsb_2fa21246-d00c-4d9c-8b46-80f9b9bb5562/thanos-query/0.log" Jul 22 21:47:25.115232 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:25.115199 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5699cfc5fc-4whsb_2fa21246-d00c-4d9c-8b46-80f9b9bb5562/kube-rbac-proxy-web/0.log" Jul 22 21:47:25.140553 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:25.140491 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5699cfc5fc-4whsb_2fa21246-d00c-4d9c-8b46-80f9b9bb5562/kube-rbac-proxy/0.log" Jul 22 21:47:25.163339 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:25.163308 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5699cfc5fc-4whsb_2fa21246-d00c-4d9c-8b46-80f9b9bb5562/prom-label-proxy/0.log" Jul 22 21:47:25.185640 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:25.185591 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5699cfc5fc-4whsb_2fa21246-d00c-4d9c-8b46-80f9b9bb5562/kube-rbac-proxy-rules/0.log" Jul 22 21:47:25.225375 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:25.225289 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5699cfc5fc-4whsb_2fa21246-d00c-4d9c-8b46-80f9b9bb5562/kube-rbac-proxy-metrics/0.log" Jul 22 21:47:26.365912 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.365872 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97"] Jul 22 21:47:26.373992 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.373953 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.378578 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.378485 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97"] Jul 22 21:47:26.417542 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.417502 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5592\" (UniqueName: \"kubernetes.io/projected/472d62fc-7cf4-46b5-b437-aa52885b84cb-kube-api-access-c5592\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.417816 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.417796 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-sys\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.418009 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.417995 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-proc\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.418260 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.418242 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-lib-modules\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.418424 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.418410 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-podres\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.519369 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.519332 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-lib-modules\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.519369 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.519381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-podres\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.519647 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.519459 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5592\" (UniqueName: \"kubernetes.io/projected/472d62fc-7cf4-46b5-b437-aa52885b84cb-kube-api-access-c5592\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.519647 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.519564 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-lib-modules\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.519647 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.519579 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-podres\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.519647 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.519610 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-sys\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.519867 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.519655 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-proc\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.519867 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.519724 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-sys\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.519867 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.519781 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/472d62fc-7cf4-46b5-b437-aa52885b84cb-proc\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.528563 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.528493 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5592\" (UniqueName: \"kubernetes.io/projected/472d62fc-7cf4-46b5-b437-aa52885b84cb-kube-api-access-c5592\") pod \"perf-node-gather-daemonset-7fm97\" (UID: \"472d62fc-7cf4-46b5-b437-aa52885b84cb\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.695263 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.695176 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:26.910963 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:26.910592 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97"] Jul 22 21:47:27.073241 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:27.073201 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/2.log" Jul 22 21:47:27.079142 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:27.079106 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bvgwp_beaa77f6-0828-48c3-953c-0bacf46c177b/console-operator/3.log" Jul 22 21:47:27.572825 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:27.572792 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ff7d68bdd-nbdct_8506fa63-eef4-4cb5-ac0b-9721010dca6f/console/0.log" Jul 22 21:47:27.591006 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:27.590970 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" event={"ID":"472d62fc-7cf4-46b5-b437-aa52885b84cb","Type":"ContainerStarted","Data":"510b6f78033ec3a279eadaa277cc4eb6e40853313c4176e3313a18ba8fba4a84"} Jul 22 21:47:27.591305 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:27.591284 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" event={"ID":"472d62fc-7cf4-46b5-b437-aa52885b84cb","Type":"ContainerStarted","Data":"c2dfdece31c85168e9c343146a8b8db9b2f531c8b3df4d5b61ad05b57328f680"} Jul 22 21:47:27.591479 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:27.591462 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:27.608413 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:27.608358 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-j688d_dc5f4ccd-270a-485b-a7bf-4d3d022da1ea/download-server/0.log" Jul 22 21:47:29.340303 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:29.340252 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zhcx7_ef1dd499-990b-49f1-adb6-9e68904d36ed/dns/0.log" Jul 22 21:47:29.360793 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:29.360740 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zhcx7_ef1dd499-990b-49f1-adb6-9e68904d36ed/kube-rbac-proxy/0.log" Jul 22 21:47:29.429866 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:29.429828 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g6tpx_6a4189a4-946c-42c6-9fe3-95db3c0c73bd/dns-node-resolver/0.log" Jul 22 21:47:29.988573 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:29.988543 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2tl7d_400c915a-cea5-4e42-bb74-437f9e93133a/node-ca/0.log" Jul 22 21:47:30.940206 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:30.940165 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vr5bv_b8ddec1d-3275-433e-8111-e4d100a641fa/istio-proxy/0.log" Jul 22 21:47:31.142210 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:31.142181 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dzsxm_f134018c-a35b-442e-8438-9d865b7a3535/istio-proxy/0.log" Jul 22 21:47:31.176855 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:31.176802 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dzsxm_f134018c-a35b-442e-8438-9d865b7a3535/istio-proxy/1.log" Jul 22 21:47:31.259426 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:31.259301 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c69f9dccb-qd97j_252c0d53-08ac-4f77-b716-489cc651023d/router/0.log" Jul 22 21:47:31.956326 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:31.956292 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jz77h_2861d068-fec4-432f-b35e-3d9c9f81154d/serve-healthcheck-canary/0.log" Jul 22 21:47:32.484306 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:32.484267 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-bw9fb_c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1/insights-operator/0.log" Jul 22 21:47:32.484656 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:32.484630 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-bw9fb_c075f6a4-3da1-4ae6-b3d9-65748bc0c1c1/insights-operator/1.log" Jul 22 21:47:32.659195 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:32.659160 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qzn68_a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3/kube-rbac-proxy/0.log" Jul 22 21:47:32.680193 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:32.680165 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qzn68_a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3/exporter/0.log" Jul 22 21:47:32.702581 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:32.702546 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qzn68_a0ce1ccb-0a34-4afe-9a53-6a7cd4d7ebd3/extractor/0.log" Jul 22 21:47:33.611166 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:33.611134 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" Jul 22 21:47:33.627881 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:33.627801 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-7fm97" podStartSLOduration=7.627777207 podStartE2EDuration="7.627777207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:47:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:47:27.608903947 +0000 UTC m=+3031.148412252" watchObservedRunningTime="2026-07-22 21:47:33.627777207 +0000 UTC m=+3037.167285510" Jul 22 21:47:34.839963 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:34.839929 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-n2d7v_d9047eaa-a1d6-4123-a1f3-d67c4af7b03f/manager/0.log" Jul 22 21:47:35.242880 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:35.242785 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846644596-mgmtb_294931d0-fe19-4bc4-9f30-e85b7d5d7742/manager/0.log" Jul 22 21:47:35.265050 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:35.265018 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846644596-mgmtb_294931d0-fe19-4bc4-9f30-e85b7d5d7742/copy-manifests/0.log" Jul 22 21:47:36.882180 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:36.882067 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7dc9694985-9kq52_3136f806-3e7e-4f99-a7fd-b6856e4b480f/manager/0.log" Jul 22 21:47:36.930085 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:36.930028 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-jbqbn_76bcf0d0-9273-41cb-b98f-fdc26d27d9d7/openshift-lws-operator/0.log" Jul 22 21:47:37.617067 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:37.617029 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vr5bv_b8ddec1d-3275-433e-8111-e4d100a641fa/istio-proxy/0.log" Jul 22 21:47:37.784548 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:37.784493 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dzsxm_f134018c-a35b-442e-8438-9d865b7a3535/istio-proxy/0.log" Jul 22 21:47:37.822216 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:37.822184 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dzsxm_f134018c-a35b-442e-8438-9d865b7a3535/istio-proxy/1.log" Jul 22 21:47:37.881380 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:37.881297 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c69f9dccb-qd97j_252c0d53-08ac-4f77-b716-489cc651023d/router/0.log" Jul 22 21:47:39.073724 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:39.073695 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vr5bv_b8ddec1d-3275-433e-8111-e4d100a641fa/istio-proxy/0.log" Jul 22 21:47:39.253907 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:39.253864 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dzsxm_f134018c-a35b-442e-8438-9d865b7a3535/istio-proxy/0.log" Jul 22 21:47:39.292986 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:39.292952 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dzsxm_f134018c-a35b-442e-8438-9d865b7a3535/istio-proxy/1.log" Jul 22 21:47:39.348615 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:39.348578 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c69f9dccb-qd97j_252c0d53-08ac-4f77-b716-489cc651023d/router/0.log" Jul 22 21:47:42.322170 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:42.322135 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-csx4s_472c551d-bdfe-4ec3-910e-49ba89267ecf/kube-storage-version-migrator-operator/1.log" Jul 22 21:47:42.323177 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:42.323156 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-csx4s_472c551d-bdfe-4ec3-910e-49ba89267ecf/kube-storage-version-migrator-operator/0.log" Jul 22 21:47:43.270363 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:43.270330 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tpx6_210cd3a4-c863-42d9-b923-2861068be417/kube-multus-additional-cni-plugins/0.log" Jul 22 21:47:43.292274 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:43.292247 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tpx6_210cd3a4-c863-42d9-b923-2861068be417/egress-router-binary-copy/0.log" Jul 22 21:47:43.311995 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:43.311968 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tpx6_210cd3a4-c863-42d9-b923-2861068be417/cni-plugins/0.log" Jul 22 21:47:43.332398 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:43.332363 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tpx6_210cd3a4-c863-42d9-b923-2861068be417/bond-cni-plugin/0.log" Jul 22 21:47:43.353200 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:43.353170 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tpx6_210cd3a4-c863-42d9-b923-2861068be417/routeoverride-cni/0.log" Jul 22 21:47:43.374997 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:43.374972 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tpx6_210cd3a4-c863-42d9-b923-2861068be417/whereabouts-cni-bincopy/0.log" Jul 22 21:47:43.395140 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:43.395108 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tpx6_210cd3a4-c863-42d9-b923-2861068be417/whereabouts-cni/0.log" Jul 22 21:47:43.731387 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:43.731350 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d7krj_0c400296-cf77-42dd-8c41-6866af91b447/kube-multus/0.log" Jul 22 21:47:43.827076 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:43.827045 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5s2tf_3b98e5db-0164-4705-8954-50b7dcb3cc39/network-metrics-daemon/0.log" Jul 22 21:47:43.847200 ip-10-0-141-215 kubenswrapper[2557]: I0722 21:47:43.847166 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5s2tf_3b98e5db-0164-4705-8954-50b7dcb3cc39/kube-rbac-proxy/0.log"