Jul 06 22:44:11.162229 ip-10-0-142-117 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 22:44:11.162240 ip-10-0-142-117 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 22:44:11.162251 ip-10-0-142-117 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 22:44:11.162668 ip-10-0-142-117 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 22:44:21.571938 ip-10-0-142-117 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 06 22:44:21.571956 ip-10-0-142-117 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4b2709db418849138c048a60a44ebbb9 -- Jul 06 22:46:11.553851 ip-10-0-142-117 systemd[1]: Starting Kubernetes Kubelet... Jul 06 22:46:12.010493 ip-10-0-142-117 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:46:12.010493 ip-10-0-142-117 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 22:46:12.010493 ip-10-0-142-117 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:46:12.010493 ip-10-0-142-117 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 22:46:12.010493 ip-10-0-142-117 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:46:12.013506 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.013355 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 22:46:12.018681 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018653 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:12.018681 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018679 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:12.018681 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018683 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018687 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018690 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018694 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018697 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018700 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018703 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018706 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018709 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018712 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018715 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018718 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018721 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018724 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018727 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018730 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018733 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018736 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018746 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018749 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:12.018792 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018752 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018755 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018757 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018760 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018763 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018765 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018768 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018771 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018773 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018777 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018779 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018782 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018785 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018788 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018792 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018796 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018799 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018802 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018805 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018809 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:12.019289 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018811 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018814 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018818 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018821 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018824 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018827 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018830 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018834 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018837 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018840 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018842 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018845 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018848 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018851 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018853 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018856 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018859 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018861 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018864 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018867 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:12.019885 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018870 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018872 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018875 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018878 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018880 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018883 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018886 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018890 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018894 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018899 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018902 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018905 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018909 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018912 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018915 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018918 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018924 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018928 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:12.020401 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018931 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018935 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018939 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018943 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018945 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018948 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018952 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018955 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018957 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018960 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018962 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018965 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018968 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018971 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018974 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018977 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018979 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018982 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.018986 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:12.020880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019945 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019957 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019961 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019965 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019969 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019972 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019975 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019978 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019982 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019986 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019989 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019992 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019995 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.019997 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020000 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020003 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020006 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020008 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020011 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:12.021379 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020014 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020016 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020020 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020024 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020027 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020030 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020033 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020036 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020039 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020042 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020044 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020047 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020050 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020053 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020057 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020060 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020063 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020066 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020069 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020071 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:12.021900 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020074 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020077 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020080 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020083 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020086 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020088 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020091 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020094 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020097 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020099 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020102 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020105 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020108 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020111 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020113 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020116 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020119 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020122 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020125 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:12.022460 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020128 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020130 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020133 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020136 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020139 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020142 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020144 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020148 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020150 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020153 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020182 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020186 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020190 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020194 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020198 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020201 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020205 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020209 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020212 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020214 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:12.022983 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020217 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020220 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020223 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020225 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020228 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020231 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020234 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020236 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020239 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020245 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020247 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020250 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020253 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020255 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020258 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020261 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020264 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020267 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020270 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020275 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:12.023513 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.020278 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021270 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021280 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021284 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021288 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021291 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021295 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021298 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021301 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021308 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021311 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021314 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021317 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021320 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021323 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021326 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021328 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021331 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021334 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021337 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:12.024069 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021340 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021343 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021346 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021350 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021354 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021356 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021359 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021362 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021365 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021368 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021370 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021375 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021379 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021383 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021386 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021389 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021392 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021395 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021398 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:12.024630 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021401 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021403 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021406 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021410 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021413 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021415 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021419 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021421 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021424 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021427 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021430 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021432 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021435 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021438 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021440 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021443 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021446 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021448 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021451 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021454 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:12.025119 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021456 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021459 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021462 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021464 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021468 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021470 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021473 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021478 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021482 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021485 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021488 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021491 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021494 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021497 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021500 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021503 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021506 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021509 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021512 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:12.025649 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021514 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021517 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021520 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021523 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021525 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021539 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021543 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021545 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021548 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021551 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021554 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021556 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021559 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021563 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021565 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021568 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021588 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021592 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021595 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021598 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:12.026165 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021601 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.021604 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021708 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021718 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021730 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021746 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021752 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021755 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021760 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021765 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021769 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021773 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021777 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021781 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021784 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021788 2568 flags.go:64] FLAG: --cgroup-root="" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021791 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021794 2568 flags.go:64] FLAG: --client-ca-file="" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021797 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021801 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021805 2568 flags.go:64] FLAG: --cluster-domain="" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021808 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021812 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021815 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 22:46:12.026706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021820 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021824 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021827 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021830 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021834 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021838 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021842 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021845 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021848 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021853 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021857 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021861 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021864 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021867 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021871 2568 flags.go:64] FLAG: --enable-server="true" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021874 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021880 2568 flags.go:64] FLAG: --event-burst="100" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021883 2568 flags.go:64] FLAG: --event-qps="50" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021886 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021893 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021896 2568 flags.go:64] FLAG: --eviction-hard="" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021902 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021905 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021909 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021912 2568 flags.go:64] FLAG: --eviction-soft="" Jul 06 22:46:12.027350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021916 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021919 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021922 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021925 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021929 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021932 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021935 2568 flags.go:64] FLAG: --feature-gates="" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021942 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021946 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021949 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021953 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021956 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021960 2568 flags.go:64] FLAG: --help="false" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021963 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021966 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021970 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021973 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021977 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021980 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021983 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021986 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021989 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021992 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 22:46:12.028027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021995 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.021999 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022002 2568 flags.go:64] FLAG: --kube-reserved="" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022007 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022011 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022015 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022018 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022021 2568 flags.go:64] FLAG: --lock-file="" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022024 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022027 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022031 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022037 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022041 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022044 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022047 2568 flags.go:64] FLAG: --logging-format="text" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022050 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022054 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022057 2568 flags.go:64] FLAG: --manifest-url="" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022060 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022065 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022068 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022077 2568 flags.go:64] FLAG: --max-pods="110" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022081 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022084 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022087 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 22:46:12.028807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022090 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022094 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022097 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022100 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022108 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022112 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022115 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022118 2568 flags.go:64] FLAG: --pod-cidr="" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022121 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022127 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022132 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022136 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022140 2568 flags.go:64] FLAG: --port="10250" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022144 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022147 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02cf1113918bd6d4a" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022150 2568 flags.go:64] FLAG: --qos-reserved="" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022154 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022157 2568 flags.go:64] FLAG: --register-node="true" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022160 2568 flags.go:64] FLAG: --register-with-taints="" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022164 2568 flags.go:64] FLAG: --registry-burst="10" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022168 2568 flags.go:64] FLAG: --registry-qps="5" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022171 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022174 2568 flags.go:64] FLAG: --reserved-memory="" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022178 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022182 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 22:46:12.029482 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022185 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022188 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022191 2568 flags.go:64] FLAG: --runonce="false" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022194 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022200 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022203 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022207 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022210 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022213 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022217 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022220 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022224 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022227 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022230 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022233 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022236 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022239 2568 flags.go:64] FLAG: --system-cgroups="" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022244 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022250 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022253 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022257 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022261 2568 flags.go:64] FLAG: --tls-min-version="" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022265 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022268 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022271 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 22:46:12.030159 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022274 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022277 2568 flags.go:64] FLAG: --v="2" Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022282 2568 flags.go:64] FLAG: --version="false" Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022286 2568 flags.go:64] FLAG: --vmodule="" Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022290 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022294 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022456 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022460 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022464 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022468 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022471 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022476 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022479 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022482 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022485 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022488 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022491 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022494 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022497 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022499 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022502 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:12.030879 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022505 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022508 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022511 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022516 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022519 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022522 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022524 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022528 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022531 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022534 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022536 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022539 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022542 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022544 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022547 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022550 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022553 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022556 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022558 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022561 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:12.031436 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022564 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022567 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022587 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022590 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022593 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022598 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022602 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022605 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022609 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022612 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022615 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022618 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022621 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022624 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022627 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022632 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022634 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022637 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022640 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022643 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:12.031999 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022646 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022649 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022652 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022655 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022658 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022660 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022663 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022666 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022669 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022674 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022678 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022681 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022683 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022686 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022691 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022693 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022696 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022699 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022704 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:12.032556 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022708 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022711 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022714 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022718 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022721 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022724 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022727 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022729 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022735 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022738 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022741 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022744 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022746 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022749 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022753 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022756 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022759 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022762 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022765 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022768 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:12.033086 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022770 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022773 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022776 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022778 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.022781 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.022786 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.030850 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.030873 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.030898 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.030905 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.030983 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.030989 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.030993 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.030996 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.030999 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:12.033684 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031002 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031005 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031008 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031012 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031015 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031018 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031021 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031024 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031029 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031034 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031038 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031041 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031044 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031047 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031050 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031053 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031056 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031059 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031062 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:12.034098 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031065 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031068 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031071 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031073 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031077 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031082 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031086 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031089 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031092 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031095 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031097 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031100 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031103 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031107 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031110 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031112 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031115 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031118 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031121 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031124 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:12.034612 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031127 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031130 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031133 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031136 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031139 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031141 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031145 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031147 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031150 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031153 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031156 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031158 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031161 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031165 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031169 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031173 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031177 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031182 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031186 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:12.035134 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031190 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031193 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031196 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031199 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031202 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031204 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031207 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031210 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031212 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031215 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031218 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031221 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031223 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031226 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031229 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031232 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031235 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031238 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031240 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031243 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:12.035646 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031246 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031248 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031251 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031254 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031256 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031259 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031262 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031265 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031267 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031271 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031274 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031277 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031280 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031283 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031285 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:12.036173 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031288 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.031294 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031447 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031454 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031458 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031461 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031464 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031467 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031470 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031472 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031475 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031477 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031480 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031483 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:12.036672 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031486 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031489 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031492 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031495 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031498 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031500 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031504 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031507 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031510 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031513 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031516 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031518 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031523 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031526 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031529 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031533 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031536 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031539 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031542 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:12.037071 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031544 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031547 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031550 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031553 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031555 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031558 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031561 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031564 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031566 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031586 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031590 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031593 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031595 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031600 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031603 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031606 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031609 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031612 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031617 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031620 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:12.037587 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031623 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031626 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031628 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031631 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031634 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031637 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031640 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031643 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031646 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031650 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031653 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031656 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031659 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031661 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031665 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031669 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031672 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031675 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031677 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031681 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:12.038122 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031684 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031686 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031689 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031692 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031694 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031697 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031700 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031703 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031706 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031708 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031711 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031714 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031717 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031719 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031722 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031725 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031728 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031730 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031733 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031736 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:12.038669 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031739 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031742 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031745 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031749 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031751 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031754 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031757 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:12.031760 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.031765 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.031917 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.034419 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.036196 2568 server.go:1019] "Starting client certificate rotation" Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.036308 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:46:12.039203 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.036359 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:46:12.039558 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.039062 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:46:12.041076 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.041048 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:46:12.061523 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.061484 2568 log.go:25] "Validated CRI v1 runtime API" Jul 06 22:46:12.064295 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.064267 2568 log.go:25] "Validated CRI v1 image API" Jul 06 22:46:12.065497 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.065469 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 22:46:12.068408 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.068383 2568 fs.go:135] Filesystem UUIDs: map[042dbd69-9815-4b8e-8521-b5fd13b46c85:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fdf8fd9d-994d-48c5-83e1-55c330fbc7d8:/dev/nvme0n1p3] Jul 06 22:46:12.068489 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.068409 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 22:46:12.071251 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.071225 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:46:12.075120 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.074991 2568 manager.go:216] Machine: {Timestamp:2026-07-06 22:46:12.072455506 +0000 UTC m=+0.383623666 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099831 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c9b3529a260c901abbf5562b24f8c SystemUUID:ec2c9b35-29a2-60c9-01ab-bf5562b24f8c BootID:4b2709db-4188-4913-8c04-8a60a44ebbb9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5d:4e:e8:f6:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5d:4e:e8:f6:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:21:e2:95:46:d9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 22:46:12.075120 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.075114 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 22:46:12.075243 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.075211 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 22:46:12.079528 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.079491 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 22:46:12.079718 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.079532 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 22:46:12.080377 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.080365 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 22:46:12.080414 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.080380 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 22:46:12.080414 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.080388 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:46:12.081099 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.081087 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:46:12.082427 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.082415 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 22:46:12.085744 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.085728 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:46:12.085883 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.085872 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 22:46:12.085923 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.085906 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 06 22:46:12.085923 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.085917 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 22:46:12.085984 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.085933 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 22:46:12.085984 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.085949 2568 kubelet.go:398] "Adding apiserver pod source" Jul 06 22:46:12.085984 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.085959 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 22:46:12.086350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.086321 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:46:12.086350 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.086347 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:46:12.088916 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.088893 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 22:46:12.090999 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.090981 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 22:46:12.091084 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.091015 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 22:46:12.094681 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094663 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 22:46:12.094681 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094684 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 22:46:12.094796 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094691 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 22:46:12.094796 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094698 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 22:46:12.094796 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094707 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 22:46:12.094796 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094713 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 22:46:12.094796 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094722 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 22:46:12.094796 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094728 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 22:46:12.094796 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094736 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 22:46:12.094796 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094742 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 22:46:12.094796 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094754 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 22:46:12.094796 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.094760 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 22:46:12.096196 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.096171 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 22:46:12.096258 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.096196 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 22:46:12.096714 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.096700 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 22:46:12.096751 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.096719 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 22:46:12.098511 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.098495 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 22:46:12.100123 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.100109 2568 server.go:1268] "Started kubelet" Jul 06 22:46:12.100292 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.100208 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 22:46:12.100292 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.100240 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 22:46:12.100426 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.100323 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 22:46:12.100612 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.100587 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mr29b" Jul 06 22:46:12.101169 ip-10-0-142-117 systemd[1]: Started Kubernetes Kubelet. Jul 06 22:46:12.104910 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.104885 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 06 22:46:12.105181 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.105161 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 22:46:12.106790 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.106761 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mr29b" Jul 06 22:46:12.106963 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.106908 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 22:46:12.112437 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.112417 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 22:46:12.112583 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.112451 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 22:46:12.112583 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.112499 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jul 06 22:46:12.113086 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113064 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 22:46:12.113444 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113425 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 22:46:12.113444 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113445 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 22:46:12.113684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113617 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 06 22:46:12.113684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113628 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 06 22:46:12.113786 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113690 2568 factory.go:153] Registering CRI-O factory Jul 06 22:46:12.113786 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113731 2568 factory.go:223] Registration of the crio container factory successfully Jul 06 22:46:12.113893 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113839 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 22:46:12.113893 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113852 2568 factory.go:55] Registering systemd factory Jul 06 22:46:12.113893 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113861 2568 factory.go:223] Registration of the systemd container factory successfully Jul 06 22:46:12.113893 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113885 2568 factory.go:103] Registering Raw factory Jul 06 22:46:12.114065 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.113901 2568 manager.go:1196] Started watching for new ooms in manager Jul 06 22:46:12.114295 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.114281 2568 manager.go:349] Starting recovery of all containers Jul 06 22:46:12.121275 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.121245 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:12.124380 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.124347 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-117.ec2.internal\" not found" node="ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.125169 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.125150 2568 manager.go:354] Recovery completed Jul 06 22:46:12.130341 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.130323 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:12.132425 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.132406 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:12.132513 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.132441 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:12.132513 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.132452 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:12.133116 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.133100 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 22:46:12.133116 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.133114 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 22:46:12.133265 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.133134 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:46:12.133265 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.133143 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:12.134040 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.134023 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:12.134114 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.134058 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:12.134114 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.134072 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:12.134425 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.134408 2568 policy_none.go:49] "None policy: Start" Jul 06 22:46:12.134497 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.134429 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 22:46:12.134497 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.134444 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 22:46:12.135591 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.135559 2568 policy_none.go:47] "Start" Jul 06 22:46:12.181564 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.181326 2568 manager.go:337] "Starting Device Plugin manager" Jul 06 22:46:12.181702 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.181611 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 22:46:12.181702 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.181627 2568 server.go:87] "Starting device plugin registration server" Jul 06 22:46:12.181964 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.181951 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 22:46:12.182001 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.181967 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 22:46:12.182085 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.182068 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 22:46:12.182177 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.182163 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 22:46:12.182177 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.182177 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 22:46:12.182880 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.182860 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 22:46:12.182970 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.182920 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-117.ec2.internal\" not found" Jul 06 22:46:12.265708 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.265608 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 22:46:12.267005 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.266985 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 22:46:12.267097 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.267036 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 22:46:12.267097 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.267070 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 22:46:12.267184 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.267118 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 22:46:12.270177 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.270152 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:12.283107 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.283074 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:12.284152 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.284131 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:12.284280 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.284167 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:12.284280 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.284179 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:12.284280 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.284205 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.294262 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.294230 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.294353 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.294268 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-117.ec2.internal\": node \"ip-10-0-142-117.ec2.internal\" not found" Jul 06 22:46:12.304300 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.304269 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jul 06 22:46:12.367520 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.367439 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal"] Jul 06 22:46:12.367632 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.367585 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:12.368647 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.368629 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:12.368715 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.368664 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:12.368715 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.368676 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:12.370131 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.370117 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:12.370236 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.370222 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.370276 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.370254 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:12.371078 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.371058 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:12.371163 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.371090 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:12.371163 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.371101 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:12.371799 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.371785 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:12.371868 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.371810 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:12.371868 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.371824 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:12.372256 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.372241 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.372296 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.372270 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:12.373097 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.373078 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:12.373198 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.373114 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:12.373198 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.373128 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:12.390436 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.390407 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-117.ec2.internal\" not found" node="ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.394967 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.394949 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-117.ec2.internal\" not found" node="ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.404705 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.404680 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jul 06 22:46:12.415637 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.415608 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20a1bee6c6da2563fb5813b625ea082f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"20a1bee6c6da2563fb5813b625ea082f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.415710 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.415642 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20a1bee6c6da2563fb5813b625ea082f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"20a1bee6c6da2563fb5813b625ea082f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.415710 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.415668 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18ffdb5b21a4104d25d53564786ff1f5-config\") pod \"kube-apiserver-proxy-ip-10-0-142-117.ec2.internal\" (UID: \"18ffdb5b21a4104d25d53564786ff1f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.504965 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.504915 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jul 06 22:46:12.516199 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.516129 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20a1bee6c6da2563fb5813b625ea082f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"20a1bee6c6da2563fb5813b625ea082f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.516199 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.516167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20a1bee6c6da2563fb5813b625ea082f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"20a1bee6c6da2563fb5813b625ea082f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.516199 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.516186 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18ffdb5b21a4104d25d53564786ff1f5-config\") pod \"kube-apiserver-proxy-ip-10-0-142-117.ec2.internal\" (UID: \"18ffdb5b21a4104d25d53564786ff1f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.516384 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.516265 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20a1bee6c6da2563fb5813b625ea082f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"20a1bee6c6da2563fb5813b625ea082f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.516384 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.516329 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18ffdb5b21a4104d25d53564786ff1f5-config\") pod \"kube-apiserver-proxy-ip-10-0-142-117.ec2.internal\" (UID: \"18ffdb5b21a4104d25d53564786ff1f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.516384 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.516366 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20a1bee6c6da2563fb5813b625ea082f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"20a1bee6c6da2563fb5813b625ea082f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.606202 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.606166 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jul 06 22:46:12.699697 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.699650 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.699818 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:12.699678 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jul 06 22:46:12.707073 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.707050 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jul 06 22:46:12.812710 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.812600 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jul 06 22:46:12.920046 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:12.920022 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jul 06 22:46:13.020260 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.020227 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jul 06 22:46:13.036434 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.036409 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 22:46:13.036572 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.036549 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 22:46:13.036615 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.036585 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 22:46:13.037772 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.037755 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:13.064985 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.064918 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:13.086952 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.086916 2568 apiserver.go:52] "Watching apiserver" Jul 06 22:46:13.095816 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.095774 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 22:46:13.096177 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.096152 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-r55k5","openshift-image-registry/node-ca-jrhnq","openshift-network-diagnostics/network-check-target-hv8gk","openshift-network-operator/iptables-alerter-pkqk2","openshift-ovn-kubernetes/ovnkube-node-9qvqv","kube-system/global-pull-secret-syncer-pvr6q","kube-system/konnectivity-agent-f8rvz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g","openshift-cluster-node-tuning-operator/tuned-trx96","openshift-dns/node-resolver-wkg87","openshift-multus/multus-additional-cni-plugins-bwh7m","openshift-multus/multus-c55fj"] Jul 06 22:46:13.097830 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.097812 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:13.097936 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.097904 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:13.098833 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.098811 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jrhnq" Jul 06 22:46:13.099980 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.099965 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:13.100065 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.100019 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:13.101120 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.101104 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pkqk2" Jul 06 22:46:13.101370 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.101350 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 22:46:13.101478 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.101375 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 22:46:13.101478 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.101424 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 22:46:13.101478 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.101443 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zps9d\"" Jul 06 22:46:13.102805 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.102786 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.103311 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.103294 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-57t7q\"" Jul 06 22:46:13.103421 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.103395 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:46:13.104122 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.103977 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 22:46:13.104122 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.103984 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 22:46:13.104291 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.104234 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:13.104376 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.104348 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:13.105222 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.105197 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 22:46:13.105454 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.105428 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 22:46:13.105548 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.105493 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 22:46:13.106260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.105809 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 22:46:13.106260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.105822 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 22:46:13.106260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.105867 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 22:46:13.106260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.105890 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jhk4f\"" Jul 06 22:46:13.106260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.106107 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:13.107840 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.107823 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.108614 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.108594 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 22:46:13.109050 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.109033 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-98l7t\"" Jul 06 22:46:13.109219 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.109203 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 22:46:13.109305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.109287 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.109868 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.109847 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d6skf\"" Jul 06 22:46:13.110106 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.110087 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 22:46:13.110190 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.110118 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 22:46:13.110190 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.110137 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 22:46:13.110605 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.110587 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wkg87" Jul 06 22:46:13.111704 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.111680 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 22:46:13.111792 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.111680 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:46:13.111792 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.111753 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wzrbj\"" Jul 06 22:46:13.112100 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.112085 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.112889 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.112602 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jul 06 22:46:13.112889 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.112689 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 22:46:13.112889 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.112751 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bl746\"" Jul 06 22:46:13.112889 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.112755 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 22:41:12 +0000 UTC" deadline="2028-04-16 13:43:26.901535528 +0000 UTC" Jul 06 22:46:13.112889 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.112799 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15590h57m13.788740445s" Jul 06 22:46:13.112889 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.112847 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 22:46:13.113181 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.112899 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 22:46:13.113986 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.113956 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.114335 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.114319 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 22:46:13.114534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.114516 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 22:46:13.114677 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.114661 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 22:46:13.114763 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.114681 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ll6d9\"" Jul 06 22:46:13.114763 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.114690 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 22:46:13.114763 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.114702 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 22:46:13.116096 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.116078 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 22:46:13.116158 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.116137 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qwg24\"" Jul 06 22:46:13.120404 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120382 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-conf-dir\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.120496 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9ae6155-7a85-461c-8ce2-854f62d2c9e5-host-slash\") pod \"iptables-alerter-pkqk2\" (UID: \"b9ae6155-7a85-461c-8ce2-854f62d2c9e5\") " pod="openshift-network-operator/iptables-alerter-pkqk2" Jul 06 22:46:13.120555 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120506 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-run-netns\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.120623 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120581 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-cni-bin\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.120678 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120646 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83a4a470-d3eb-4396-9fb5-f50ea5555f4e-agent-certs\") pod \"konnectivity-agent-f8rvz\" (UID: \"83a4a470-d3eb-4396-9fb5-f50ea5555f4e\") " pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:13.120736 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120690 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-sys\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.120790 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120736 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03-serviceca\") pod \"node-ca-jrhnq\" (UID: \"e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03\") " pod="openshift-image-registry/node-ca-jrhnq" Jul 06 22:46:13.120843 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqxgb\" (UniqueName: \"kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb\") pod \"network-check-target-hv8gk\" (UID: \"ae3307c9-b5ee-486a-925c-52f0852e8000\") " pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:13.120843 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.120923 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-sysctl-d\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.120923 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a889342-55cd-46aa-87f2-dd986aa3e6ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.120923 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120908 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrhg4\" (UniqueName: \"kubernetes.io/projected/7a889342-55cd-46aa-87f2-dd986aa3e6ff-kube-api-access-rrhg4\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.121047 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120924 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-var-lib-cni-bin\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.121047 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120946 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-etc-kubernetes\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.121047 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-log-socket\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.121047 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.120993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-modprobe-d\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.121242 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121035 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-systemd\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.121242 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121080 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-run-netns\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.121242 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-hostroot\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.121242 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121209 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjss4\" (UniqueName: \"kubernetes.io/projected/44689168-2d9a-49c7-b7ae-6b8caa09b985-kube-api-access-jjss4\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:13.121242 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121234 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-daemon-config\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.121433 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121265 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03-host\") pod \"node-ca-jrhnq\" (UID: \"e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03\") " pod="openshift-image-registry/node-ca-jrhnq" Jul 06 22:46:13.121433 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-system-cni-dir\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.121433 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121305 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hztzx\" (UniqueName: \"kubernetes.io/projected/850fbf17-6749-4f07-9a4e-9ec93c8345bd-kube-api-access-hztzx\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.121433 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121321 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:13.121433 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121346 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlrwm\" (UniqueName: \"kubernetes.io/projected/4396dace-7959-45c5-b915-078ebe3d333c-kube-api-access-dlrwm\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.121433 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-tuned\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.121433 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121389 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9ae6155-7a85-461c-8ce2-854f62d2c9e5-iptables-alerter-script\") pod \"iptables-alerter-pkqk2\" (UID: \"b9ae6155-7a85-461c-8ce2-854f62d2c9e5\") " pod="openshift-network-operator/iptables-alerter-pkqk2" Jul 06 22:46:13.121433 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmn5q\" (UniqueName: \"kubernetes.io/projected/b9ae6155-7a85-461c-8ce2-854f62d2c9e5-kube-api-access-zmn5q\") pod \"iptables-alerter-pkqk2\" (UID: \"b9ae6155-7a85-461c-8ce2-854f62d2c9e5\") " pod="openshift-network-operator/iptables-alerter-pkqk2" Jul 06 22:46:13.121696 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-registration-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.121696 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121536 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-sys-fs\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.121696 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121553 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-system-cni-dir\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.121696 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121569 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-run-k8s-cni-cncf-io\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.121696 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121585 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.121696 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121621 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-device-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.121696 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121644 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-os-release\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.121696 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121661 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/850fbf17-6749-4f07-9a4e-9ec93c8345bd-cni-binary-copy\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.121696 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121683 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-socket-dir-parent\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121707 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-var-lib-cni-multus\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121746 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-kubelet\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121773 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf97cfd3-1578-4f60-b609-fc54d91ddd38-hosts-file\") pod \"node-resolver-wkg87\" (UID: \"cf97cfd3-1578-4f60-b609-fc54d91ddd38\") " pod="openshift-dns/node-resolver-wkg87" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf97cfd3-1578-4f60-b609-fc54d91ddd38-tmp-dir\") pod \"node-resolver-wkg87\" (UID: \"cf97cfd3-1578-4f60-b609-fc54d91ddd38\") " pod="openshift-dns/node-resolver-wkg87" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121823 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-sysctl-conf\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121854 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-host\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e812039-235d-4e1f-b0f4-597162219a9a-env-overrides\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121957 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e84ebda6-5eef-48c7-8565-ebe6bfad767c-kubelet-config\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.121985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122010 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83a4a470-d3eb-4396-9fb5-f50ea5555f4e-konnectivity-ca\") pod \"konnectivity-agent-f8rvz\" (UID: \"83a4a470-d3eb-4396-9fb5-f50ea5555f4e\") " pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122038 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-run-multus-certs\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.122064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122064 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt9dv\" (UniqueName: \"kubernetes.io/projected/5e812039-235d-4e1f-b0f4-597162219a9a-kube-api-access-bt9dv\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47d6c46a-8290-4334-a151-f31da5e8bb26-tmp\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122113 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-cnibin\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122136 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwb7p\" (UniqueName: \"kubernetes.io/projected/e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03-kube-api-access-xwb7p\") pod \"node-ca-jrhnq\" (UID: \"e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03\") " pod="openshift-image-registry/node-ca-jrhnq" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122162 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122186 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-socket-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122240 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-kubernetes\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122262 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5w7p\" (UniqueName: \"kubernetes.io/projected/47d6c46a-8290-4334-a151-f31da5e8bb26-kube-api-access-x5w7p\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122277 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-cni-dir\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122298 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-slash\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122329 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-run-systemd\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122352 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-sysconfig\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-run\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-lib-modules\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a889342-55cd-46aa-87f2-dd986aa3e6ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.122534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-run-openvswitch\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122513 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-node-log\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122548 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhm6r\" (UniqueName: \"kubernetes.io/projected/cf97cfd3-1578-4f60-b609-fc54d91ddd38-kube-api-access-lhm6r\") pod \"node-resolver-wkg87\" (UID: \"cf97cfd3-1578-4f60-b609-fc54d91ddd38\") " pod="openshift-dns/node-resolver-wkg87" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-var-lib-kubelet\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122609 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-cnibin\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122635 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-var-lib-openvswitch\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122663 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-cni-netd\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122692 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e812039-235d-4e1f-b0f4-597162219a9a-ovnkube-config\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122719 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e84ebda6-5eef-48c7-8565-ebe6bfad767c-dbus\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122742 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-os-release\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122767 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-systemd-units\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122786 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-etc-openvswitch\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122800 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-run-ovn\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122814 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e812039-235d-4e1f-b0f4-597162219a9a-ovn-node-metrics-cert\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122836 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e812039-235d-4e1f-b0f4-597162219a9a-ovnkube-script-lib\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122855 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a889342-55cd-46aa-87f2-dd986aa3e6ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.123134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122897 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.123885 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.122923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-var-lib-kubelet\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.123885 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.123599 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:46:13.123885 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.123684 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jul 06 22:46:13.123982 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.123883 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal"] Jul 06 22:46:13.125820 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.125803 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:46:13.132130 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.132111 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:46:13.132297 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.132281 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal"] Jul 06 22:46:13.148115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.148090 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6k2wb" Jul 06 22:46:13.155988 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.155958 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6k2wb" Jul 06 22:46:13.213798 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.213768 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 22:46:13.223112 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223083 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlrwm\" (UniqueName: \"kubernetes.io/projected/4396dace-7959-45c5-b915-078ebe3d333c-kube-api-access-dlrwm\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.223275 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223121 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-tuned\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.223275 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223159 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9ae6155-7a85-461c-8ce2-854f62d2c9e5-iptables-alerter-script\") pod \"iptables-alerter-pkqk2\" (UID: \"b9ae6155-7a85-461c-8ce2-854f62d2c9e5\") " pod="openshift-network-operator/iptables-alerter-pkqk2" Jul 06 22:46:13.223275 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223185 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmn5q\" (UniqueName: \"kubernetes.io/projected/b9ae6155-7a85-461c-8ce2-854f62d2c9e5-kube-api-access-zmn5q\") pod \"iptables-alerter-pkqk2\" (UID: \"b9ae6155-7a85-461c-8ce2-854f62d2c9e5\") " pod="openshift-network-operator/iptables-alerter-pkqk2" Jul 06 22:46:13.223275 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223217 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-registration-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.223275 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223236 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-sys-fs\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.223275 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223262 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-system-cni-dir\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223287 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-run-k8s-cni-cncf-io\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223315 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223357 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-device-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223380 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-os-release\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223405 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/850fbf17-6749-4f07-9a4e-9ec93c8345bd-cni-binary-copy\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223428 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-socket-dir-parent\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-var-lib-cni-multus\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223469 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-run-k8s-cni-cncf-io\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223472 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223522 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-kubelet\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223563 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223596 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-registration-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.223670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223649 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-sys-fs\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223691 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-socket-dir-parent\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223697 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-system-cni-dir\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223476 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-kubelet\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223741 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf97cfd3-1578-4f60-b609-fc54d91ddd38-hosts-file\") pod \"node-resolver-wkg87\" (UID: \"cf97cfd3-1578-4f60-b609-fc54d91ddd38\") " pod="openshift-dns/node-resolver-wkg87" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223744 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-var-lib-cni-multus\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223779 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf97cfd3-1578-4f60-b609-fc54d91ddd38-tmp-dir\") pod \"node-resolver-wkg87\" (UID: \"cf97cfd3-1578-4f60-b609-fc54d91ddd38\") " pod="openshift-dns/node-resolver-wkg87" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223807 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-sysctl-conf\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-host\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223852 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e812039-235d-4e1f-b0f4-597162219a9a-env-overrides\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223873 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e84ebda6-5eef-48c7-8565-ebe6bfad767c-kubelet-config\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223894 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223915 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83a4a470-d3eb-4396-9fb5-f50ea5555f4e-konnectivity-ca\") pod \"konnectivity-agent-f8rvz\" (UID: \"83a4a470-d3eb-4396-9fb5-f50ea5555f4e\") " pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223938 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-run-multus-certs\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223962 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt9dv\" (UniqueName: \"kubernetes.io/projected/5e812039-235d-4e1f-b0f4-597162219a9a-kube-api-access-bt9dv\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.223986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47d6c46a-8290-4334-a151-f31da5e8bb26-tmp\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224007 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-cnibin\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224027 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwb7p\" (UniqueName: \"kubernetes.io/projected/e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03-kube-api-access-xwb7p\") pod \"node-ca-jrhnq\" (UID: \"e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03\") " pod="openshift-image-registry/node-ca-jrhnq" Jul 06 22:46:13.224431 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224048 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224072 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-socket-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224094 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-kubernetes\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224115 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5w7p\" (UniqueName: \"kubernetes.io/projected/47d6c46a-8290-4334-a151-f31da5e8bb26-kube-api-access-x5w7p\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-cni-dir\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224171 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-slash\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224194 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-run-systemd\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224191 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9ae6155-7a85-461c-8ce2-854f62d2c9e5-iptables-alerter-script\") pod \"iptables-alerter-pkqk2\" (UID: \"b9ae6155-7a85-461c-8ce2-854f62d2c9e5\") " pod="openshift-network-operator/iptables-alerter-pkqk2" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224217 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224227 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-run-multus-certs\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224242 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-sysconfig\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224279 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf97cfd3-1578-4f60-b609-fc54d91ddd38-hosts-file\") pod \"node-resolver-wkg87\" (UID: \"cf97cfd3-1578-4f60-b609-fc54d91ddd38\") " pod="openshift-dns/node-resolver-wkg87" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224274 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/850fbf17-6749-4f07-9a4e-9ec93c8345bd-cni-binary-copy\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224293 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-sysconfig\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224325 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-run\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224284 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-run\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224394 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-sysctl-conf\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224404 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e84ebda6-5eef-48c7-8565-ebe6bfad767c-kubelet-config\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:13.225391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224462 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-os-release\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224472 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-device-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224533 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-host\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-lib-modules\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224633 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a889342-55cd-46aa-87f2-dd986aa3e6ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.224643 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224666 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-run-openvswitch\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224690 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf97cfd3-1578-4f60-b609-fc54d91ddd38-tmp-dir\") pod \"node-resolver-wkg87\" (UID: \"cf97cfd3-1578-4f60-b609-fc54d91ddd38\") " pod="openshift-dns/node-resolver-wkg87" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.224720 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs podName:44689168-2d9a-49c7-b7ae-6b8caa09b985 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:13.724698003 +0000 UTC m=+2.035866183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs") pod "network-metrics-daemon-r55k5" (UID: "44689168-2d9a-49c7-b7ae-6b8caa09b985") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224740 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-node-log\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224746 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-run-openvswitch\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224770 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhm6r\" (UniqueName: \"kubernetes.io/projected/cf97cfd3-1578-4f60-b609-fc54d91ddd38-kube-api-access-lhm6r\") pod \"node-resolver-wkg87\" (UID: \"cf97cfd3-1578-4f60-b609-fc54d91ddd38\") " pod="openshift-dns/node-resolver-wkg87" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224786 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-kubernetes\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224797 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-var-lib-kubelet\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224778 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-cni-dir\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224828 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-cnibin\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224853 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-slash\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.226521 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224865 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e812039-235d-4e1f-b0f4-597162219a9a-env-overrides\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224917 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-run-systemd\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-var-lib-openvswitch\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.224993 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225016 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-cni-netd\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225045 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-var-lib-openvswitch\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225267 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83a4a470-d3eb-4396-9fb5-f50ea5555f4e-konnectivity-ca\") pod \"konnectivity-agent-f8rvz\" (UID: \"83a4a470-d3eb-4396-9fb5-f50ea5555f4e\") " pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225275 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-var-lib-kubelet\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225318 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-cni-netd\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225371 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-lib-modules\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225422 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-cnibin\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225425 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-cnibin\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225536 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225549 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e812039-235d-4e1f-b0f4-597162219a9a-ovnkube-config\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225048 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e812039-235d-4e1f-b0f4-597162219a9a-ovnkube-config\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225592 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-node-log\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225598 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e84ebda6-5eef-48c7-8565-ebe6bfad767c-dbus\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225629 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-os-release\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.227468 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225646 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-socket-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225678 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-systemd-units\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225688 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-os-release\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225706 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-etc-openvswitch\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225724 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-systemd-units\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225731 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-run-ovn\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225648 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e84ebda6-5eef-48c7-8565-ebe6bfad767c-dbus\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225757 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e812039-235d-4e1f-b0f4-597162219a9a-ovn-node-metrics-cert\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225765 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-etc-openvswitch\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225783 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e812039-235d-4e1f-b0f4-597162219a9a-ovnkube-script-lib\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225810 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-run-ovn\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225810 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a889342-55cd-46aa-87f2-dd986aa3e6ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225844 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225869 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-var-lib-kubelet\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225920 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-conf-dir\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225959 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9ae6155-7a85-461c-8ce2-854f62d2c9e5-host-slash\") pod \"iptables-alerter-pkqk2\" (UID: \"b9ae6155-7a85-461c-8ce2-854f62d2c9e5\") " pod="openshift-network-operator/iptables-alerter-pkqk2" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225985 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-run-netns\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.225998 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-var-lib-kubelet\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.228405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-cni-bin\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226035 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a889342-55cd-46aa-87f2-dd986aa3e6ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226056 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9ae6155-7a85-461c-8ce2-854f62d2c9e5-host-slash\") pod \"iptables-alerter-pkqk2\" (UID: \"b9ae6155-7a85-461c-8ce2-854f62d2c9e5\") " pod="openshift-network-operator/iptables-alerter-pkqk2" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226068 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-conf-dir\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226079 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-cni-bin\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226084 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83a4a470-d3eb-4396-9fb5-f50ea5555f4e-agent-certs\") pod \"konnectivity-agent-f8rvz\" (UID: \"83a4a470-d3eb-4396-9fb5-f50ea5555f4e\") " pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226119 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-host-run-netns\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226172 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-sys\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226236 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03-serviceca\") pod \"node-ca-jrhnq\" (UID: \"e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03\") " pod="openshift-image-registry/node-ca-jrhnq" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226293 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-sys\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226365 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxgb\" (UniqueName: \"kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb\") pod \"network-check-target-hv8gk\" (UID: \"ae3307c9-b5ee-486a-925c-52f0852e8000\") " pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226393 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e812039-235d-4e1f-b0f4-597162219a9a-ovnkube-script-lib\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226512 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226568 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-sysctl-d\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226580 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4396dace-7959-45c5-b915-078ebe3d333c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a889342-55cd-46aa-87f2-dd986aa3e6ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226678 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-sysctl-d\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.229429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226677 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrhg4\" (UniqueName: \"kubernetes.io/projected/7a889342-55cd-46aa-87f2-dd986aa3e6ff-kube-api-access-rrhg4\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226740 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-var-lib-cni-bin\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226780 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-etc-kubernetes\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226806 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-log-socket\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226847 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-modprobe-d\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226872 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-systemd\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226895 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-run-netns\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-hostroot\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226958 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjss4\" (UniqueName: \"kubernetes.io/projected/44689168-2d9a-49c7-b7ae-6b8caa09b985-kube-api-access-jjss4\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-daemon-config\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.226998 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03-serviceca\") pod \"node-ca-jrhnq\" (UID: \"e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03\") " pod="openshift-image-registry/node-ca-jrhnq" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227009 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03-host\") pod \"node-ca-jrhnq\" (UID: \"e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03\") " pod="openshift-image-registry/node-ca-jrhnq" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227044 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-system-cni-dir\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227049 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03-host\") pod \"node-ca-jrhnq\" (UID: \"e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03\") " pod="openshift-image-registry/node-ca-jrhnq" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227051 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-modprobe-d\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227072 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hztzx\" (UniqueName: \"kubernetes.io/projected/850fbf17-6749-4f07-9a4e-9ec93c8345bd-kube-api-access-hztzx\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227102 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227099 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-systemd\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.230440 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227126 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-var-lib-cni-bin\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227288 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-etc-kubernetes\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227333 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-host-run-netns\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.227334 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227396 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e812039-235d-4e1f-b0f4-597162219a9a-log-socket\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227432 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-hostroot\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.227461 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret podName:e84ebda6-5eef-48c7-8565-ebe6bfad767c nodeName:}" failed. No retries permitted until 2026-07-06 22:46:13.727439956 +0000 UTC m=+2.038608102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret") pod "global-pull-secret-syncer-pvr6q" (UID: "e84ebda6-5eef-48c7-8565-ebe6bfad767c") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227599 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a889342-55cd-46aa-87f2-dd986aa3e6ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.227838 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850fbf17-6749-4f07-9a4e-9ec93c8345bd-system-cni-dir\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.228039 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a889342-55cd-46aa-87f2-dd986aa3e6ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.228039 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a889342-55cd-46aa-87f2-dd986aa3e6ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.228122 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/850fbf17-6749-4f07-9a4e-9ec93c8345bd-multus-daemon-config\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.228643 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47d6c46a-8290-4334-a151-f31da5e8bb26-etc-tuned\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.228704 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47d6c46a-8290-4334-a151-f31da5e8bb26-tmp\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.229324 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e812039-235d-4e1f-b0f4-597162219a9a-ovn-node-metrics-cert\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.231461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.229654 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83a4a470-d3eb-4396-9fb5-f50ea5555f4e-agent-certs\") pod \"konnectivity-agent-f8rvz\" (UID: \"83a4a470-d3eb-4396-9fb5-f50ea5555f4e\") " pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:13.232368 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.231471 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlrwm\" (UniqueName: \"kubernetes.io/projected/4396dace-7959-45c5-b915-078ebe3d333c-kube-api-access-dlrwm\") pod \"aws-ebs-csi-driver-node-ftp6g\" (UID: \"4396dace-7959-45c5-b915-078ebe3d333c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.232368 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.231655 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmn5q\" (UniqueName: \"kubernetes.io/projected/b9ae6155-7a85-461c-8ce2-854f62d2c9e5-kube-api-access-zmn5q\") pod \"iptables-alerter-pkqk2\" (UID: \"b9ae6155-7a85-461c-8ce2-854f62d2c9e5\") " pod="openshift-network-operator/iptables-alerter-pkqk2" Jul 06 22:46:13.232836 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.232812 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5w7p\" (UniqueName: \"kubernetes.io/projected/47d6c46a-8290-4334-a151-f31da5e8bb26-kube-api-access-x5w7p\") pod \"tuned-trx96\" (UID: \"47d6c46a-8290-4334-a151-f31da5e8bb26\") " pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.237218 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.237165 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:13.237218 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.237198 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:13.237218 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.237223 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqxgb for pod openshift-network-diagnostics/network-check-target-hv8gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:13.237615 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.237300 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb podName:ae3307c9-b5ee-486a-925c-52f0852e8000 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:13.737274356 +0000 UTC m=+2.048442517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hqxgb" (UniqueName: "kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb") pod "network-check-target-hv8gk" (UID: "ae3307c9-b5ee-486a-925c-52f0852e8000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:13.237882 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.237851 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt9dv\" (UniqueName: \"kubernetes.io/projected/5e812039-235d-4e1f-b0f4-597162219a9a-kube-api-access-bt9dv\") pod \"ovnkube-node-9qvqv\" (UID: \"5e812039-235d-4e1f-b0f4-597162219a9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.238043 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.237901 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhm6r\" (UniqueName: \"kubernetes.io/projected/cf97cfd3-1578-4f60-b609-fc54d91ddd38-kube-api-access-lhm6r\") pod \"node-resolver-wkg87\" (UID: \"cf97cfd3-1578-4f60-b609-fc54d91ddd38\") " pod="openshift-dns/node-resolver-wkg87" Jul 06 22:46:13.239778 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.239756 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwb7p\" (UniqueName: \"kubernetes.io/projected/e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03-kube-api-access-xwb7p\") pod \"node-ca-jrhnq\" (UID: \"e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03\") " pod="openshift-image-registry/node-ca-jrhnq" Jul 06 22:46:13.240523 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.240502 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hztzx\" (UniqueName: \"kubernetes.io/projected/850fbf17-6749-4f07-9a4e-9ec93c8345bd-kube-api-access-hztzx\") pod \"multus-c55fj\" (UID: \"850fbf17-6749-4f07-9a4e-9ec93c8345bd\") " pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.240785 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.240768 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjss4\" (UniqueName: \"kubernetes.io/projected/44689168-2d9a-49c7-b7ae-6b8caa09b985-kube-api-access-jjss4\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:13.240988 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.240971 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrhg4\" (UniqueName: \"kubernetes.io/projected/7a889342-55cd-46aa-87f2-dd986aa3e6ff-kube-api-access-rrhg4\") pod \"multus-additional-cni-plugins-bwh7m\" (UID: \"7a889342-55cd-46aa-87f2-dd986aa3e6ff\") " pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.265566 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.265540 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" Jul 06 22:46:13.271592 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.271542 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c55fj" Jul 06 22:46:13.357443 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:13.357401 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ffdb5b21a4104d25d53564786ff1f5.slice/crio-9531a240cd9022f508a1e84d2551d71c3742b020570333ab2ed5a769194b878e WatchSource:0}: Error finding container 9531a240cd9022f508a1e84d2551d71c3742b020570333ab2ed5a769194b878e: Status 404 returned error can't find the container with id 9531a240cd9022f508a1e84d2551d71c3742b020570333ab2ed5a769194b878e Jul 06 22:46:13.357763 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:13.357741 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a1bee6c6da2563fb5813b625ea082f.slice/crio-e39e799bb50401bcd371c3866e436310d480250c1347d662e7384ccc0f9ae812 WatchSource:0}: Error finding container e39e799bb50401bcd371c3866e436310d480250c1347d662e7384ccc0f9ae812: Status 404 returned error can't find the container with id e39e799bb50401bcd371c3866e436310d480250c1347d662e7384ccc0f9ae812 Jul 06 22:46:13.364294 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.364273 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:46:13.425888 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.425847 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jrhnq" Jul 06 22:46:13.435312 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:13.435286 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d93ceb_53f0_4c9c_92e9_c7cd4f12fe03.slice/crio-d032dc7edc917e8db562f91a23d0541a858c90d4d27153037d2260bd24fb6e7b WatchSource:0}: Error finding container d032dc7edc917e8db562f91a23d0541a858c90d4d27153037d2260bd24fb6e7b: Status 404 returned error can't find the container with id d032dc7edc917e8db562f91a23d0541a858c90d4d27153037d2260bd24fb6e7b Jul 06 22:46:13.443660 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.443643 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pkqk2" Jul 06 22:46:13.451856 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.451831 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:13.452492 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:13.452466 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ae6155_7a85_461c_8ce2_854f62d2c9e5.slice/crio-fba000ba295389d60fff931089925580612081c730b20cfb864d14259e855db5 WatchSource:0}: Error finding container fba000ba295389d60fff931089925580612081c730b20cfb864d14259e855db5: Status 404 returned error can't find the container with id fba000ba295389d60fff931089925580612081c730b20cfb864d14259e855db5 Jul 06 22:46:13.460594 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:13.460564 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e812039_235d_4e1f_b0f4_597162219a9a.slice/crio-06901f74485537fe0a80278aa639f7e2bf9bf0aa24d3999332dd9f4ad1be62ee WatchSource:0}: Error finding container 06901f74485537fe0a80278aa639f7e2bf9bf0aa24d3999332dd9f4ad1be62ee: Status 404 returned error can't find the container with id 06901f74485537fe0a80278aa639f7e2bf9bf0aa24d3999332dd9f4ad1be62ee Jul 06 22:46:13.475538 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.475491 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:13.483538 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:13.483513 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a4a470_d3eb_4396_9fb5_f50ea5555f4e.slice/crio-3d860ffb93bc458698908874fa58ca35676465307e721a065faf7f49ad54d6ae WatchSource:0}: Error finding container 3d860ffb93bc458698908874fa58ca35676465307e721a065faf7f49ad54d6ae: Status 404 returned error can't find the container with id 3d860ffb93bc458698908874fa58ca35676465307e721a065faf7f49ad54d6ae Jul 06 22:46:13.488223 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.488204 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" Jul 06 22:46:13.495893 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:13.495864 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4396dace_7959_45c5_b915_078ebe3d333c.slice/crio-b9aee67528a915ec98a97ee22d208b84b9e272fbac1dd7cb40499ea89051e711 WatchSource:0}: Error finding container b9aee67528a915ec98a97ee22d208b84b9e272fbac1dd7cb40499ea89051e711: Status 404 returned error can't find the container with id b9aee67528a915ec98a97ee22d208b84b9e272fbac1dd7cb40499ea89051e711 Jul 06 22:46:13.503714 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.503691 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trx96" Jul 06 22:46:13.511218 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:13.511191 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d6c46a_8290_4334_a151_f31da5e8bb26.slice/crio-9e33928d65c387faab8228b98b7c09dbb5eaf0b1989bf0e560a0df0cb0bf032c WatchSource:0}: Error finding container 9e33928d65c387faab8228b98b7c09dbb5eaf0b1989bf0e560a0df0cb0bf032c: Status 404 returned error can't find the container with id 9e33928d65c387faab8228b98b7c09dbb5eaf0b1989bf0e560a0df0cb0bf032c Jul 06 22:46:13.525113 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.525087 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wkg87" Jul 06 22:46:13.533245 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:13.533213 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf97cfd3_1578_4f60_b609_fc54d91ddd38.slice/crio-a71797b956d56eba32f031e8f43a3ab1d99b7176633d5943a3ca74e7b8b656d2 WatchSource:0}: Error finding container a71797b956d56eba32f031e8f43a3ab1d99b7176633d5943a3ca74e7b8b656d2: Status 404 returned error can't find the container with id a71797b956d56eba32f031e8f43a3ab1d99b7176633d5943a3ca74e7b8b656d2 Jul 06 22:46:13.610012 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:13.609985 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850fbf17_6749_4f07_9a4e_9ec93c8345bd.slice/crio-a804138fd4c3c880b1ff65d9e79c39615ffbfc85b9878d76d39453ff6567e3cb WatchSource:0}: Error finding container a804138fd4c3c880b1ff65d9e79c39615ffbfc85b9878d76d39453ff6567e3cb: Status 404 returned error can't find the container with id a804138fd4c3c880b1ff65d9e79c39615ffbfc85b9878d76d39453ff6567e3cb Jul 06 22:46:13.679249 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:13.679216 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a889342_55cd_46aa_87f2_dd986aa3e6ff.slice/crio-4e52d711688f8f4d1f7183d1a0e4cfbcd32eee4c10052a60a8be70ca096851bd WatchSource:0}: Error finding container 4e52d711688f8f4d1f7183d1a0e4cfbcd32eee4c10052a60a8be70ca096851bd: Status 404 returned error can't find the container with id 4e52d711688f8f4d1f7183d1a0e4cfbcd32eee4c10052a60a8be70ca096851bd Jul 06 22:46:13.730690 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.730648 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:13.730910 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.730715 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:13.730910 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.730792 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:13.730910 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.730861 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:13.730910 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.730864 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret podName:e84ebda6-5eef-48c7-8565-ebe6bfad767c nodeName:}" failed. No retries permitted until 2026-07-06 22:46:14.730848668 +0000 UTC m=+3.042016814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret") pod "global-pull-secret-syncer-pvr6q" (UID: "e84ebda6-5eef-48c7-8565-ebe6bfad767c") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:13.730910 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.730916 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs podName:44689168-2d9a-49c7-b7ae-6b8caa09b985 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:14.730902989 +0000 UTC m=+3.042071135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs") pod "network-metrics-daemon-r55k5" (UID: "44689168-2d9a-49c7-b7ae-6b8caa09b985") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:13.831465 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:13.831420 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxgb\" (UniqueName: \"kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb\") pod \"network-check-target-hv8gk\" (UID: \"ae3307c9-b5ee-486a-925c-52f0852e8000\") " pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:13.831796 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.831654 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:13.831796 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.831682 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:13.831796 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.831697 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqxgb for pod openshift-network-diagnostics/network-check-target-hv8gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:13.831796 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:13.831769 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb podName:ae3307c9-b5ee-486a-925c-52f0852e8000 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:14.831747204 +0000 UTC m=+3.142915355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqxgb" (UniqueName: "kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb") pod "network-check-target-hv8gk" (UID: "ae3307c9-b5ee-486a-925c-52f0852e8000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:14.160822 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.160770 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:41:13 +0000 UTC" deadline="2028-03-06 07:19:40.35227081 +0000 UTC" Jul 06 22:46:14.160822 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.160813 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14600h33m26.191463138s" Jul 06 22:46:14.281463 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.281424 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:14.281676 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:14.281562 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:14.311025 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.310955 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wkg87" event={"ID":"cf97cfd3-1578-4f60-b609-fc54d91ddd38","Type":"ContainerStarted","Data":"a71797b956d56eba32f031e8f43a3ab1d99b7176633d5943a3ca74e7b8b656d2"} Jul 06 22:46:14.328161 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.328111 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trx96" event={"ID":"47d6c46a-8290-4334-a151-f31da5e8bb26","Type":"ContainerStarted","Data":"9e33928d65c387faab8228b98b7c09dbb5eaf0b1989bf0e560a0df0cb0bf032c"} Jul 06 22:46:14.332185 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.332140 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" event={"ID":"4396dace-7959-45c5-b915-078ebe3d333c","Type":"ContainerStarted","Data":"b9aee67528a915ec98a97ee22d208b84b9e272fbac1dd7cb40499ea89051e711"} Jul 06 22:46:14.337092 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.337049 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f8rvz" event={"ID":"83a4a470-d3eb-4396-9fb5-f50ea5555f4e","Type":"ContainerStarted","Data":"3d860ffb93bc458698908874fa58ca35676465307e721a065faf7f49ad54d6ae"} Jul 06 22:46:14.355997 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.355949 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pkqk2" event={"ID":"b9ae6155-7a85-461c-8ce2-854f62d2c9e5","Type":"ContainerStarted","Data":"fba000ba295389d60fff931089925580612081c730b20cfb864d14259e855db5"} Jul 06 22:46:14.371689 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.371479 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" event={"ID":"7a889342-55cd-46aa-87f2-dd986aa3e6ff","Type":"ContainerStarted","Data":"4e52d711688f8f4d1f7183d1a0e4cfbcd32eee4c10052a60a8be70ca096851bd"} Jul 06 22:46:14.412773 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.412668 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c55fj" event={"ID":"850fbf17-6749-4f07-9a4e-9ec93c8345bd","Type":"ContainerStarted","Data":"a804138fd4c3c880b1ff65d9e79c39615ffbfc85b9878d76d39453ff6567e3cb"} Jul 06 22:46:14.413911 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.413072 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:14.443960 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.443913 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" event={"ID":"5e812039-235d-4e1f-b0f4-597162219a9a","Type":"ContainerStarted","Data":"06901f74485537fe0a80278aa639f7e2bf9bf0aa24d3999332dd9f4ad1be62ee"} Jul 06 22:46:14.461680 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.461637 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jrhnq" event={"ID":"e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03","Type":"ContainerStarted","Data":"d032dc7edc917e8db562f91a23d0541a858c90d4d27153037d2260bd24fb6e7b"} Jul 06 22:46:14.476901 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.476837 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" event={"ID":"20a1bee6c6da2563fb5813b625ea082f","Type":"ContainerStarted","Data":"e39e799bb50401bcd371c3866e436310d480250c1347d662e7384ccc0f9ae812"} Jul 06 22:46:14.490130 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.490086 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" event={"ID":"18ffdb5b21a4104d25d53564786ff1f5","Type":"ContainerStarted","Data":"9531a240cd9022f508a1e84d2551d71c3742b020570333ab2ed5a769194b878e"} Jul 06 22:46:14.529847 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.529810 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:14.742034 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.741943 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:14.742034 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.742010 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:14.742277 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:14.742231 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:14.742342 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:14.742298 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs podName:44689168-2d9a-49c7-b7ae-6b8caa09b985 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:16.742279037 +0000 UTC m=+5.053447198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs") pod "network-metrics-daemon-r55k5" (UID: "44689168-2d9a-49c7-b7ae-6b8caa09b985") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:14.742410 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:14.742383 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:14.742462 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:14.742419 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret podName:e84ebda6-5eef-48c7-8565-ebe6bfad767c nodeName:}" failed. No retries permitted until 2026-07-06 22:46:16.742407247 +0000 UTC m=+5.053575409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret") pod "global-pull-secret-syncer-pvr6q" (UID: "e84ebda6-5eef-48c7-8565-ebe6bfad767c") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:14.843524 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:14.843477 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxgb\" (UniqueName: \"kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb\") pod \"network-check-target-hv8gk\" (UID: \"ae3307c9-b5ee-486a-925c-52f0852e8000\") " pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:14.843764 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:14.843744 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:14.843859 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:14.843772 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:14.843859 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:14.843787 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqxgb for pod openshift-network-diagnostics/network-check-target-hv8gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:14.843976 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:14.843859 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb podName:ae3307c9-b5ee-486a-925c-52f0852e8000 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:16.843838414 +0000 UTC m=+5.155006577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqxgb" (UniqueName: "kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb") pod "network-check-target-hv8gk" (UID: "ae3307c9-b5ee-486a-925c-52f0852e8000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:15.162135 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:15.161974 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:41:13 +0000 UTC" deadline="2028-02-23 20:19:25.337289479 +0000 UTC" Jul 06 22:46:15.162135 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:15.162049 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14325h33m10.175245467s" Jul 06 22:46:15.268800 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:15.267985 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:15.268800 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:15.268127 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:15.268800 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:15.268632 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:15.268800 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:15.268744 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:16.268313 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:16.268124 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:16.268313 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:16.268283 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:16.771332 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:16.771285 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:16.771550 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:16.771364 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:16.771681 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:16.771569 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:16.771681 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:16.771644 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs podName:44689168-2d9a-49c7-b7ae-6b8caa09b985 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:20.771620877 +0000 UTC m=+9.082789039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs") pod "network-metrics-daemon-r55k5" (UID: "44689168-2d9a-49c7-b7ae-6b8caa09b985") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:16.772081 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:16.772060 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:16.772162 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:16.772116 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret podName:e84ebda6-5eef-48c7-8565-ebe6bfad767c nodeName:}" failed. No retries permitted until 2026-07-06 22:46:20.772100402 +0000 UTC m=+9.083268563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret") pod "global-pull-secret-syncer-pvr6q" (UID: "e84ebda6-5eef-48c7-8565-ebe6bfad767c") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:16.872958 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:16.872112 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxgb\" (UniqueName: \"kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb\") pod \"network-check-target-hv8gk\" (UID: \"ae3307c9-b5ee-486a-925c-52f0852e8000\") " pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:16.872958 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:16.872349 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:16.872958 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:16.872371 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:16.872958 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:16.872386 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqxgb for pod openshift-network-diagnostics/network-check-target-hv8gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:16.872958 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:16.872453 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb podName:ae3307c9-b5ee-486a-925c-52f0852e8000 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:20.872429981 +0000 UTC m=+9.183598146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqxgb" (UniqueName: "kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb") pod "network-check-target-hv8gk" (UID: "ae3307c9-b5ee-486a-925c-52f0852e8000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:17.267707 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:17.267618 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:17.267861 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:17.267792 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:17.268057 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:17.267621 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:17.268147 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:17.268105 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:18.268780 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:18.268743 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:18.269306 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:18.268907 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:19.267719 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:19.267685 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:19.267719 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:19.267721 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:19.268008 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:19.267844 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:19.268008 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:19.267980 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:20.268260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:20.268158 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:20.268753 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:20.268310 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:20.811428 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:20.810684 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:20.811428 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:20.810746 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:20.811428 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:20.810874 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:20.811428 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:20.810938 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs podName:44689168-2d9a-49c7-b7ae-6b8caa09b985 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:28.810918487 +0000 UTC m=+17.122086636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs") pod "network-metrics-daemon-r55k5" (UID: "44689168-2d9a-49c7-b7ae-6b8caa09b985") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:20.811428 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:20.811337 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:20.811428 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:20.811391 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret podName:e84ebda6-5eef-48c7-8565-ebe6bfad767c nodeName:}" failed. No retries permitted until 2026-07-06 22:46:28.811375459 +0000 UTC m=+17.122543619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret") pod "global-pull-secret-syncer-pvr6q" (UID: "e84ebda6-5eef-48c7-8565-ebe6bfad767c") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:20.911409 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:20.911302 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxgb\" (UniqueName: \"kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb\") pod \"network-check-target-hv8gk\" (UID: \"ae3307c9-b5ee-486a-925c-52f0852e8000\") " pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:20.911604 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:20.911439 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:20.911604 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:20.911472 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:20.911604 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:20.911488 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqxgb for pod openshift-network-diagnostics/network-check-target-hv8gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:20.911604 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:20.911570 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb podName:ae3307c9-b5ee-486a-925c-52f0852e8000 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:28.911551616 +0000 UTC m=+17.222719763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqxgb" (UniqueName: "kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb") pod "network-check-target-hv8gk" (UID: "ae3307c9-b5ee-486a-925c-52f0852e8000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:21.268124 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:21.268024 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:21.268124 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:21.268079 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:21.268681 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:21.268162 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:21.268681 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:21.268642 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:22.269635 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:22.269181 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:22.269635 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:22.269300 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:23.267325 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:23.267288 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:23.267532 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:23.267407 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:23.267977 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:23.267861 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:23.267977 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:23.267942 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:24.267765 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:24.267728 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:24.268193 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:24.267860 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:25.267787 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:25.267742 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:25.268254 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:25.267800 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:25.268254 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:25.267903 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:25.268254 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:25.268029 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:26.268066 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:26.268025 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:26.268555 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:26.268181 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:27.267533 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:27.267482 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:27.267747 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:27.267482 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:27.267747 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:27.267670 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:27.267864 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:27.267768 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:28.267513 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:28.267458 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:28.267926 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:28.267599 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:28.871550 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:28.871490 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:28.871735 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:28.871607 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:28.871735 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:28.871622 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:28.871735 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:28.871688 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs podName:44689168-2d9a-49c7-b7ae-6b8caa09b985 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:44.871670109 +0000 UTC m=+33.182838276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs") pod "network-metrics-daemon-r55k5" (UID: "44689168-2d9a-49c7-b7ae-6b8caa09b985") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:28.871735 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:28.871691 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:28.871735 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:28.871725 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret podName:e84ebda6-5eef-48c7-8565-ebe6bfad767c nodeName:}" failed. No retries permitted until 2026-07-06 22:46:44.871716011 +0000 UTC m=+33.182884155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret") pod "global-pull-secret-syncer-pvr6q" (UID: "e84ebda6-5eef-48c7-8565-ebe6bfad767c") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:28.972513 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:28.972460 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxgb\" (UniqueName: \"kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb\") pod \"network-check-target-hv8gk\" (UID: \"ae3307c9-b5ee-486a-925c-52f0852e8000\") " pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:28.972686 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:28.972658 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:28.972686 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:28.972683 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:28.972776 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:28.972698 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqxgb for pod openshift-network-diagnostics/network-check-target-hv8gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:28.972776 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:28.972765 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb podName:ae3307c9-b5ee-486a-925c-52f0852e8000 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:44.972746202 +0000 UTC m=+33.283914351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqxgb" (UniqueName: "kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb") pod "network-check-target-hv8gk" (UID: "ae3307c9-b5ee-486a-925c-52f0852e8000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:29.267470 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:29.267386 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:29.267658 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:29.267540 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:29.267658 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:29.267560 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:29.268056 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:29.267661 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:30.268041 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:30.267999 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:30.268526 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:30.268143 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:31.267698 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:31.267661 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:31.267911 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:31.267661 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:31.267911 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:31.267792 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:31.267911 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:31.267865 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:32.268219 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:32.268180 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:32.268668 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:32.268291 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:33.267510 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:33.267464 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:33.267676 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:33.267526 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:33.267676 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:33.267611 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:33.267793 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:33.267742 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:34.268352 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:34.268321 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:34.268829 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:34.268452 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:34.541224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:34.541025 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c55fj" event={"ID":"850fbf17-6749-4f07-9a4e-9ec93c8345bd","Type":"ContainerStarted","Data":"5306b79e92c5218118f074c066d20bce700d8c9e725084ca17baa5174cea8a5e"} Jul 06 22:46:34.542661 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:34.542634 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" event={"ID":"5e812039-235d-4e1f-b0f4-597162219a9a","Type":"ContainerStarted","Data":"81394b1d6dd7d5d31e5a17145a8aa3c0e118d44ba56472a966b76d336aa964d1"} Jul 06 22:46:34.544132 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:34.544104 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" event={"ID":"18ffdb5b21a4104d25d53564786ff1f5","Type":"ContainerStarted","Data":"bcad442e59560efca4c4197564f6e0942c485e3f73a1be735654c00c75fb4841"} Jul 06 22:46:34.545567 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:34.545542 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trx96" event={"ID":"47d6c46a-8290-4334-a151-f31da5e8bb26","Type":"ContainerStarted","Data":"07381b3d761cac8351235bebb9309eff941855b6fd589f8f0d8d9787a8476a40"} Jul 06 22:46:34.558668 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:34.558622 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c55fj" podStartSLOduration=1.834008552 podStartE2EDuration="22.558608074s" totalImagesPullingTime="20.724599522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:34.558396628 +0000 UTC m=+22.869564793" watchObservedRunningTime="2026-07-06 22:46:34.558608074 +0000 UTC m=+22.869776239" Jul 06 22:46:34.576020 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:34.575979 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" podStartSLOduration=21.575964816 podStartE2EDuration="21.575964816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:34.57563762 +0000 UTC m=+22.886805783" watchObservedRunningTime="2026-07-06 22:46:34.575964816 +0000 UTC m=+22.887132982" Jul 06 22:46:34.591106 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:34.591073 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-trx96" podStartSLOduration=1.831358053 podStartE2EDuration="22.591061566s" totalImagesPullingTime="20.759703513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:34.590598161 +0000 UTC m=+22.901766327" watchObservedRunningTime="2026-07-06 22:46:34.591061566 +0000 UTC m=+22.902229732" Jul 06 22:46:35.267982 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:35.267749 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:35.268124 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:35.267805 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:35.268124 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:35.268042 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:35.268124 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:35.268101 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:35.550754 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:35.550737 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 22:46:35.551323 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:35.551024 2568 generic.go:356] "Generic (PLEG): container finished" podID="5e812039-235d-4e1f-b0f4-597162219a9a" containerID="a34a1d87b8c237b5eac111f6d8dd11edbd0f5d5c3b91cabb2ed85e4d01752df1" exitCode=1 Jul 06 22:46:35.551323 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:35.551114 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" event={"ID":"5e812039-235d-4e1f-b0f4-597162219a9a","Type":"ContainerStarted","Data":"cd28b1c8bb509bda0a8d97f2521f9513ef7314b223cba887df597f5ae2c5f2d3"} Jul 06 22:46:35.551323 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:35.551175 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" event={"ID":"5e812039-235d-4e1f-b0f4-597162219a9a","Type":"ContainerStarted","Data":"e88d9f909bf75e1d2cad458f454c20971f240505716263b4c96a2c7ae53acbd5"} Jul 06 22:46:35.551323 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:35.551209 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" event={"ID":"5e812039-235d-4e1f-b0f4-597162219a9a","Type":"ContainerStarted","Data":"b998d751ccb545e525e81de1beb439059fc1ba030f34bc6a00d6bc6c49557ccd"} Jul 06 22:46:35.551323 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:35.551236 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" event={"ID":"5e812039-235d-4e1f-b0f4-597162219a9a","Type":"ContainerStarted","Data":"4ebc712b9bd4925461588fcf57479e56cca8f6098c6bbd8d5117810c96480dfd"} Jul 06 22:46:35.551323 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:35.551263 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" event={"ID":"5e812039-235d-4e1f-b0f4-597162219a9a","Type":"ContainerDied","Data":"a34a1d87b8c237b5eac111f6d8dd11edbd0f5d5c3b91cabb2ed85e4d01752df1"} Jul 06 22:46:36.268065 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.268025 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:36.268245 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:36.268154 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:36.554893 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.554814 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jrhnq" event={"ID":"e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03","Type":"ContainerStarted","Data":"e0a80af467fd0bbd77c74b4b5aa2d7cbc83e707d22daa36fb3498ce3e42d4f8f"} Jul 06 22:46:36.556353 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.556323 2568 generic.go:356] "Generic (PLEG): container finished" podID="20a1bee6c6da2563fb5813b625ea082f" containerID="145487ccd0d7d119d95a86c5a6871e2b7b56bd9c3e86cef6526c77de9cab1ec4" exitCode=0 Jul 06 22:46:36.556473 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.556394 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" event={"ID":"20a1bee6c6da2563fb5813b625ea082f","Type":"ContainerDied","Data":"145487ccd0d7d119d95a86c5a6871e2b7b56bd9c3e86cef6526c77de9cab1ec4"} Jul 06 22:46:36.557776 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.557757 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wkg87" event={"ID":"cf97cfd3-1578-4f60-b609-fc54d91ddd38","Type":"ContainerStarted","Data":"7a5ce928fc0d768da0472d4281920d897f456cfa493176c0c03b39b4c704ac82"} Jul 06 22:46:36.559208 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.559188 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" event={"ID":"4396dace-7959-45c5-b915-078ebe3d333c","Type":"ContainerStarted","Data":"e640ce64be25fae82707173c83527e128d7b34d60e9e109a67052511fbe1ea7c"} Jul 06 22:46:36.560389 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.560371 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f8rvz" event={"ID":"83a4a470-d3eb-4396-9fb5-f50ea5555f4e","Type":"ContainerStarted","Data":"28660e7925c8a54b69a184c7e2decc81965dce2b1656b20e40e0a8e03656dd54"} Jul 06 22:46:36.561628 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.561609 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pkqk2" event={"ID":"b9ae6155-7a85-461c-8ce2-854f62d2c9e5","Type":"ContainerStarted","Data":"eac56d585cff39717cebe332d6a6cc4514d0f3241230721fec6beb77b80f58e4"} Jul 06 22:46:36.563047 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.563026 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a889342-55cd-46aa-87f2-dd986aa3e6ff" containerID="fc989b65f0787957b52d1732a40f5accff9c8197188e7894db9047c229a137ca" exitCode=0 Jul 06 22:46:36.563137 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.563056 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" event={"ID":"7a889342-55cd-46aa-87f2-dd986aa3e6ff","Type":"ContainerDied","Data":"fc989b65f0787957b52d1732a40f5accff9c8197188e7894db9047c229a137ca"} Jul 06 22:46:36.568641 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.568603 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jrhnq" podStartSLOduration=3.834407182 podStartE2EDuration="24.568591055s" totalImagesPullingTime="20.734183873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:36.568147185 +0000 UTC m=+24.879315352" watchObservedRunningTime="2026-07-06 22:46:36.568591055 +0000 UTC m=+24.879759221" Jul 06 22:46:36.581540 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.581321 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pkqk2" podStartSLOduration=3.866098296 podStartE2EDuration="24.581308799s" totalImagesPullingTime="20.715210503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:36.581093067 +0000 UTC m=+24.892261234" watchObservedRunningTime="2026-07-06 22:46:36.581308799 +0000 UTC m=+24.892476965" Jul 06 22:46:36.593630 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.593596 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f8rvz" podStartSLOduration=3.907981038 podStartE2EDuration="24.593584555s" totalImagesPullingTime="20.685603517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:36.593246378 +0000 UTC m=+24.904414545" watchObservedRunningTime="2026-07-06 22:46:36.593584555 +0000 UTC m=+24.904752720" Jul 06 22:46:36.641914 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.641872 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wkg87" podStartSLOduration=4.005691297 podStartE2EDuration="24.641859273s" totalImagesPullingTime="20.636167976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:36.641571638 +0000 UTC m=+24.952739805" watchObservedRunningTime="2026-07-06 22:46:36.641859273 +0000 UTC m=+24.953027439" Jul 06 22:46:36.953249 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:36.953227 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 22:46:37.195114 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:37.195024 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T22:46:36.953242319Z","UUID":"d2dfbd37-a8a4-45c4-ac2d-485207a9d84d","Handler":null,"Name":"","Endpoint":""} Jul 06 22:46:37.196649 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:37.196632 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 22:46:37.196760 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:37.196672 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 22:46:37.267528 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:37.267480 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:37.267528 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:37.267518 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:37.267767 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:37.267601 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:37.267767 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:37.267753 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:37.567671 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:37.567584 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" event={"ID":"4396dace-7959-45c5-b915-078ebe3d333c","Type":"ContainerStarted","Data":"4fcbc0f0bc84cc6146340fd79da7c7f79410c4a9c5010d6864542f4d9f64010f"} Jul 06 22:46:37.570474 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:37.570451 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 22:46:37.570901 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:37.570855 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" event={"ID":"5e812039-235d-4e1f-b0f4-597162219a9a","Type":"ContainerStarted","Data":"af1400a528a9a432cf8e26cc4e91f39b95ff026b546f71eed9080c767a800db2"} Jul 06 22:46:37.572392 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:37.572370 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" event={"ID":"20a1bee6c6da2563fb5813b625ea082f","Type":"ContainerStarted","Data":"6c47107b42b0d00a0cd235a653cf0310f1eef4f4ef29ea5b124a65e87d28ef11"} Jul 06 22:46:37.587566 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:37.587437 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" podStartSLOduration=24.587415255 podStartE2EDuration="24.587415255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:37.586954883 +0000 UTC m=+25.898123050" watchObservedRunningTime="2026-07-06 22:46:37.587415255 +0000 UTC m=+25.898583423" Jul 06 22:46:38.267656 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:38.267574 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:38.267819 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:38.267708 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:38.576257 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:38.576171 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" event={"ID":"4396dace-7959-45c5-b915-078ebe3d333c","Type":"ContainerStarted","Data":"2e240628d33ab81ef1ec05a8b1b5a3da088f62d3c0fd028d1d5c79a1506aa0eb"} Jul 06 22:46:38.595190 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:38.595146 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftp6g" podStartSLOduration=3.662168496 podStartE2EDuration="26.595132679s" totalImagesPullingTime="22.932964183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:38.594788193 +0000 UTC m=+26.905956359" watchObservedRunningTime="2026-07-06 22:46:38.595132679 +0000 UTC m=+26.906300844" Jul 06 22:46:39.268069 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:39.268041 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:39.268198 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:39.268166 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:39.268266 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:39.268221 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:39.268334 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:39.268313 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:39.582243 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:39.582019 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 22:46:39.582662 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:39.582535 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" event={"ID":"5e812039-235d-4e1f-b0f4-597162219a9a","Type":"ContainerStarted","Data":"f848b893fdf0aa06c05a261b17fac0e1054cc88dbff213252b26c0215eee641b"} Jul 06 22:46:39.583124 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:39.583107 2568 scope.go:117] "RemoveContainer" containerID="a34a1d87b8c237b5eac111f6d8dd11edbd0f5d5c3b91cabb2ed85e4d01752df1" Jul 06 22:46:40.267880 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:40.267846 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:40.268074 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:40.267976 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:40.598838 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:40.593410 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 22:46:40.598838 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:40.593829 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" event={"ID":"5e812039-235d-4e1f-b0f4-597162219a9a","Type":"ContainerStarted","Data":"850ebe1e92bb77426584b6990afa5d0bb4a2adc1aaec83562ad40605feaf6a17"} Jul 06 22:46:40.598838 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:40.595090 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:40.598838 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:40.595169 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:40.598838 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:40.595265 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:40.622982 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:40.622756 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:40.626068 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:40.626008 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" podStartSLOduration=7.764609392 podStartE2EDuration="28.625985737s" totalImagesPullingTime="20.861376345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:40.625347429 +0000 UTC m=+28.936515595" watchObservedRunningTime="2026-07-06 22:46:40.625985737 +0000 UTC m=+28.937153904" Jul 06 22:46:40.627744 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:40.627722 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:46:40.722071 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:40.722020 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:40.722790 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:40.722766 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:41.267546 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:41.267520 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:41.267673 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:41.267641 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:41.267739 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:41.267726 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:41.267843 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:41.267826 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:41.432567 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:41.432290 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvr6q"] Jul 06 22:46:41.432750 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:41.432676 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:41.432809 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:41.432787 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:41.433150 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:41.433133 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hv8gk"] Jul 06 22:46:41.438128 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:41.434921 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r55k5"] Jul 06 22:46:41.596446 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:41.596368 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:41.596446 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:41.596390 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:41.596669 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:41.596623 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:41.596669 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:41.596621 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:41.596783 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:41.596748 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:41.597199 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:41.597178 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f8rvz" Jul 06 22:46:42.601106 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:42.601021 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" event={"ID":"7a889342-55cd-46aa-87f2-dd986aa3e6ff","Type":"ContainerStarted","Data":"bd4667e380c9429630c07f3e28e5b89d3785b8eb9659edc17bd8144fb003a212"} Jul 06 22:46:43.268022 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:43.267981 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:43.268178 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:43.268030 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:43.268178 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:43.268030 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:43.268178 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:43.268093 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:43.268319 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:43.268204 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:43.268319 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:43.268266 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:43.605684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:43.605579 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a889342-55cd-46aa-87f2-dd986aa3e6ff" containerID="bd4667e380c9429630c07f3e28e5b89d3785b8eb9659edc17bd8144fb003a212" exitCode=0 Jul 06 22:46:43.605684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:43.605657 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" event={"ID":"7a889342-55cd-46aa-87f2-dd986aa3e6ff","Type":"ContainerDied","Data":"bd4667e380c9429630c07f3e28e5b89d3785b8eb9659edc17bd8144fb003a212"} Jul 06 22:46:44.886341 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:44.886300 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:44.886792 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:44.886370 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:44.886792 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:44.886445 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:44.886792 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:44.886529 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs podName:44689168-2d9a-49c7-b7ae-6b8caa09b985 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:16.886511596 +0000 UTC m=+65.197679753 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs") pod "network-metrics-daemon-r55k5" (UID: "44689168-2d9a-49c7-b7ae-6b8caa09b985") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:44.886792 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:44.886453 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:44.886792 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:44.886565 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret podName:e84ebda6-5eef-48c7-8565-ebe6bfad767c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:16.886559223 +0000 UTC m=+65.197727396 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret") pod "global-pull-secret-syncer-pvr6q" (UID: "e84ebda6-5eef-48c7-8565-ebe6bfad767c") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:44.987134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:44.987098 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxgb\" (UniqueName: \"kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb\") pod \"network-check-target-hv8gk\" (UID: \"ae3307c9-b5ee-486a-925c-52f0852e8000\") " pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:44.987292 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:44.987267 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:44.987342 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:44.987294 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:44.987342 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:44.987307 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqxgb for pod openshift-network-diagnostics/network-check-target-hv8gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:44.987445 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:44.987371 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb podName:ae3307c9-b5ee-486a-925c-52f0852e8000 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:16.987352804 +0000 UTC m=+65.298520963 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqxgb" (UniqueName: "kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb") pod "network-check-target-hv8gk" (UID: "ae3307c9-b5ee-486a-925c-52f0852e8000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:45.267553 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:45.267490 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:45.267553 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:45.267543 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:45.267753 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:45.267550 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:45.267753 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:45.267629 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r55k5" podUID="44689168-2d9a-49c7-b7ae-6b8caa09b985" Jul 06 22:46:45.267753 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:45.267702 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv8gk" podUID="ae3307c9-b5ee-486a-925c-52f0852e8000" Jul 06 22:46:45.267912 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:45.267792 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvr6q" podUID="e84ebda6-5eef-48c7-8565-ebe6bfad767c" Jul 06 22:46:45.612407 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:45.612373 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a889342-55cd-46aa-87f2-dd986aa3e6ff" containerID="bc405cdc3f7db97358d3579e444e584d746cb0c4fb98e81f8d8730e2f7b19c67" exitCode=0 Jul 06 22:46:45.612571 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:45.612438 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" event={"ID":"7a889342-55cd-46aa-87f2-dd986aa3e6ff","Type":"ContainerDied","Data":"bc405cdc3f7db97358d3579e444e584d746cb0c4fb98e81f8d8730e2f7b19c67"} Jul 06 22:46:46.444120 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.443941 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeReady" Jul 06 22:46:46.444492 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.444224 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 22:46:46.484190 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.484161 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lg9t4"] Jul 06 22:46:46.497559 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.497525 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qnjgj"] Jul 06 22:46:46.498072 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.497826 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.500516 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.500473 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jx42h\"" Jul 06 22:46:46.500625 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.500522 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 22:46:46.500625 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.500527 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 22:46:46.511572 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.511550 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lg9t4"] Jul 06 22:46:46.511675 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.511596 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qnjgj"] Jul 06 22:46:46.511710 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.511668 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qnjgj" Jul 06 22:46:46.514232 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.514210 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 22:46:46.514366 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.514298 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 22:46:46.514426 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.514410 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 22:46:46.514426 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.514418 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d66nl\"" Jul 06 22:46:46.597281 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.597245 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.597281 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.597284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbsjc\" (UniqueName: \"kubernetes.io/projected/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-kube-api-access-xbsjc\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.597524 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.597342 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d49jf\" (UniqueName: \"kubernetes.io/projected/fd118b33-d5f6-4328-8b38-ee08e8ba9f08-kube-api-access-d49jf\") pod \"ingress-canary-qnjgj\" (UID: \"fd118b33-d5f6-4328-8b38-ee08e8ba9f08\") " pod="openshift-ingress-canary/ingress-canary-qnjgj" Jul 06 22:46:46.597524 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.597362 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-tmp-dir\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.597524 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.597401 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd118b33-d5f6-4328-8b38-ee08e8ba9f08-cert\") pod \"ingress-canary-qnjgj\" (UID: \"fd118b33-d5f6-4328-8b38-ee08e8ba9f08\") " pod="openshift-ingress-canary/ingress-canary-qnjgj" Jul 06 22:46:46.597524 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.597425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-config-volume\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.698383 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.698299 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.698383 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.698332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbsjc\" (UniqueName: \"kubernetes.io/projected/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-kube-api-access-xbsjc\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.698383 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.698379 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d49jf\" (UniqueName: \"kubernetes.io/projected/fd118b33-d5f6-4328-8b38-ee08e8ba9f08-kube-api-access-d49jf\") pod \"ingress-canary-qnjgj\" (UID: \"fd118b33-d5f6-4328-8b38-ee08e8ba9f08\") " pod="openshift-ingress-canary/ingress-canary-qnjgj" Jul 06 22:46:46.698665 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.698406 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-tmp-dir\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.698665 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.698457 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd118b33-d5f6-4328-8b38-ee08e8ba9f08-cert\") pod \"ingress-canary-qnjgj\" (UID: \"fd118b33-d5f6-4328-8b38-ee08e8ba9f08\") " pod="openshift-ingress-canary/ingress-canary-qnjgj" Jul 06 22:46:46.698665 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.698483 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-config-volume\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.698665 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:46.698458 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:46:46.698665 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:46.698606 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls podName:dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e nodeName:}" failed. No retries permitted until 2026-07-06 22:46:47.198580313 +0000 UTC m=+35.509748457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls") pod "dns-default-lg9t4" (UID: "dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e") : secret "dns-default-metrics-tls" not found Jul 06 22:46:46.698887 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.698784 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-tmp-dir\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.699003 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.698983 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-config-volume\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.702718 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.702698 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd118b33-d5f6-4328-8b38-ee08e8ba9f08-cert\") pod \"ingress-canary-qnjgj\" (UID: \"fd118b33-d5f6-4328-8b38-ee08e8ba9f08\") " pod="openshift-ingress-canary/ingress-canary-qnjgj" Jul 06 22:46:46.707304 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.707277 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbsjc\" (UniqueName: \"kubernetes.io/projected/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-kube-api-access-xbsjc\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:46.707409 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.707344 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d49jf\" (UniqueName: \"kubernetes.io/projected/fd118b33-d5f6-4328-8b38-ee08e8ba9f08-kube-api-access-d49jf\") pod \"ingress-canary-qnjgj\" (UID: \"fd118b33-d5f6-4328-8b38-ee08e8ba9f08\") " pod="openshift-ingress-canary/ingress-canary-qnjgj" Jul 06 22:46:46.820165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:46.820144 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qnjgj" Jul 06 22:46:47.003291 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.003256 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qnjgj"] Jul 06 22:46:47.051395 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:46:47.051365 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd118b33_d5f6_4328_8b38_ee08e8ba9f08.slice/crio-621028b3a010bc570e8ec8b99badbb672e3f11cbd9d9b81700f381a636ef0858 WatchSource:0}: Error finding container 621028b3a010bc570e8ec8b99badbb672e3f11cbd9d9b81700f381a636ef0858: Status 404 returned error can't find the container with id 621028b3a010bc570e8ec8b99badbb672e3f11cbd9d9b81700f381a636ef0858 Jul 06 22:46:47.202211 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.202127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:47.202363 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:47.202259 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:46:47.202363 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:47.202343 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls podName:dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e nodeName:}" failed. No retries permitted until 2026-07-06 22:46:48.202316432 +0000 UTC m=+36.513484590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls") pod "dns-default-lg9t4" (UID: "dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e") : secret "dns-default-metrics-tls" not found Jul 06 22:46:47.268243 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.268062 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:46:47.268404 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.268092 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:46:47.268404 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.268103 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:46:47.272509 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.272475 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:46:47.272656 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.272519 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:46:47.272656 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.272543 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 22:46:47.272656 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.272561 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkkl7\"" Jul 06 22:46:47.272936 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.272922 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 22:46:47.273174 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.273156 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5j2wj\"" Jul 06 22:46:47.618583 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.618490 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qnjgj" event={"ID":"fd118b33-d5f6-4328-8b38-ee08e8ba9f08","Type":"ContainerStarted","Data":"621028b3a010bc570e8ec8b99badbb672e3f11cbd9d9b81700f381a636ef0858"} Jul 06 22:46:47.624649 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.624612 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a889342-55cd-46aa-87f2-dd986aa3e6ff" containerID="f3401da71095e4d86a64b5da887e2fe98a9f592c2b9390ab3cff8cd1906fc64a" exitCode=0 Jul 06 22:46:47.624830 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:47.624710 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" event={"ID":"7a889342-55cd-46aa-87f2-dd986aa3e6ff","Type":"ContainerDied","Data":"f3401da71095e4d86a64b5da887e2fe98a9f592c2b9390ab3cff8cd1906fc64a"} Jul 06 22:46:48.212424 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:48.212369 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:48.212626 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:48.212592 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:46:48.212684 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:48.212655 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls podName:dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e nodeName:}" failed. No retries permitted until 2026-07-06 22:46:50.212636506 +0000 UTC m=+38.523804653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls") pod "dns-default-lg9t4" (UID: "dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e") : secret "dns-default-metrics-tls" not found Jul 06 22:46:50.229852 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:50.229809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:50.230287 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:50.229955 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:46:50.230287 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:50.230016 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls podName:dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e nodeName:}" failed. No retries permitted until 2026-07-06 22:46:54.230001928 +0000 UTC m=+42.541170075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls") pod "dns-default-lg9t4" (UID: "dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e") : secret "dns-default-metrics-tls" not found Jul 06 22:46:50.635168 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:50.635077 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qnjgj" event={"ID":"fd118b33-d5f6-4328-8b38-ee08e8ba9f08","Type":"ContainerStarted","Data":"e2c064960ca7d4ee94842b3c2b3d5684d13cd67e2d9817f9e75051eb25761ce4"} Jul 06 22:46:50.652581 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:50.652490 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qnjgj" podStartSLOduration=2.090008101 podStartE2EDuration="4.65247091s" totalImagesPullingTime="2.562462809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:50.650953044 +0000 UTC m=+38.962121223" watchObservedRunningTime="2026-07-06 22:46:50.65247091 +0000 UTC m=+38.963639077" Jul 06 22:46:53.645213 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:53.645173 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a889342-55cd-46aa-87f2-dd986aa3e6ff" containerID="0e5c157661ce8eb78674c48e14aa07fef7e3f3b48cbbd3d3c9d137b3a8527362" exitCode=0 Jul 06 22:46:53.645601 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:53.645244 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" event={"ID":"7a889342-55cd-46aa-87f2-dd986aa3e6ff","Type":"ContainerDied","Data":"0e5c157661ce8eb78674c48e14aa07fef7e3f3b48cbbd3d3c9d137b3a8527362"} Jul 06 22:46:54.261002 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:54.260962 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:46:54.261181 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:54.261115 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:46:54.261223 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:46:54.261182 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls podName:dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e nodeName:}" failed. No retries permitted until 2026-07-06 22:47:02.261165337 +0000 UTC m=+50.572333481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls") pod "dns-default-lg9t4" (UID: "dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e") : secret "dns-default-metrics-tls" not found Jul 06 22:46:54.649934 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:54.649834 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a889342-55cd-46aa-87f2-dd986aa3e6ff" containerID="161efa8ea969b64eda41484a40c566f4aa507de5f7005eaef9660f56fbd201b8" exitCode=0 Jul 06 22:46:54.649934 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:54.649878 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" event={"ID":"7a889342-55cd-46aa-87f2-dd986aa3e6ff","Type":"ContainerDied","Data":"161efa8ea969b64eda41484a40c566f4aa507de5f7005eaef9660f56fbd201b8"} Jul 06 22:46:55.658270 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:55.658231 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" event={"ID":"7a889342-55cd-46aa-87f2-dd986aa3e6ff","Type":"ContainerStarted","Data":"5c410440a7908273d06ea508c534a1d2925acbc351f681154fede296b9de2e73"} Jul 06 22:46:55.683272 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:46:55.683216 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bwh7m" podStartSLOduration=9.84197738 podStartE2EDuration="43.683201461s" totalImagesPullingTime="33.841224081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:55.682173273 +0000 UTC m=+43.993341439" watchObservedRunningTime="2026-07-06 22:46:55.683201461 +0000 UTC m=+43.994369626" Jul 06 22:47:02.317135 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:02.317090 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:47:02.317552 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:02.317248 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:47:02.317552 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:02.317316 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls podName:dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e nodeName:}" failed. No retries permitted until 2026-07-06 22:47:18.317300525 +0000 UTC m=+66.628468690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls") pod "dns-default-lg9t4" (UID: "dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e") : secret "dns-default-metrics-tls" not found Jul 06 22:47:04.441517 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.441464 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg"] Jul 06 22:47:04.443432 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.443412 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:04.445574 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.445552 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 22:47:04.445890 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.445874 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 22:47:04.446407 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.446389 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-46zbz\"" Jul 06 22:47:04.454668 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.454647 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg"] Jul 06 22:47:04.528849 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.528813 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:04.528849 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.528858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a91034b3-3ca7-4bc2-abe8-39001338252d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:04.567855 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.567822 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59f574999c-h5cs9"] Jul 06 22:47:04.569681 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.569662 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.573700 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.573674 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 22:47:04.573828 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.573715 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 22:47:04.573900 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.573850 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fr57l\"" Jul 06 22:47:04.583966 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.583931 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 22:47:04.584140 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.584123 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 22:47:04.593141 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.593108 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f574999c-h5cs9"] Jul 06 22:47:04.629461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.629428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzth7\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-kube-api-access-jzth7\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.629461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.629467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:04.629718 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.629489 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-trusted-ca\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.629718 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.629529 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a91034b3-3ca7-4bc2-abe8-39001338252d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:04.629718 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:04.629607 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:47:04.629718 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.629637 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.629718 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:04.629681 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert podName:a91034b3-3ca7-4bc2-abe8-39001338252d nodeName:}" failed. No retries permitted until 2026-07-06 22:47:05.12965856 +0000 UTC m=+53.440826715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5bdtg" (UID: "a91034b3-3ca7-4bc2-abe8-39001338252d") : secret "networking-console-plugin-cert" not found Jul 06 22:47:04.629992 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.629777 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-bound-sa-token\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.629992 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.629816 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56a0fc27-6076-4abe-812a-5f3890a8b8e7-ca-trust-extracted\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.629992 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.629841 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-certificates\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.629992 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.629931 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-installation-pull-secrets\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.629992 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.629960 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-image-registry-private-configuration\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.630137 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.630109 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a91034b3-3ca7-4bc2-abe8-39001338252d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:04.653712 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.653683 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5"] Jul 06 22:47:04.656618 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.656591 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:04.659800 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.659778 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7mtjt\"" Jul 06 22:47:04.659952 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.659877 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 22:47:04.660218 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.660202 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 22:47:04.660312 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.660224 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:47:04.671476 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.671445 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5"] Jul 06 22:47:04.730843 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.730809 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-skss5\" (UID: \"6ae2123b-2765-44ea-9276-e60da0271b8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:04.731026 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.730860 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-bound-sa-token\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.731026 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.730913 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56a0fc27-6076-4abe-812a-5f3890a8b8e7-ca-trust-extracted\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.731026 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.730949 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-certificates\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.731187 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.731166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-installation-pull-secrets\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.731225 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.731209 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-image-registry-private-configuration\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.731262 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.731243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzth7\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-kube-api-access-jzth7\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.731298 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.731282 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-trusted-ca\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.731342 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.731325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nqhg\" (UniqueName: \"kubernetes.io/projected/6ae2123b-2765-44ea-9276-e60da0271b8d-kube-api-access-8nqhg\") pod \"cluster-samples-operator-56fcf86bf-skss5\" (UID: \"6ae2123b-2765-44ea-9276-e60da0271b8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:04.731393 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.731356 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.731393 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.731369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56a0fc27-6076-4abe-812a-5f3890a8b8e7-ca-trust-extracted\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.731485 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:04.731447 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:47:04.731485 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:04.731458 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f574999c-h5cs9: secret "image-registry-tls" not found Jul 06 22:47:04.731608 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:04.731538 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls podName:56a0fc27-6076-4abe-812a-5f3890a8b8e7 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:05.231520101 +0000 UTC m=+53.542688260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls") pod "image-registry-59f574999c-h5cs9" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7") : secret "image-registry-tls" not found Jul 06 22:47:04.731608 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.731548 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-certificates\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.732291 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.732262 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-trusted-ca\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.734919 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.734899 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-image-registry-private-configuration\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.734995 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.734931 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-installation-pull-secrets\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.741397 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.741362 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-bound-sa-token\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.741953 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.741930 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzth7\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-kube-api-access-jzth7\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:04.832353 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.832309 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nqhg\" (UniqueName: \"kubernetes.io/projected/6ae2123b-2765-44ea-9276-e60da0271b8d-kube-api-access-8nqhg\") pod \"cluster-samples-operator-56fcf86bf-skss5\" (UID: \"6ae2123b-2765-44ea-9276-e60da0271b8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:04.832582 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.832369 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-skss5\" (UID: \"6ae2123b-2765-44ea-9276-e60da0271b8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:04.832582 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:04.832447 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:47:04.832582 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:04.832532 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls podName:6ae2123b-2765-44ea-9276-e60da0271b8d nodeName:}" failed. No retries permitted until 2026-07-06 22:47:05.332491486 +0000 UTC m=+53.643659644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-skss5" (UID: "6ae2123b-2765-44ea-9276-e60da0271b8d") : secret "samples-operator-tls" not found Jul 06 22:47:04.841057 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:04.841035 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nqhg\" (UniqueName: \"kubernetes.io/projected/6ae2123b-2765-44ea-9276-e60da0271b8d-kube-api-access-8nqhg\") pod \"cluster-samples-operator-56fcf86bf-skss5\" (UID: \"6ae2123b-2765-44ea-9276-e60da0271b8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:05.134856 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:05.134772 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:05.135051 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:05.134924 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:47:05.135051 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:05.135013 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert podName:a91034b3-3ca7-4bc2-abe8-39001338252d nodeName:}" failed. No retries permitted until 2026-07-06 22:47:06.134997027 +0000 UTC m=+54.446165172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5bdtg" (UID: "a91034b3-3ca7-4bc2-abe8-39001338252d") : secret "networking-console-plugin-cert" not found Jul 06 22:47:05.235713 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:05.235666 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:05.235948 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:05.235821 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:47:05.235948 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:05.235842 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f574999c-h5cs9: secret "image-registry-tls" not found Jul 06 22:47:05.235948 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:05.235896 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls podName:56a0fc27-6076-4abe-812a-5f3890a8b8e7 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:06.235879551 +0000 UTC m=+54.547047696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls") pod "image-registry-59f574999c-h5cs9" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7") : secret "image-registry-tls" not found Jul 06 22:47:05.336620 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:05.336569 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-skss5\" (UID: \"6ae2123b-2765-44ea-9276-e60da0271b8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:05.336787 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:05.336721 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:47:05.336825 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:05.336789 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls podName:6ae2123b-2765-44ea-9276-e60da0271b8d nodeName:}" failed. No retries permitted until 2026-07-06 22:47:06.33677279 +0000 UTC m=+54.647940934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-skss5" (UID: "6ae2123b-2765-44ea-9276-e60da0271b8d") : secret "samples-operator-tls" not found Jul 06 22:47:06.144056 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:06.143938 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:06.144432 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:06.144099 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:47:06.144432 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:06.144167 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert podName:a91034b3-3ca7-4bc2-abe8-39001338252d nodeName:}" failed. No retries permitted until 2026-07-06 22:47:08.144151435 +0000 UTC m=+56.455319614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5bdtg" (UID: "a91034b3-3ca7-4bc2-abe8-39001338252d") : secret "networking-console-plugin-cert" not found Jul 06 22:47:06.245249 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:06.245196 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:06.245402 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:06.245347 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:47:06.245402 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:06.245368 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f574999c-h5cs9: secret "image-registry-tls" not found Jul 06 22:47:06.245490 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:06.245420 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls podName:56a0fc27-6076-4abe-812a-5f3890a8b8e7 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:08.245404432 +0000 UTC m=+56.556572576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls") pod "image-registry-59f574999c-h5cs9" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7") : secret "image-registry-tls" not found Jul 06 22:47:06.346183 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:06.346146 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-skss5\" (UID: \"6ae2123b-2765-44ea-9276-e60da0271b8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:06.346375 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:06.346326 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:47:06.346448 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:06.346409 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls podName:6ae2123b-2765-44ea-9276-e60da0271b8d nodeName:}" failed. No retries permitted until 2026-07-06 22:47:08.346389666 +0000 UTC m=+56.657557831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-skss5" (UID: "6ae2123b-2765-44ea-9276-e60da0271b8d") : secret "samples-operator-tls" not found Jul 06 22:47:08.160865 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:08.160815 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:08.161263 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:08.160967 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:47:08.161263 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:08.161035 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert podName:a91034b3-3ca7-4bc2-abe8-39001338252d nodeName:}" failed. No retries permitted until 2026-07-06 22:47:12.161020039 +0000 UTC m=+60.472188182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5bdtg" (UID: "a91034b3-3ca7-4bc2-abe8-39001338252d") : secret "networking-console-plugin-cert" not found Jul 06 22:47:08.262258 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:08.262217 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:08.262421 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:08.262377 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:47:08.262421 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:08.262400 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f574999c-h5cs9: secret "image-registry-tls" not found Jul 06 22:47:08.262487 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:08.262456 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls podName:56a0fc27-6076-4abe-812a-5f3890a8b8e7 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:12.262439648 +0000 UTC m=+60.573607797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls") pod "image-registry-59f574999c-h5cs9" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7") : secret "image-registry-tls" not found Jul 06 22:47:08.363396 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:08.363360 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-skss5\" (UID: \"6ae2123b-2765-44ea-9276-e60da0271b8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:08.363593 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:08.363479 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:47:08.363593 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:08.363553 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls podName:6ae2123b-2765-44ea-9276-e60da0271b8d nodeName:}" failed. No retries permitted until 2026-07-06 22:47:12.363539747 +0000 UTC m=+60.674707891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-skss5" (UID: "6ae2123b-2765-44ea-9276-e60da0271b8d") : secret "samples-operator-tls" not found Jul 06 22:47:09.226394 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.226364 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zsfk7"] Jul 06 22:47:09.229100 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.229084 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.231289 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.231268 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 22:47:09.231422 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.231302 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4p5jh\"" Jul 06 22:47:09.231422 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.231302 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 22:47:09.232158 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.232143 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 22:47:09.232273 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.232242 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 22:47:09.240573 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.240543 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zsfk7"] Jul 06 22:47:09.270575 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.270536 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.270785 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.270594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6dba2eb5-ade5-4809-a6cd-32264f60254c-crio-socket\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.270785 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.270658 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqlpb\" (UniqueName: \"kubernetes.io/projected/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-api-access-nqlpb\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.270785 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.270707 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6dba2eb5-ade5-4809-a6cd-32264f60254c-data-volume\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.270785 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.270749 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.371965 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.371911 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.372171 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.372022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.372171 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:09.372058 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:47:09.372171 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.372120 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6dba2eb5-ade5-4809-a6cd-32264f60254c-crio-socket\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.372171 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.372062 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6dba2eb5-ade5-4809-a6cd-32264f60254c-crio-socket\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.372171 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:09.372145 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm podName:6dba2eb5-ade5-4809-a6cd-32264f60254c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:09.87212564 +0000 UTC m=+58.183293802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zsfk7" (UID: "6dba2eb5-ade5-4809-a6cd-32264f60254c") : configmap "kube-rbac-proxy" not found Jul 06 22:47:09.372409 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:09.372177 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:09.372409 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.372206 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqlpb\" (UniqueName: \"kubernetes.io/projected/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-api-access-nqlpb\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.372409 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:09.372228 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls podName:6dba2eb5-ade5-4809-a6cd-32264f60254c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:09.872216098 +0000 UTC m=+58.183384243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zsfk7" (UID: "6dba2eb5-ade5-4809-a6cd-32264f60254c") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:09.372409 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.372259 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6dba2eb5-ade5-4809-a6cd-32264f60254c-data-volume\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.372604 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.372557 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6dba2eb5-ade5-4809-a6cd-32264f60254c-data-volume\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.381484 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.381455 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqlpb\" (UniqueName: \"kubernetes.io/projected/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-api-access-nqlpb\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.876491 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.876446 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.876689 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:09.876603 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:09.876689 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:09.876660 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:09.876689 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:09.876666 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls podName:6dba2eb5-ade5-4809-a6cd-32264f60254c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:10.876652606 +0000 UTC m=+59.187820750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zsfk7" (UID: "6dba2eb5-ade5-4809-a6cd-32264f60254c") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:09.876820 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:09.876756 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:47:09.876820 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:09.876811 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm podName:6dba2eb5-ade5-4809-a6cd-32264f60254c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:10.876799288 +0000 UTC m=+59.187967432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zsfk7" (UID: "6dba2eb5-ade5-4809-a6cd-32264f60254c") : configmap "kube-rbac-proxy" not found Jul 06 22:47:10.885734 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:10.885678 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:10.886129 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:10.885771 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:10.886129 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:10.885837 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:10.886129 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:10.885861 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:47:10.886129 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:10.885901 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls podName:6dba2eb5-ade5-4809-a6cd-32264f60254c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:12.885886207 +0000 UTC m=+61.197054352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zsfk7" (UID: "6dba2eb5-ade5-4809-a6cd-32264f60254c") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:10.886129 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:10.885918 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm podName:6dba2eb5-ade5-4809-a6cd-32264f60254c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:12.885909898 +0000 UTC m=+61.197078042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zsfk7" (UID: "6dba2eb5-ade5-4809-a6cd-32264f60254c") : configmap "kube-rbac-proxy" not found Jul 06 22:47:11.392882 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:11.392854 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wkg87_cf97cfd3-1578-4f60-b609-fc54d91ddd38/dns-node-resolver/0.log" Jul 06 22:47:12.192758 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:12.192730 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jrhnq_e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03/node-ca/0.log" Jul 06 22:47:12.195428 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:12.195406 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:12.195589 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:12.195571 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:47:12.195647 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:12.195636 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert podName:a91034b3-3ca7-4bc2-abe8-39001338252d nodeName:}" failed. No retries permitted until 2026-07-06 22:47:20.195617598 +0000 UTC m=+68.506785761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5bdtg" (UID: "a91034b3-3ca7-4bc2-abe8-39001338252d") : secret "networking-console-plugin-cert" not found Jul 06 22:47:12.296677 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:12.296633 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:12.296847 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:12.296806 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:47:12.296847 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:12.296828 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f574999c-h5cs9: secret "image-registry-tls" not found Jul 06 22:47:12.296922 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:12.296891 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls podName:56a0fc27-6076-4abe-812a-5f3890a8b8e7 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:20.296874407 +0000 UTC m=+68.608042552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls") pod "image-registry-59f574999c-h5cs9" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7") : secret "image-registry-tls" not found Jul 06 22:47:12.397892 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:12.397834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-skss5\" (UID: \"6ae2123b-2765-44ea-9276-e60da0271b8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:12.398072 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:12.397991 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:47:12.398072 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:12.398057 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls podName:6ae2123b-2765-44ea-9276-e60da0271b8d nodeName:}" failed. No retries permitted until 2026-07-06 22:47:20.398041632 +0000 UTC m=+68.709209776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-skss5" (UID: "6ae2123b-2765-44ea-9276-e60da0271b8d") : secret "samples-operator-tls" not found Jul 06 22:47:12.611868 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:12.611794 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qvqv" Jul 06 22:47:12.901575 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:12.901460 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:12.901746 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:12.901600 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:47:12.901746 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:12.901681 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm podName:6dba2eb5-ade5-4809-a6cd-32264f60254c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:16.901660668 +0000 UTC m=+65.212828814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zsfk7" (UID: "6dba2eb5-ade5-4809-a6cd-32264f60254c") : configmap "kube-rbac-proxy" not found Jul 06 22:47:12.901746 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:12.901706 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:12.901914 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:12.901826 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:12.901914 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:12.901874 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls podName:6dba2eb5-ade5-4809-a6cd-32264f60254c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:16.901862142 +0000 UTC m=+65.213030301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zsfk7" (UID: "6dba2eb5-ade5-4809-a6cd-32264f60254c") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:13.192858 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:13.192829 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qnjgj_fd118b33-d5f6-4328-8b38-ee08e8ba9f08/serve-healthcheck-canary/0.log" Jul 06 22:47:16.936480 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:16.936442 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:16.936989 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:16.936562 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:47:16.936989 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:16.936592 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:16.936989 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:16.936606 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:16.936989 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:16.936663 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:47:16.936989 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:16.936679 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls podName:6dba2eb5-ade5-4809-a6cd-32264f60254c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:24.936662495 +0000 UTC m=+73.247830638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zsfk7" (UID: "6dba2eb5-ade5-4809-a6cd-32264f60254c") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:16.936989 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:16.936744 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:47:16.936989 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:16.936777 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm podName:6dba2eb5-ade5-4809-a6cd-32264f60254c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:24.93676943 +0000 UTC m=+73.247937577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zsfk7" (UID: "6dba2eb5-ade5-4809-a6cd-32264f60254c") : configmap "kube-rbac-proxy" not found Jul 06 22:47:16.939788 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:16.939763 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:47:16.939903 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:16.939883 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:47:16.947463 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:16.947444 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 22:47:16.947534 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:16.947518 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs podName:44689168-2d9a-49c7-b7ae-6b8caa09b985 nodeName:}" failed. No retries permitted until 2026-07-06 22:48:20.947487989 +0000 UTC m=+129.258656132 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs") pod "network-metrics-daemon-r55k5" (UID: "44689168-2d9a-49c7-b7ae-6b8caa09b985") : secret "metrics-daemon-secret" not found Jul 06 22:47:16.949515 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:16.949484 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84ebda6-5eef-48c7-8565-ebe6bfad767c-original-pull-secret\") pod \"global-pull-secret-syncer-pvr6q\" (UID: \"e84ebda6-5eef-48c7-8565-ebe6bfad767c\") " pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:47:16.977513 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:16.977460 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvr6q" Jul 06 22:47:17.038181 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:17.038096 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxgb\" (UniqueName: \"kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb\") pod \"network-check-target-hv8gk\" (UID: \"ae3307c9-b5ee-486a-925c-52f0852e8000\") " pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:47:17.041257 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:17.040869 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 22:47:17.051947 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:17.051917 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 22:47:17.063916 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:17.063887 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqxgb\" (UniqueName: \"kubernetes.io/projected/ae3307c9-b5ee-486a-925c-52f0852e8000-kube-api-access-hqxgb\") pod \"network-check-target-hv8gk\" (UID: \"ae3307c9-b5ee-486a-925c-52f0852e8000\") " pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:47:17.109603 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:17.109571 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvr6q"] Jul 06 22:47:17.112853 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:17.112818 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode84ebda6_5eef_48c7_8565_ebe6bfad767c.slice/crio-65092c7a045e28a838814a181dca59b3b9be7e4978aceb6fd20dd6aace18eb0c WatchSource:0}: Error finding container 65092c7a045e28a838814a181dca59b3b9be7e4978aceb6fd20dd6aace18eb0c: Status 404 returned error can't find the container with id 65092c7a045e28a838814a181dca59b3b9be7e4978aceb6fd20dd6aace18eb0c Jul 06 22:47:17.287145 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:17.287111 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkkl7\"" Jul 06 22:47:17.295319 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:17.295291 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:47:17.422413 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:17.422225 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hv8gk"] Jul 06 22:47:17.425018 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:17.424991 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3307c9_b5ee_486a_925c_52f0852e8000.slice/crio-31fd5bbc1651f7042f9af02589d7ff337a9a363ab901d3dfbffcd17ae6901eea WatchSource:0}: Error finding container 31fd5bbc1651f7042f9af02589d7ff337a9a363ab901d3dfbffcd17ae6901eea: Status 404 returned error can't find the container with id 31fd5bbc1651f7042f9af02589d7ff337a9a363ab901d3dfbffcd17ae6901eea Jul 06 22:47:17.710853 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:17.710811 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvr6q" event={"ID":"e84ebda6-5eef-48c7-8565-ebe6bfad767c","Type":"ContainerStarted","Data":"65092c7a045e28a838814a181dca59b3b9be7e4978aceb6fd20dd6aace18eb0c"} Jul 06 22:47:17.712210 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:17.712171 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hv8gk" event={"ID":"ae3307c9-b5ee-486a-925c-52f0852e8000","Type":"ContainerStarted","Data":"31fd5bbc1651f7042f9af02589d7ff337a9a363ab901d3dfbffcd17ae6901eea"} Jul 06 22:47:18.350475 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:18.350434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:47:18.350959 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:18.350640 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:47:18.350959 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:18.350719 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls podName:dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e nodeName:}" failed. No retries permitted until 2026-07-06 22:47:50.350697327 +0000 UTC m=+98.661865515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls") pod "dns-default-lg9t4" (UID: "dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e") : secret "dns-default-metrics-tls" not found Jul 06 22:47:20.268250 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:20.268214 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:20.268750 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:20.268385 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:47:20.268750 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:20.268464 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert podName:a91034b3-3ca7-4bc2-abe8-39001338252d nodeName:}" failed. No retries permitted until 2026-07-06 22:47:36.268445016 +0000 UTC m=+84.579613175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5bdtg" (UID: "a91034b3-3ca7-4bc2-abe8-39001338252d") : secret "networking-console-plugin-cert" not found Jul 06 22:47:20.369020 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:20.368987 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:20.371685 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:20.371650 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls\") pod \"image-registry-59f574999c-h5cs9\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:20.470231 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:20.470189 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-skss5\" (UID: \"6ae2123b-2765-44ea-9276-e60da0271b8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:20.473225 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:20.473194 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ae2123b-2765-44ea-9276-e60da0271b8d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-skss5\" (UID: \"6ae2123b-2765-44ea-9276-e60da0271b8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:20.480309 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:20.480275 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fr57l\"" Jul 06 22:47:20.488792 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:20.488750 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:20.568253 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:20.568170 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7mtjt\"" Jul 06 22:47:20.576406 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:20.576360 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" Jul 06 22:47:22.102809 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.102775 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5"] Jul 06 22:47:22.121279 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.121209 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f574999c-h5cs9"] Jul 06 22:47:22.132833 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:22.132798 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a0fc27_6076_4abe_812a_5f3890a8b8e7.slice/crio-b5895aa68f3d179a3e70e30402fa2e28c23ab48551d7aac5af2914e01a18221e WatchSource:0}: Error finding container b5895aa68f3d179a3e70e30402fa2e28c23ab48551d7aac5af2914e01a18221e: Status 404 returned error can't find the container with id b5895aa68f3d179a3e70e30402fa2e28c23ab48551d7aac5af2914e01a18221e Jul 06 22:47:22.728116 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.728071 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" event={"ID":"56a0fc27-6076-4abe-812a-5f3890a8b8e7","Type":"ContainerStarted","Data":"59d5309c0c386905b8cbeb0bc8d25cfcf994a9313d041d0b4c7d2b81c9d6e51c"} Jul 06 22:47:22.728312 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.728139 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" event={"ID":"56a0fc27-6076-4abe-812a-5f3890a8b8e7","Type":"ContainerStarted","Data":"b5895aa68f3d179a3e70e30402fa2e28c23ab48551d7aac5af2914e01a18221e"} Jul 06 22:47:22.728312 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.728202 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:47:22.729650 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.729615 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" event={"ID":"6ae2123b-2765-44ea-9276-e60da0271b8d","Type":"ContainerStarted","Data":"9fc69dbcdbf0751241975c566084fbf45c5cff23a44085f68d34f3ed32e71c36"} Jul 06 22:47:22.731272 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.731243 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvr6q" event={"ID":"e84ebda6-5eef-48c7-8565-ebe6bfad767c","Type":"ContainerStarted","Data":"4cd06f6581d61c57d8fcdfb4f882c9b7bef7d9776c0f355a43178b4d3ec880c3"} Jul 06 22:47:22.733119 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.733089 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hv8gk" event={"ID":"ae3307c9-b5ee-486a-925c-52f0852e8000","Type":"ContainerStarted","Data":"6d17e3446f7a386c2b119f8716cdb30dee4f8fb80f6ec034224bd2987848af42"} Jul 06 22:47:22.733260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.733192 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:47:22.745652 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.745598 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" podStartSLOduration=18.745579985 podStartE2EDuration="18.745579985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:22.74508086 +0000 UTC m=+71.056249037" watchObservedRunningTime="2026-07-06 22:47:22.745579985 +0000 UTC m=+71.056748153" Jul 06 22:47:22.760415 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.760356 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pvr6q" podStartSLOduration=65.90876197 podStartE2EDuration="1m10.760336555s" totalImagesPullingTime="4.851574585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:22.760179702 +0000 UTC m=+71.071347879" watchObservedRunningTime="2026-07-06 22:47:22.760336555 +0000 UTC m=+71.071504723" Jul 06 22:47:22.774269 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:22.774216 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hv8gk" podStartSLOduration=66.24695743 podStartE2EDuration="1m10.774197563s" totalImagesPullingTime="4.527240133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:22.773571552 +0000 UTC m=+71.084739721" watchObservedRunningTime="2026-07-06 22:47:22.774197563 +0000 UTC m=+71.085365723" Jul 06 22:47:23.739046 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:23.739003 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" event={"ID":"6ae2123b-2765-44ea-9276-e60da0271b8d","Type":"ContainerStarted","Data":"e21ffba5790baad406305c2e34d8d022aad44d044f4d036692867df2256c5ed7"} Jul 06 22:47:23.739568 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:23.739080 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" event={"ID":"6ae2123b-2765-44ea-9276-e60da0271b8d","Type":"ContainerStarted","Data":"30ffa4ab866d5f9a6d3c9fd650486a7c795d1a9f39e421b6aa8689aecd352bc0"} Jul 06 22:47:23.753698 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:23.753633 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-skss5" podStartSLOduration=18.345690558 podStartE2EDuration="19.753613925s" totalImagesPullingTime="1.407923367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:23.753315085 +0000 UTC m=+72.064483250" watchObservedRunningTime="2026-07-06 22:47:23.753613925 +0000 UTC m=+72.064782090" Jul 06 22:47:25.010701 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:25.010643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:25.011085 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:25.010743 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:25.011085 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:25.010850 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:25.011085 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:25.010905 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls podName:6dba2eb5-ade5-4809-a6cd-32264f60254c nodeName:}" failed. No retries permitted until 2026-07-06 22:47:41.010891252 +0000 UTC m=+89.322059395 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zsfk7" (UID: "6dba2eb5-ade5-4809-a6cd-32264f60254c") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:25.011238 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:25.011178 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6dba2eb5-ade5-4809-a6cd-32264f60254c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:35.139245 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.139116 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c"] Jul 06 22:47:35.141821 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.141802 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:35.144382 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.144350 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 22:47:35.145259 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.145241 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 22:47:35.145364 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.145308 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 22:47:35.145364 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.145322 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 22:47:35.151812 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.151786 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c"] Jul 06 22:47:35.171340 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.171307 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f574999c-h5cs9"] Jul 06 22:47:35.239261 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.239221 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fddb6f768-v98x2"] Jul 06 22:47:35.241698 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.241678 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.263790 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.263752 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fddb6f768-v98x2"] Jul 06 22:47:35.289161 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.289119 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b1844b14-bdc2-4cbc-b164-f34e54cefc0f-klusterlet-config\") pod \"klusterlet-addon-workmgr-75788db8f6-96c4c\" (UID: \"b1844b14-bdc2-4cbc-b164-f34e54cefc0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:35.289161 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.289164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1844b14-bdc2-4cbc-b164-f34e54cefc0f-tmp\") pod \"klusterlet-addon-workmgr-75788db8f6-96c4c\" (UID: \"b1844b14-bdc2-4cbc-b164-f34e54cefc0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:35.289370 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.289188 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5kj7\" (UniqueName: \"kubernetes.io/projected/b1844b14-bdc2-4cbc-b164-f34e54cefc0f-kube-api-access-v5kj7\") pod \"klusterlet-addon-workmgr-75788db8f6-96c4c\" (UID: \"b1844b14-bdc2-4cbc-b164-f34e54cefc0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:35.389876 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.389782 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f06e63ed-81de-4017-83c5-e056846a2141-installation-pull-secrets\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.389876 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.389846 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f06e63ed-81de-4017-83c5-e056846a2141-trusted-ca\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.390068 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.389899 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1844b14-bdc2-4cbc-b164-f34e54cefc0f-tmp\") pod \"klusterlet-addon-workmgr-75788db8f6-96c4c\" (UID: \"b1844b14-bdc2-4cbc-b164-f34e54cefc0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:35.390068 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.389927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f06e63ed-81de-4017-83c5-e056846a2141-image-registry-private-configuration\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.390068 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.389970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f06e63ed-81de-4017-83c5-e056846a2141-registry-certificates\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.390068 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.390050 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f06e63ed-81de-4017-83c5-e056846a2141-registry-tls\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.390192 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.390087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvls\" (UniqueName: \"kubernetes.io/projected/f06e63ed-81de-4017-83c5-e056846a2141-kube-api-access-mfvls\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.390192 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.390140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b1844b14-bdc2-4cbc-b164-f34e54cefc0f-klusterlet-config\") pod \"klusterlet-addon-workmgr-75788db8f6-96c4c\" (UID: \"b1844b14-bdc2-4cbc-b164-f34e54cefc0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:35.390192 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.390169 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5kj7\" (UniqueName: \"kubernetes.io/projected/b1844b14-bdc2-4cbc-b164-f34e54cefc0f-kube-api-access-v5kj7\") pod \"klusterlet-addon-workmgr-75788db8f6-96c4c\" (UID: \"b1844b14-bdc2-4cbc-b164-f34e54cefc0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:35.390192 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.390185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f06e63ed-81de-4017-83c5-e056846a2141-ca-trust-extracted\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.390330 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.390275 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1844b14-bdc2-4cbc-b164-f34e54cefc0f-tmp\") pod \"klusterlet-addon-workmgr-75788db8f6-96c4c\" (UID: \"b1844b14-bdc2-4cbc-b164-f34e54cefc0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:35.390330 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.390292 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f06e63ed-81de-4017-83c5-e056846a2141-bound-sa-token\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.392785 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.392759 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b1844b14-bdc2-4cbc-b164-f34e54cefc0f-klusterlet-config\") pod \"klusterlet-addon-workmgr-75788db8f6-96c4c\" (UID: \"b1844b14-bdc2-4cbc-b164-f34e54cefc0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:35.399142 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.399109 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5kj7\" (UniqueName: \"kubernetes.io/projected/b1844b14-bdc2-4cbc-b164-f34e54cefc0f-kube-api-access-v5kj7\") pod \"klusterlet-addon-workmgr-75788db8f6-96c4c\" (UID: \"b1844b14-bdc2-4cbc-b164-f34e54cefc0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:35.451335 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.451295 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:35.491449 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.491412 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f06e63ed-81de-4017-83c5-e056846a2141-bound-sa-token\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.491449 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.491454 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f06e63ed-81de-4017-83c5-e056846a2141-installation-pull-secrets\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.491727 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.491510 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f06e63ed-81de-4017-83c5-e056846a2141-trusted-ca\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.491727 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.491547 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f06e63ed-81de-4017-83c5-e056846a2141-image-registry-private-configuration\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.491727 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.491577 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f06e63ed-81de-4017-83c5-e056846a2141-registry-certificates\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.491727 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.491623 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f06e63ed-81de-4017-83c5-e056846a2141-registry-tls\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.491727 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.491653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvls\" (UniqueName: \"kubernetes.io/projected/f06e63ed-81de-4017-83c5-e056846a2141-kube-api-access-mfvls\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.491727 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.491722 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f06e63ed-81de-4017-83c5-e056846a2141-ca-trust-extracted\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.492357 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.492328 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f06e63ed-81de-4017-83c5-e056846a2141-ca-trust-extracted\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.492746 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.492721 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f06e63ed-81de-4017-83c5-e056846a2141-registry-certificates\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.492957 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.492936 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f06e63ed-81de-4017-83c5-e056846a2141-trusted-ca\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.494374 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.494344 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f06e63ed-81de-4017-83c5-e056846a2141-registry-tls\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.494486 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.494470 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f06e63ed-81de-4017-83c5-e056846a2141-image-registry-private-configuration\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.494621 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.494603 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f06e63ed-81de-4017-83c5-e056846a2141-installation-pull-secrets\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.499284 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.499255 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f06e63ed-81de-4017-83c5-e056846a2141-bound-sa-token\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.499581 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.499559 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvls\" (UniqueName: \"kubernetes.io/projected/f06e63ed-81de-4017-83c5-e056846a2141-kube-api-access-mfvls\") pod \"image-registry-5fddb6f768-v98x2\" (UID: \"f06e63ed-81de-4017-83c5-e056846a2141\") " pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.550652 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.550622 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.585990 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.585952 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c"] Jul 06 22:47:35.588909 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:35.588874 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1844b14_bdc2_4cbc_b164_f34e54cefc0f.slice/crio-a4f1afc20ea52cd29ee4794acd5527272d956da59e5382c8f4f1c5af8ed164c9 WatchSource:0}: Error finding container a4f1afc20ea52cd29ee4794acd5527272d956da59e5382c8f4f1c5af8ed164c9: Status 404 returned error can't find the container with id a4f1afc20ea52cd29ee4794acd5527272d956da59e5382c8f4f1c5af8ed164c9 Jul 06 22:47:35.684339 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.684239 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fddb6f768-v98x2"] Jul 06 22:47:35.687533 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:35.687486 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06e63ed_81de_4017_83c5_e056846a2141.slice/crio-6e11a584ed228465017b6b8144e03c31ee659be05bc97f9e5cf575f8f0f98083 WatchSource:0}: Error finding container 6e11a584ed228465017b6b8144e03c31ee659be05bc97f9e5cf575f8f0f98083: Status 404 returned error can't find the container with id 6e11a584ed228465017b6b8144e03c31ee659be05bc97f9e5cf575f8f0f98083 Jul 06 22:47:35.782089 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.782051 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" event={"ID":"b1844b14-bdc2-4cbc-b164-f34e54cefc0f","Type":"ContainerStarted","Data":"a4f1afc20ea52cd29ee4794acd5527272d956da59e5382c8f4f1c5af8ed164c9"} Jul 06 22:47:35.783594 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.783557 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" event={"ID":"f06e63ed-81de-4017-83c5-e056846a2141","Type":"ContainerStarted","Data":"e0326abcb232b4c05f7b7909a3744d95e99b898e95f9f4751890f7d080015dca"} Jul 06 22:47:35.783704 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.783604 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" event={"ID":"f06e63ed-81de-4017-83c5-e056846a2141","Type":"ContainerStarted","Data":"6e11a584ed228465017b6b8144e03c31ee659be05bc97f9e5cf575f8f0f98083"} Jul 06 22:47:35.783704 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.783639 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:35.802188 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:35.802135 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" podStartSLOduration=0.802117296 podStartE2EDuration="802.117296ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:35.800961255 +0000 UTC m=+84.112129422" watchObservedRunningTime="2026-07-06 22:47:35.802117296 +0000 UTC m=+84.113285462" Jul 06 22:47:36.298643 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:36.298600 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:36.301067 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:36.301042 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a91034b3-3ca7-4bc2-abe8-39001338252d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5bdtg\" (UID: \"a91034b3-3ca7-4bc2-abe8-39001338252d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:36.555104 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:36.555009 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-46zbz\"" Jul 06 22:47:36.562227 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:36.562184 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" Jul 06 22:47:36.737591 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:36.737378 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg"] Jul 06 22:47:36.741964 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:36.741922 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91034b3_3ca7_4bc2_abe8_39001338252d.slice/crio-59838888a678fccbd612b7c1dbcf2cb812b752c1f6872e00b619ca1d34911524 WatchSource:0}: Error finding container 59838888a678fccbd612b7c1dbcf2cb812b752c1f6872e00b619ca1d34911524: Status 404 returned error can't find the container with id 59838888a678fccbd612b7c1dbcf2cb812b752c1f6872e00b619ca1d34911524 Jul 06 22:47:36.799420 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:36.799315 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" event={"ID":"a91034b3-3ca7-4bc2-abe8-39001338252d","Type":"ContainerStarted","Data":"59838888a678fccbd612b7c1dbcf2cb812b752c1f6872e00b619ca1d34911524"} Jul 06 22:47:40.813884 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:40.813838 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" event={"ID":"b1844b14-bdc2-4cbc-b164-f34e54cefc0f","Type":"ContainerStarted","Data":"42a91311a925806a1819eafb77954aeca4efe3ebfd3eb3bc0af166107d358a6f"} Jul 06 22:47:40.814404 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:40.814026 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:40.815513 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:40.815471 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" event={"ID":"a91034b3-3ca7-4bc2-abe8-39001338252d","Type":"ContainerStarted","Data":"e37375a236c3b98af552b4a9a84e2916e5812a186109b8fa03638f864609e71b"} Jul 06 22:47:40.816075 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:40.816058 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" Jul 06 22:47:40.829512 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:40.829439 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75788db8f6-96c4c" podStartSLOduration=1.6661478029999999 podStartE2EDuration="5.829422509s" totalImagesPullingTime="4.163274706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:40.829246377 +0000 UTC m=+89.140414543" watchObservedRunningTime="2026-07-06 22:47:40.829422509 +0000 UTC m=+89.140590674" Jul 06 22:47:40.844112 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:40.844057 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5bdtg" podStartSLOduration=33.846550413 podStartE2EDuration="36.844038377s" totalImagesPullingTime="2.997487964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:40.843364242 +0000 UTC m=+89.154532408" watchObservedRunningTime="2026-07-06 22:47:40.844038377 +0000 UTC m=+89.155206542" Jul 06 22:47:41.041054 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:41.041002 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:41.043361 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:41.043337 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6dba2eb5-ade5-4809-a6cd-32264f60254c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsfk7\" (UID: \"6dba2eb5-ade5-4809-a6cd-32264f60254c\") " pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:41.341168 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:41.341137 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4p5jh\"" Jul 06 22:47:41.349223 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:41.349193 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zsfk7" Jul 06 22:47:41.484697 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:41.484664 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zsfk7"] Jul 06 22:47:41.488052 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:41.488020 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dba2eb5_ade5_4809_a6cd_32264f60254c.slice/crio-cbd135803bf7573bd2cd9810d37ad9740182574dd6d72626a359565561f03c6a WatchSource:0}: Error finding container cbd135803bf7573bd2cd9810d37ad9740182574dd6d72626a359565561f03c6a: Status 404 returned error can't find the container with id cbd135803bf7573bd2cd9810d37ad9740182574dd6d72626a359565561f03c6a Jul 06 22:47:41.823424 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:41.823382 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zsfk7" event={"ID":"6dba2eb5-ade5-4809-a6cd-32264f60254c","Type":"ContainerStarted","Data":"cbd135803bf7573bd2cd9810d37ad9740182574dd6d72626a359565561f03c6a"} Jul 06 22:47:45.178207 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:45.178168 2568 patch_prober.go:28] interesting pod/image-registry-59f574999c-h5cs9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 22:47:45.178677 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:45.178228 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" podUID="56a0fc27-6076-4abe-812a-5f3890a8b8e7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:47:45.839714 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:45.839677 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zsfk7" event={"ID":"6dba2eb5-ade5-4809-a6cd-32264f60254c","Type":"ContainerStarted","Data":"c424ca2491a168dfe9f90f5bce1c96d520fec7c9df05d7ce93fd519c7bd2fc8b"} Jul 06 22:47:46.846007 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:46.845959 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zsfk7" event={"ID":"6dba2eb5-ade5-4809-a6cd-32264f60254c","Type":"ContainerStarted","Data":"cadf8a72eba40f18ecbfdc7eae17df2df370065cd149280e699d803110da30f0"} Jul 06 22:47:48.855177 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:48.855138 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zsfk7" event={"ID":"6dba2eb5-ade5-4809-a6cd-32264f60254c","Type":"ContainerStarted","Data":"b96568a491d74e81ba79ddead3c1c484cf62027bbd7923bfe3a4bf7270734a95"} Jul 06 22:47:48.872361 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:48.872303 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zsfk7" podStartSLOduration=33.095966337 podStartE2EDuration="39.872286952s" totalImagesPullingTime="6.776320615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:47:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:48.871791204 +0000 UTC m=+97.182959381" watchObservedRunningTime="2026-07-06 22:47:48.872286952 +0000 UTC m=+97.183455118" Jul 06 22:47:50.417800 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:50.417758 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:47:50.420149 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:50.420125 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e-metrics-tls\") pod \"dns-default-lg9t4\" (UID: \"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e\") " pod="openshift-dns/dns-default-lg9t4" Jul 06 22:47:50.710402 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:50.710371 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jx42h\"" Jul 06 22:47:50.718764 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:50.718737 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lg9t4" Jul 06 22:47:50.845812 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:50.845775 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lg9t4"] Jul 06 22:47:50.848527 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:50.848476 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc4cbf4_87eb_4c17_9ae6_0c91b47a785e.slice/crio-fd141cffa4a70b9878fab8f5cd4392c745df23fd5c7e4bbbf5dba8d6cf7486a7 WatchSource:0}: Error finding container fd141cffa4a70b9878fab8f5cd4392c745df23fd5c7e4bbbf5dba8d6cf7486a7: Status 404 returned error can't find the container with id fd141cffa4a70b9878fab8f5cd4392c745df23fd5c7e4bbbf5dba8d6cf7486a7 Jul 06 22:47:50.863108 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:50.863071 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lg9t4" event={"ID":"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e","Type":"ContainerStarted","Data":"fd141cffa4a70b9878fab8f5cd4392c745df23fd5c7e4bbbf5dba8d6cf7486a7"} Jul 06 22:47:51.329042 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.328953 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb"] Jul 06 22:47:51.332320 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.332293 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.335064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.335028 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 22:47:51.335192 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.335114 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 22:47:51.335242 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.335046 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 22:47:51.335541 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.335515 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 22:47:51.336149 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.335926 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 22:47:51.336149 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.335980 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-d6xpk\"" Jul 06 22:47:51.344257 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.344232 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb"] Jul 06 22:47:51.354191 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.354155 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4"] Jul 06 22:47:51.359871 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.359837 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.362941 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.362486 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 22:47:51.362941 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.362517 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 22:47:51.362941 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.362565 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h8c47\"" Jul 06 22:47:51.362941 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.362663 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 22:47:51.366964 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.366936 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4"] Jul 06 22:47:51.374329 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.374277 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cw85x"] Jul 06 22:47:51.377886 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.377856 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.380955 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.380758 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 22:47:51.381641 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.381285 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 22:47:51.381641 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.381488 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 22:47:51.381641 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.381583 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v6465\"" Jul 06 22:47:51.528246 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528202 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfc6963d-b744-436b-94be-db2e04f1eab2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.528246 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528252 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7df81927-8885-4c48-ae26-77626331b130-sys\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528281 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7df81927-8885-4c48-ae26-77626331b130-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528307 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjtpm\" (UniqueName: \"kubernetes.io/projected/7df81927-8885-4c48-ae26-77626331b130-kube-api-access-sjtpm\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528350 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc6963d-b744-436b-94be-db2e04f1eab2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528376 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7df81927-8885-4c48-ae26-77626331b130-node-exporter-wtmp\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7df81927-8885-4c48-ae26-77626331b130-node-exporter-textfile\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528493 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfc6963d-b744-436b-94be-db2e04f1eab2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528552 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bjmv\" (UniqueName: \"kubernetes.io/projected/cfc6963d-b744-436b-94be-db2e04f1eab2-kube-api-access-8bjmv\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528582 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7df81927-8885-4c48-ae26-77626331b130-node-exporter-accelerators-collector-config\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528660 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528688 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14c9228a-5809-496d-9aff-c164f12768b9-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528708 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14c9228a-5809-496d-9aff-c164f12768b9-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528730 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df81927-8885-4c48-ae26-77626331b130-metrics-client-ca\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.528781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.529279 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528796 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df81927-8885-4c48-ae26-77626331b130-node-exporter-tls\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.529279 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528840 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx7nz\" (UniqueName: \"kubernetes.io/projected/14c9228a-5809-496d-9aff-c164f12768b9-kube-api-access-lx7nz\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.529279 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.528874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7df81927-8885-4c48-ae26-77626331b130-root\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.629360 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629273 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7df81927-8885-4c48-ae26-77626331b130-node-exporter-accelerators-collector-config\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.629360 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.629360 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629355 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14c9228a-5809-496d-9aff-c164f12768b9-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.629676 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629383 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14c9228a-5809-496d-9aff-c164f12768b9-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.629676 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629414 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df81927-8885-4c48-ae26-77626331b130-metrics-client-ca\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.629676 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629448 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.629676 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629472 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df81927-8885-4c48-ae26-77626331b130-node-exporter-tls\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.629676 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629516 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx7nz\" (UniqueName: \"kubernetes.io/projected/14c9228a-5809-496d-9aff-c164f12768b9-kube-api-access-lx7nz\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.629676 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:51.629521 2568 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 06 22:47:51.629676 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7df81927-8885-4c48-ae26-77626331b130-root\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.629676 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:51.629591 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-tls podName:14c9228a-5809-496d-9aff-c164f12768b9 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:52.129569056 +0000 UTC m=+100.440737216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-jksv4" (UID: "14c9228a-5809-496d-9aff-c164f12768b9") : secret "kube-state-metrics-tls" not found Jul 06 22:47:51.629676 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629606 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7df81927-8885-4c48-ae26-77626331b130-root\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.629676 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629629 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfc6963d-b744-436b-94be-db2e04f1eab2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.629676 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629659 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7df81927-8885-4c48-ae26-77626331b130-sys\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629685 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7df81927-8885-4c48-ae26-77626331b130-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjtpm\" (UniqueName: \"kubernetes.io/projected/7df81927-8885-4c48-ae26-77626331b130-kube-api-access-sjtpm\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629750 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc6963d-b744-436b-94be-db2e04f1eab2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629775 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7df81927-8885-4c48-ae26-77626331b130-node-exporter-wtmp\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629804 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629836 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7df81927-8885-4c48-ae26-77626331b130-node-exporter-textfile\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629867 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfc6963d-b744-436b-94be-db2e04f1eab2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bjmv\" (UniqueName: \"kubernetes.io/projected/cfc6963d-b744-436b-94be-db2e04f1eab2-kube-api-access-8bjmv\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.629936 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14c9228a-5809-496d-9aff-c164f12768b9-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.630011 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7df81927-8885-4c48-ae26-77626331b130-node-exporter-accelerators-collector-config\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:51.630111 2568 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:51.630178 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc6963d-b744-436b-94be-db2e04f1eab2-openshift-state-metrics-tls podName:cfc6963d-b744-436b-94be-db2e04f1eab2 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:52.130148468 +0000 UTC m=+100.441316619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cfc6963d-b744-436b-94be-db2e04f1eab2-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-sddjb" (UID: "cfc6963d-b744-436b-94be-db2e04f1eab2") : secret "openshift-state-metrics-tls" not found Jul 06 22:47:51.630224 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.630181 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14c9228a-5809-496d-9aff-c164f12768b9-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.630935 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.630332 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7df81927-8885-4c48-ae26-77626331b130-node-exporter-wtmp\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.630935 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.630383 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df81927-8885-4c48-ae26-77626331b130-metrics-client-ca\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.630935 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:51.630603 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 22:47:51.630935 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:51.630660 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7df81927-8885-4c48-ae26-77626331b130-node-exporter-tls podName:7df81927-8885-4c48-ae26-77626331b130 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:52.13064416 +0000 UTC m=+100.441812310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7df81927-8885-4c48-ae26-77626331b130-node-exporter-tls") pod "node-exporter-cw85x" (UID: "7df81927-8885-4c48-ae26-77626331b130") : secret "node-exporter-tls" not found Jul 06 22:47:51.630935 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.630868 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7df81927-8885-4c48-ae26-77626331b130-sys\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.631226 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.631197 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.631356 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.631309 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7df81927-8885-4c48-ae26-77626331b130-node-exporter-textfile\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.631356 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.631312 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfc6963d-b744-436b-94be-db2e04f1eab2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.633033 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.632987 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.633033 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.633002 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfc6963d-b744-436b-94be-db2e04f1eab2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.633306 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.633285 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7df81927-8885-4c48-ae26-77626331b130-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.643555 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.643522 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjtpm\" (UniqueName: \"kubernetes.io/projected/7df81927-8885-4c48-ae26-77626331b130-kube-api-access-sjtpm\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:51.643789 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.643641 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bjmv\" (UniqueName: \"kubernetes.io/projected/cfc6963d-b744-436b-94be-db2e04f1eab2-kube-api-access-8bjmv\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:51.643789 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.643715 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx7nz\" (UniqueName: \"kubernetes.io/projected/14c9228a-5809-496d-9aff-c164f12768b9-kube-api-access-lx7nz\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:51.823628 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.823592 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-dln4s"] Jul 06 22:47:51.828381 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.828356 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dln4s" Jul 06 22:47:51.831143 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.830974 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 22:47:51.831143 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.831020 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 22:47:51.831143 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.831125 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rm2cr\"" Jul 06 22:47:51.831367 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.831280 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j969w\" (UniqueName: \"kubernetes.io/projected/5dcb6448-6d8c-49dc-8029-5eb8db3a4c8b-kube-api-access-j969w\") pod \"downloads-685bfb5f64-dln4s\" (UID: \"5dcb6448-6d8c-49dc-8029-5eb8db3a4c8b\") " pod="openshift-console/downloads-685bfb5f64-dln4s" Jul 06 22:47:51.837193 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.837170 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dln4s"] Jul 06 22:47:51.932473 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.932376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j969w\" (UniqueName: \"kubernetes.io/projected/5dcb6448-6d8c-49dc-8029-5eb8db3a4c8b-kube-api-access-j969w\") pod \"downloads-685bfb5f64-dln4s\" (UID: \"5dcb6448-6d8c-49dc-8029-5eb8db3a4c8b\") " pod="openshift-console/downloads-685bfb5f64-dln4s" Jul 06 22:47:51.944004 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:51.943964 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j969w\" (UniqueName: \"kubernetes.io/projected/5dcb6448-6d8c-49dc-8029-5eb8db3a4c8b-kube-api-access-j969w\") pod \"downloads-685bfb5f64-dln4s\" (UID: \"5dcb6448-6d8c-49dc-8029-5eb8db3a4c8b\") " pod="openshift-console/downloads-685bfb5f64-dln4s" Jul 06 22:47:52.133773 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.133734 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc6963d-b744-436b-94be-db2e04f1eab2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:52.133965 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.133826 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:52.133965 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.133876 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df81927-8885-4c48-ae26-77626331b130-node-exporter-tls\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:52.136582 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.136546 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14c9228a-5809-496d-9aff-c164f12768b9-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jksv4\" (UID: \"14c9228a-5809-496d-9aff-c164f12768b9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:52.136727 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.136663 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df81927-8885-4c48-ae26-77626331b130-node-exporter-tls\") pod \"node-exporter-cw85x\" (UID: \"7df81927-8885-4c48-ae26-77626331b130\") " pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:52.136892 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.136864 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc6963d-b744-436b-94be-db2e04f1eab2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-sddjb\" (UID: \"cfc6963d-b744-436b-94be-db2e04f1eab2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:52.139641 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.139618 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dln4s" Jul 06 22:47:52.244870 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.244832 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" Jul 06 22:47:52.272405 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.272372 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" Jul 06 22:47:52.290514 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.290463 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cw85x" Jul 06 22:47:52.307229 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:52.307192 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df81927_8885_4c48_ae26_77626331b130.slice/crio-8ea50598f7ebdff9305245c04e723041f28db473f8471373f2e670b0570d05ea WatchSource:0}: Error finding container 8ea50598f7ebdff9305245c04e723041f28db473f8471373f2e670b0570d05ea: Status 404 returned error can't find the container with id 8ea50598f7ebdff9305245c04e723041f28db473f8471373f2e670b0570d05ea Jul 06 22:47:52.468671 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.468631 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4"] Jul 06 22:47:52.471405 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:52.471377 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c9228a_5809_496d_9aff_c164f12768b9.slice/crio-2dbe5c3913e838f0d3f87ce60b4607f801e1941fb7859c518928f77d247ff49d WatchSource:0}: Error finding container 2dbe5c3913e838f0d3f87ce60b4607f801e1941fb7859c518928f77d247ff49d: Status 404 returned error can't find the container with id 2dbe5c3913e838f0d3f87ce60b4607f801e1941fb7859c518928f77d247ff49d Jul 06 22:47:52.490683 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.490360 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:47:52.494778 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.494591 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb"] Jul 06 22:47:52.494778 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.494716 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.496909 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:52.496841 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc6963d_b744_436b_94be_db2e04f1eab2.slice/crio-ea96ec9fa263572ae613cf0847aefa34b65efb12e8755ea82f146a6e9dd9b9f7 WatchSource:0}: Error finding container ea96ec9fa263572ae613cf0847aefa34b65efb12e8755ea82f146a6e9dd9b9f7: Status 404 returned error can't find the container with id ea96ec9fa263572ae613cf0847aefa34b65efb12e8755ea82f146a6e9dd9b9f7 Jul 06 22:47:52.499698 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.499647 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 22:47:52.500030 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.499997 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 22:47:52.500485 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.500467 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 22:47:52.502316 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.502293 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 22:47:52.503441 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.503161 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 22:47:52.505459 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.505094 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 22:47:52.508487 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.505744 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 22:47:52.508487 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.505780 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 22:47:52.508487 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.506160 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 22:47:52.508487 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.508474 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dln4s"] Jul 06 22:47:52.509463 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.509167 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d7kcz\"" Jul 06 22:47:52.515522 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.513430 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:47:52.518072 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:52.518044 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcb6448_6d8c_49dc_8029_5eb8db3a4c8b.slice/crio-018f35163a111670fc5663822893d043d57af1602d7e2f3a5f1589cb044fb36d WatchSource:0}: Error finding container 018f35163a111670fc5663822893d043d57af1602d7e2f3a5f1589cb044fb36d: Status 404 returned error can't find the container with id 018f35163a111670fc5663822893d043d57af1602d7e2f3a5f1589cb044fb36d Jul 06 22:47:52.537870 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.537841 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbgsr\" (UniqueName: \"kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-kube-api-access-kbgsr\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.537870 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.537873 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.538305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.537892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.538305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.537914 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.538305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.537974 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.538305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.538017 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.538305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.538033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.538305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.538047 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.538305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.538126 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-config-out\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.538305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.538153 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.538305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.538191 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.538305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.538210 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-web-config\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.538305 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.538226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639373 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639340 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639373 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639377 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639373 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639395 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639427 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-config-out\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639447 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639486 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-web-config\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639520 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbgsr\" (UniqueName: \"kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-kube-api-access-kbgsr\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639570 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639594 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639616 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.639691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.639643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.640208 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:47:52.639772 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-trusted-ca-bundle podName:ac544955-8f59-4292-b1bc-ef966d462b43 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:53.139752665 +0000 UTC m=+101.450920829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43") : configmap references non-existent config key: ca-bundle.crt Jul 06 22:47:52.642394 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.641905 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.642394 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.642215 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.642670 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.642623 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.643457 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.643429 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.643591 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.643572 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.643985 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.643964 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-web-config\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.644185 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.644166 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.644448 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.644422 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.645331 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.645297 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-config-out\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.645667 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.645649 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.645949 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.645928 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.660729 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.660691 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbgsr\" (UniqueName: \"kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-kube-api-access-kbgsr\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:52.873510 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.873408 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dln4s" event={"ID":"5dcb6448-6d8c-49dc-8029-5eb8db3a4c8b","Type":"ContainerStarted","Data":"018f35163a111670fc5663822893d043d57af1602d7e2f3a5f1589cb044fb36d"} Jul 06 22:47:52.875726 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.875693 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" event={"ID":"cfc6963d-b744-436b-94be-db2e04f1eab2","Type":"ContainerStarted","Data":"d83c56edce5ed5ce204bb5221d4c2aeefc976ce4c20a521e12d85f984cadab1e"} Jul 06 22:47:52.875879 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.875760 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" event={"ID":"cfc6963d-b744-436b-94be-db2e04f1eab2","Type":"ContainerStarted","Data":"0588bb86aecb9e4b5d256187864b0bf2b27ac9ea1487d6031caa2a83392d5bf1"} Jul 06 22:47:52.875879 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.875792 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" event={"ID":"cfc6963d-b744-436b-94be-db2e04f1eab2","Type":"ContainerStarted","Data":"ea96ec9fa263572ae613cf0847aefa34b65efb12e8755ea82f146a6e9dd9b9f7"} Jul 06 22:47:52.877217 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.877190 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cw85x" event={"ID":"7df81927-8885-4c48-ae26-77626331b130","Type":"ContainerStarted","Data":"8ea50598f7ebdff9305245c04e723041f28db473f8471373f2e670b0570d05ea"} Jul 06 22:47:52.878591 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.878564 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" event={"ID":"14c9228a-5809-496d-9aff-c164f12768b9","Type":"ContainerStarted","Data":"2dbe5c3913e838f0d3f87ce60b4607f801e1941fb7859c518928f77d247ff49d"} Jul 06 22:47:52.880634 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.880604 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lg9t4" event={"ID":"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e","Type":"ContainerStarted","Data":"f3b5eed01cc90862fedaf223f6782fe1f3f9b50c18c2c0b601aa1bfbf8522d58"} Jul 06 22:47:52.880758 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.880661 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lg9t4" event={"ID":"dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e","Type":"ContainerStarted","Data":"ce4e46b797d2fde2cc9f2e61ab7b9c916b94cad12c3a17d47352cfe25c60525b"} Jul 06 22:47:52.880758 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.880728 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lg9t4" Jul 06 22:47:52.904779 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:52.904712 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lg9t4" podStartSLOduration=65.401140628 podStartE2EDuration="1m6.904685806s" totalImagesPullingTime="1.503545178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:52.903164395 +0000 UTC m=+101.214332563" watchObservedRunningTime="2026-07-06 22:47:52.904685806 +0000 UTC m=+101.215853976" Jul 06 22:47:53.143016 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.142912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:53.143987 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.143952 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:53.416846 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.416760 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:47:53.478283 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.478047 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77b9b8c446-2p9f4"] Jul 06 22:47:53.487142 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.486053 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.489274 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.489249 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 22:47:53.492601 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.491389 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 22:47:53.492601 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.491756 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 22:47:53.492601 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.491782 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gdgr9\"" Jul 06 22:47:53.492601 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.491933 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2g6b7u08v1oou\"" Jul 06 22:47:53.492601 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.492054 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 22:47:53.492601 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.492288 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 22:47:53.498768 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.498724 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77b9b8c446-2p9f4"] Jul 06 22:47:53.546854 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.546744 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-tls\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.546854 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.546825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-grpc-tls\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.547332 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.546895 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.547332 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.546972 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.547332 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.547015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/761119c0-e6c1-42df-af03-66d4f6d8727c-metrics-client-ca\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.547332 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.547079 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn9vx\" (UniqueName: \"kubernetes.io/projected/761119c0-e6c1-42df-af03-66d4f6d8727c-kube-api-access-sn9vx\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.547332 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.547112 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.547332 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.547148 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.632015 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.631479 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:47:53.649221 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.648376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.649221 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.648429 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/761119c0-e6c1-42df-af03-66d4f6d8727c-metrics-client-ca\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.649221 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.648485 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn9vx\" (UniqueName: \"kubernetes.io/projected/761119c0-e6c1-42df-af03-66d4f6d8727c-kube-api-access-sn9vx\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.649221 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.648552 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.649221 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.648587 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.649221 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.648613 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-tls\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.649221 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.648680 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-grpc-tls\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.649221 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.648717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.649803 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.649416 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/761119c0-e6c1-42df-af03-66d4f6d8727c-metrics-client-ca\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.652327 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.652030 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-tls\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.652327 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.652281 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.652541 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.652519 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.652821 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.652798 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-grpc-tls\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.653176 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.653130 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.654238 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.654212 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/761119c0-e6c1-42df-af03-66d4f6d8727c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.669699 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:53.669608 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac544955_8f59_4292_b1bc_ef966d462b43.slice/crio-a74006236b03913a231b6ef077e2bf2583bc8df0b85e285df93e445470e45a67 WatchSource:0}: Error finding container a74006236b03913a231b6ef077e2bf2583bc8df0b85e285df93e445470e45a67: Status 404 returned error can't find the container with id a74006236b03913a231b6ef077e2bf2583bc8df0b85e285df93e445470e45a67 Jul 06 22:47:53.671562 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.671338 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn9vx\" (UniqueName: \"kubernetes.io/projected/761119c0-e6c1-42df-af03-66d4f6d8727c-kube-api-access-sn9vx\") pod \"thanos-querier-77b9b8c446-2p9f4\" (UID: \"761119c0-e6c1-42df-af03-66d4f6d8727c\") " pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.742375 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.741710 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hv8gk" Jul 06 22:47:53.821567 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.821485 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:53.887360 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.887311 2568 generic.go:356] "Generic (PLEG): container finished" podID="7df81927-8885-4c48-ae26-77626331b130" containerID="88cbde1f391214d79c174407d31c6834733387318f7ae4675d2da1190a245306" exitCode=0 Jul 06 22:47:53.887572 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.887416 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cw85x" event={"ID":"7df81927-8885-4c48-ae26-77626331b130","Type":"ContainerDied","Data":"88cbde1f391214d79c174407d31c6834733387318f7ae4675d2da1190a245306"} Jul 06 22:47:53.889743 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:53.889707 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerStarted","Data":"a74006236b03913a231b6ef077e2bf2583bc8df0b85e285df93e445470e45a67"} Jul 06 22:47:55.132306 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.130765 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77b9b8c446-2p9f4"] Jul 06 22:47:55.137869 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:55.137834 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761119c0_e6c1_42df_af03_66d4f6d8727c.slice/crio-e9d6ed0a5cbc9f4ca1db055de58c130c7d48b68b1766f33969d7e6d2bacb4381 WatchSource:0}: Error finding container e9d6ed0a5cbc9f4ca1db055de58c130c7d48b68b1766f33969d7e6d2bacb4381: Status 404 returned error can't find the container with id e9d6ed0a5cbc9f4ca1db055de58c130c7d48b68b1766f33969d7e6d2bacb4381 Jul 06 22:47:55.178844 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.178365 2568 patch_prober.go:28] interesting pod/image-registry-59f574999c-h5cs9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 22:47:55.178844 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.178432 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" podUID="56a0fc27-6076-4abe-812a-5f3890a8b8e7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:47:55.557179 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.557141 2568 patch_prober.go:28] interesting pod/image-registry-5fddb6f768-v98x2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 22:47:55.557381 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.557209 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" podUID="f06e63ed-81de-4017-83c5-e056846a2141" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:47:55.900518 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.900408 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cw85x" event={"ID":"7df81927-8885-4c48-ae26-77626331b130","Type":"ContainerStarted","Data":"95c838172daa5445d60d3cee4532e09739fcba8c127d63bc59950507735cf2d6"} Jul 06 22:47:55.900518 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.900476 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cw85x" event={"ID":"7df81927-8885-4c48-ae26-77626331b130","Type":"ContainerStarted","Data":"78d9dd46a5ddf6f21ed89d068e457109eba226cfc88a2449251819a1725fd1b5"} Jul 06 22:47:55.903084 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.902935 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" event={"ID":"14c9228a-5809-496d-9aff-c164f12768b9","Type":"ContainerStarted","Data":"508a7406b8383e6a9a28db2c2dde16b4f40190460201b313da3fd196425a7d77"} Jul 06 22:47:55.903084 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.903011 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" event={"ID":"14c9228a-5809-496d-9aff-c164f12768b9","Type":"ContainerStarted","Data":"a4c8e60e83310770f7c4f5266b3d2b5b2f1c6a878a2ad144a8d8e52546f9c91a"} Jul 06 22:47:55.903084 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.903046 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" event={"ID":"14c9228a-5809-496d-9aff-c164f12768b9","Type":"ContainerStarted","Data":"2e67e5d3c3f49b48592e0372bac0c6c521ba800cc94a251e1d5e69f525d331f9"} Jul 06 22:47:55.904565 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.904519 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" event={"ID":"761119c0-e6c1-42df-af03-66d4f6d8727c","Type":"ContainerStarted","Data":"e9d6ed0a5cbc9f4ca1db055de58c130c7d48b68b1766f33969d7e6d2bacb4381"} Jul 06 22:47:55.906957 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.906889 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" event={"ID":"cfc6963d-b744-436b-94be-db2e04f1eab2","Type":"ContainerStarted","Data":"712fd7fe9456af6cdf1b512d7830a5eba1622aa32ae55c02443721986c2c9385"} Jul 06 22:47:55.937734 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.937676 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sddjb" podStartSLOduration=2.619609689 podStartE2EDuration="4.937658764s" totalImagesPullingTime="2.318049075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:55.936279917 +0000 UTC m=+104.247448084" watchObservedRunningTime="2026-07-06 22:47:55.937658764 +0000 UTC m=+104.248826929" Jul 06 22:47:55.937972 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.937943 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cw85x" podStartSLOduration=3.716443156 podStartE2EDuration="4.937933212s" totalImagesPullingTime="1.129436506s" totalInitContainerRuntime="92.05355ms" isStatefulPod=true podCreationTimestamp="2026-07-06 22:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:55.91921753 +0000 UTC m=+104.230385700" watchObservedRunningTime="2026-07-06 22:47:55.937933212 +0000 UTC m=+104.249101379" Jul 06 22:47:55.956836 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:55.956778 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jksv4" podStartSLOduration=2.465759201 podStartE2EDuration="4.956759315s" totalImagesPullingTime="2.491000114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:55.955095344 +0000 UTC m=+104.266263515" watchObservedRunningTime="2026-07-06 22:47:55.956759315 +0000 UTC m=+104.267927483" Jul 06 22:47:56.807048 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.806948 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fddb6f768-v98x2" Jul 06 22:47:56.914043 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.914000 2568 generic.go:356] "Generic (PLEG): container finished" podID="ac544955-8f59-4292-b1bc-ef966d462b43" containerID="65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878" exitCode=0 Jul 06 22:47:56.914253 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.914139 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerDied","Data":"65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878"} Jul 06 22:47:56.976154 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.976115 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-669664df4d-wm4kn"] Jul 06 22:47:56.990047 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.990014 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:56.992845 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.992820 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 22:47:56.995891 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.995664 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 22:47:56.995891 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.995753 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 22:47:56.995891 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.995772 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 22:47:56.996297 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.996278 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 22:47:56.996399 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.996284 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ztzpg\"" Jul 06 22:47:56.999620 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:56.999598 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669664df4d-wm4kn"] Jul 06 22:47:57.083821 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.083728 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-service-ca\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.083821 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.083806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-config\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.084106 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.083874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-oauth-serving-cert\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.084106 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.083920 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-oauth-config\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.084106 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.083948 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-serving-cert\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.084106 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.084053 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5hj4\" (UniqueName: \"kubernetes.io/projected/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-kube-api-access-h5hj4\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.185172 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.185126 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-oauth-config\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.185172 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.185175 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-serving-cert\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.185445 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.185235 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5hj4\" (UniqueName: \"kubernetes.io/projected/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-kube-api-access-h5hj4\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.185445 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.185274 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-service-ca\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.185445 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.185319 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-config\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.185445 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.185366 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-oauth-serving-cert\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.186027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.186003 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-service-ca\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.186131 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.186080 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-oauth-serving-cert\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.186131 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.186106 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-config\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.187684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.187661 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-serving-cert\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.187761 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.187661 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-oauth-config\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.193870 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.193839 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5hj4\" (UniqueName: \"kubernetes.io/projected/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-kube-api-access-h5hj4\") pod \"console-669664df4d-wm4kn\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.302363 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.302313 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:47:57.983051 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:57.982781 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669664df4d-wm4kn"] Jul 06 22:47:57.985901 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:47:57.985859 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b4e833_683c_48a5_b6e5_f392d1c0a9b3.slice/crio-ab28a6bbbd89ee64906676783b023fe2ab5ef59487f0fe40053f2a4ad7c7a824 WatchSource:0}: Error finding container ab28a6bbbd89ee64906676783b023fe2ab5ef59487f0fe40053f2a4ad7c7a824: Status 404 returned error can't find the container with id ab28a6bbbd89ee64906676783b023fe2ab5ef59487f0fe40053f2a4ad7c7a824 Jul 06 22:47:58.932260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:58.932227 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" event={"ID":"761119c0-e6c1-42df-af03-66d4f6d8727c","Type":"ContainerStarted","Data":"cf77095519ed73e342b03bf68a07492d1b980aca933a5a562d70d267f261cf19"} Jul 06 22:47:58.932658 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:58.932613 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" event={"ID":"761119c0-e6c1-42df-af03-66d4f6d8727c","Type":"ContainerStarted","Data":"4499a9ff8259938fc22693c2385311870e2039ce0a140626b135af865f9ff9c9"} Jul 06 22:47:58.933381 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:58.933352 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" event={"ID":"761119c0-e6c1-42df-af03-66d4f6d8727c","Type":"ContainerStarted","Data":"1b22cfa5eb1c4ddb16a94a9db73c91edc559d5187346bbc8379754160f7fe8cb"} Jul 06 22:47:58.935119 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:58.935064 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669664df4d-wm4kn" event={"ID":"53b4e833-683c-48a5-b6e5-f392d1c0a9b3","Type":"ContainerStarted","Data":"ab28a6bbbd89ee64906676783b023fe2ab5ef59487f0fe40053f2a4ad7c7a824"} Jul 06 22:47:59.945476 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.945280 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerStarted","Data":"4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b"} Jul 06 22:47:59.945476 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.945373 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerStarted","Data":"3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26"} Jul 06 22:47:59.945476 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.945413 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerStarted","Data":"b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64"} Jul 06 22:47:59.945476 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.945454 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerStarted","Data":"84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a"} Jul 06 22:47:59.946044 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.945491 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerStarted","Data":"a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22"} Jul 06 22:47:59.946044 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.945560 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerStarted","Data":"de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f"} Jul 06 22:47:59.950071 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.950012 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" event={"ID":"761119c0-e6c1-42df-af03-66d4f6d8727c","Type":"ContainerStarted","Data":"3223908ccc6f60980f75c5acdf5c7472936d8e0954c7af9c5374b275a1bac894"} Jul 06 22:47:59.950235 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.950096 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" event={"ID":"761119c0-e6c1-42df-af03-66d4f6d8727c","Type":"ContainerStarted","Data":"dd871165424465762adb0d3fbb34c1f7dba83e1e3c720d2e311cf21fc6c0f78c"} Jul 06 22:47:59.950235 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.950131 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" event={"ID":"761119c0-e6c1-42df-af03-66d4f6d8727c","Type":"ContainerStarted","Data":"0af368eeef895b927f2f139fcc035ace9c4dba51d68595ac91f88c6f7bc496cd"} Jul 06 22:47:59.950455 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.950426 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:47:59.974561 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.974100 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.965453563 podStartE2EDuration="7.974078432s" totalImagesPullingTime="4.990418893s" totalInitContainerRuntime="18.205976ms" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:59.972722121 +0000 UTC m=+108.283890290" watchObservedRunningTime="2026-07-06 22:47:59.974078432 +0000 UTC m=+108.285246597" Jul 06 22:47:59.998384 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:47:59.998065 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" podStartSLOduration=2.990308567 podStartE2EDuration="6.998043886s" totalImagesPullingTime="4.007735319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:59.996543028 +0000 UTC m=+108.307711197" watchObservedRunningTime="2026-07-06 22:47:59.998043886 +0000 UTC m=+108.309212052" Jul 06 22:48:00.191406 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:00.191355 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" podUID="56a0fc27-6076-4abe-812a-5f3890a8b8e7" containerName="registry" containerID="cri-o://59d5309c0c386905b8cbeb0bc8d25cfcf994a9313d041d0b4c7d2b81c9d6e51c" gracePeriod=30 Jul 06 22:48:00.957960 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:00.957918 2568 generic.go:356] "Generic (PLEG): container finished" podID="56a0fc27-6076-4abe-812a-5f3890a8b8e7" containerID="59d5309c0c386905b8cbeb0bc8d25cfcf994a9313d041d0b4c7d2b81c9d6e51c" exitCode=0 Jul 06 22:48:00.958409 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:00.958008 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" event={"ID":"56a0fc27-6076-4abe-812a-5f3890a8b8e7","Type":"ContainerDied","Data":"59d5309c0c386905b8cbeb0bc8d25cfcf994a9313d041d0b4c7d2b81c9d6e51c"} Jul 06 22:48:01.660680 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.660650 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:48:01.736454 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.736422 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-installation-pull-secrets\") pod \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " Jul 06 22:48:01.736654 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.736459 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-image-registry-private-configuration\") pod \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " Jul 06 22:48:01.736654 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.736512 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-bound-sa-token\") pod \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " Jul 06 22:48:01.736654 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.736550 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzth7\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-kube-api-access-jzth7\") pod \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " Jul 06 22:48:01.736654 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.736577 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-certificates\") pod \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " Jul 06 22:48:01.736654 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.736654 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls\") pod \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " Jul 06 22:48:01.736950 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.736703 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56a0fc27-6076-4abe-812a-5f3890a8b8e7-ca-trust-extracted\") pod \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " Jul 06 22:48:01.736950 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.736727 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-trusted-ca\") pod \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\" (UID: \"56a0fc27-6076-4abe-812a-5f3890a8b8e7\") " Jul 06 22:48:01.737097 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.737058 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "56a0fc27-6076-4abe-812a-5f3890a8b8e7" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:48:01.739261 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.739183 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "56a0fc27-6076-4abe-812a-5f3890a8b8e7" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:48:01.739612 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.739582 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "56a0fc27-6076-4abe-812a-5f3890a8b8e7" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:48:01.739712 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.739669 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "56a0fc27-6076-4abe-812a-5f3890a8b8e7" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:48:01.739902 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.739879 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "56a0fc27-6076-4abe-812a-5f3890a8b8e7" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:48:01.740143 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.740112 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-kube-api-access-jzth7" (OuterVolumeSpecName: "kube-api-access-jzth7") pod "56a0fc27-6076-4abe-812a-5f3890a8b8e7" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7"). InnerVolumeSpecName "kube-api-access-jzth7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:48:01.740255 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.740143 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "56a0fc27-6076-4abe-812a-5f3890a8b8e7" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:48:01.748003 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.747960 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a0fc27-6076-4abe-812a-5f3890a8b8e7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "56a0fc27-6076-4abe-812a-5f3890a8b8e7" (UID: "56a0fc27-6076-4abe-812a-5f3890a8b8e7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:48:01.837788 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.837751 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56a0fc27-6076-4abe-812a-5f3890a8b8e7-ca-trust-extracted\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:01.837788 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.837787 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-trusted-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:01.837788 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.837798 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-installation-pull-secrets\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:01.838094 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.837808 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56a0fc27-6076-4abe-812a-5f3890a8b8e7-image-registry-private-configuration\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:01.838094 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.837823 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-bound-sa-token\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:01.838094 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.837836 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzth7\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-kube-api-access-jzth7\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:01.838094 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.837845 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-certificates\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:01.838094 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.837853 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56a0fc27-6076-4abe-812a-5f3890a8b8e7-registry-tls\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:01.965107 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.965072 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" Jul 06 22:48:01.965606 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.965101 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f574999c-h5cs9" event={"ID":"56a0fc27-6076-4abe-812a-5f3890a8b8e7","Type":"ContainerDied","Data":"b5895aa68f3d179a3e70e30402fa2e28c23ab48551d7aac5af2914e01a18221e"} Jul 06 22:48:01.965606 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.965175 2568 scope.go:117] "RemoveContainer" containerID="59d5309c0c386905b8cbeb0bc8d25cfcf994a9313d041d0b4c7d2b81c9d6e51c" Jul 06 22:48:01.968110 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.968080 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669664df4d-wm4kn" event={"ID":"53b4e833-683c-48a5-b6e5-f392d1c0a9b3","Type":"ContainerStarted","Data":"0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b"} Jul 06 22:48:01.987548 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.987464 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-669664df4d-wm4kn" podStartSLOduration=2.304609122 podStartE2EDuration="5.987439092s" totalImagesPullingTime="3.68282997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:48:01.985371625 +0000 UTC m=+110.296539792" watchObservedRunningTime="2026-07-06 22:48:01.987439092 +0000 UTC m=+110.298607261" Jul 06 22:48:01.997937 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:01.997896 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f574999c-h5cs9"] Jul 06 22:48:02.001190 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:02.001159 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59f574999c-h5cs9"] Jul 06 22:48:02.273564 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:02.273464 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56a0fc27-6076-4abe-812a-5f3890a8b8e7" path="/var/lib/kubelet/pods/56a0fc27-6076-4abe-812a-5f3890a8b8e7/volumes" Jul 06 22:48:02.892428 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:02.892393 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lg9t4" Jul 06 22:48:03.940949 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:03.940916 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6777968dcf-gpljx"] Jul 06 22:48:03.941376 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:03.941313 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a0fc27-6076-4abe-812a-5f3890a8b8e7" containerName="registry" Jul 06 22:48:03.941376 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:03.941330 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a0fc27-6076-4abe-812a-5f3890a8b8e7" containerName="registry" Jul 06 22:48:03.941470 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:03.941421 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a0fc27-6076-4abe-812a-5f3890a8b8e7" containerName="registry" Jul 06 22:48:03.945777 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:03.945748 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:03.958283 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:03.955072 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6777968dcf-gpljx"] Jul 06 22:48:03.961259 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:03.961216 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 22:48:04.060198 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.060160 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-serving-cert\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.060198 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.060217 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-trusted-ca-bundle\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.060450 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.060247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-service-ca\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.060450 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.060283 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snqkj\" (UniqueName: \"kubernetes.io/projected/96be4d15-9619-46f2-97a6-a2edb55cfdd6-kube-api-access-snqkj\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.060450 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.060360 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-config\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.060611 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.060456 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-oauth-config\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.060611 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.060481 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-oauth-serving-cert\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.161156 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.161111 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-config\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.161347 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.161239 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-oauth-config\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.161347 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.161273 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-oauth-serving-cert\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.161347 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.161303 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-serving-cert\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.161347 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.161334 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-trusted-ca-bundle\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.161863 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.161373 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-service-ca\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.161863 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.161409 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snqkj\" (UniqueName: \"kubernetes.io/projected/96be4d15-9619-46f2-97a6-a2edb55cfdd6-kube-api-access-snqkj\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.162012 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.161990 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-config\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.162484 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.162412 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-oauth-serving-cert\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.162484 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.162434 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-service-ca\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.162484 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.162416 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-trusted-ca-bundle\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.163981 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.163962 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-oauth-config\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.164454 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.164435 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-serving-cert\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.169460 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.169414 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snqkj\" (UniqueName: \"kubernetes.io/projected/96be4d15-9619-46f2-97a6-a2edb55cfdd6-kube-api-access-snqkj\") pod \"console-6777968dcf-gpljx\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:04.259533 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:04.259473 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:05.965892 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:05.965864 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77b9b8c446-2p9f4" Jul 06 22:48:07.303240 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:07.303192 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:48:07.303713 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:07.303266 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:48:07.308868 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:07.308842 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:48:08.001139 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:08.001110 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:48:10.690649 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:10.690587 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6777968dcf-gpljx"] Jul 06 22:48:10.693265 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:48:10.693237 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96be4d15_9619_46f2_97a6_a2edb55cfdd6.slice/crio-28d1290bf1cf7f29e7a1eb21a6bfe7fb427165001da53ac9f68346abccd1cf63 WatchSource:0}: Error finding container 28d1290bf1cf7f29e7a1eb21a6bfe7fb427165001da53ac9f68346abccd1cf63: Status 404 returned error can't find the container with id 28d1290bf1cf7f29e7a1eb21a6bfe7fb427165001da53ac9f68346abccd1cf63 Jul 06 22:48:11.013321 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:11.013279 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6777968dcf-gpljx" event={"ID":"96be4d15-9619-46f2-97a6-a2edb55cfdd6","Type":"ContainerStarted","Data":"a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda"} Jul 06 22:48:11.013457 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:11.013377 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6777968dcf-gpljx" event={"ID":"96be4d15-9619-46f2-97a6-a2edb55cfdd6","Type":"ContainerStarted","Data":"28d1290bf1cf7f29e7a1eb21a6bfe7fb427165001da53ac9f68346abccd1cf63"} Jul 06 22:48:12.021403 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:12.021360 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dln4s" event={"ID":"5dcb6448-6d8c-49dc-8029-5eb8db3a4c8b","Type":"ContainerStarted","Data":"f2e4c711c0045711b7600044fe33d03cebf988cc7c53e54432311a753b07a796"} Jul 06 22:48:12.021897 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:12.021537 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-dln4s" Jul 06 22:48:12.040604 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:12.040544 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-dln4s" podStartSLOduration=2.59346982 podStartE2EDuration="21.040524664s" totalImagesPullingTime="18.447054844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:48:12.03955936 +0000 UTC m=+120.350727527" watchObservedRunningTime="2026-07-06 22:48:12.040524664 +0000 UTC m=+120.351692831" Jul 06 22:48:12.040807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:12.040786 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-dln4s" Jul 06 22:48:12.059479 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:12.059418 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6777968dcf-gpljx" podStartSLOduration=9.059395867 podStartE2EDuration="9.059395867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:48:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:48:12.05875606 +0000 UTC m=+120.369924221" watchObservedRunningTime="2026-07-06 22:48:12.059395867 +0000 UTC m=+120.370564034" Jul 06 22:48:14.260248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:14.260203 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:14.260867 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:14.260307 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:14.266019 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:14.265991 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:15.041437 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:15.041409 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:48:15.088147 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:15.088098 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-669664df4d-wm4kn"] Jul 06 22:48:21.033904 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:21.033847 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:48:21.036119 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:21.036096 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44689168-2d9a-49c7-b7ae-6b8caa09b985-metrics-certs\") pod \"network-metrics-daemon-r55k5\" (UID: \"44689168-2d9a-49c7-b7ae-6b8caa09b985\") " pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:48:21.190812 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:21.190782 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5j2wj\"" Jul 06 22:48:21.199577 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:21.199549 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r55k5" Jul 06 22:48:21.408667 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:21.408638 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r55k5"] Jul 06 22:48:21.411148 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:48:21.411119 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44689168_2d9a_49c7_b7ae_6b8caa09b985.slice/crio-7cf4aab17a07efbc4f0a29e775f223f85648180622bfa35135fa6f0a34ce28c5 WatchSource:0}: Error finding container 7cf4aab17a07efbc4f0a29e775f223f85648180622bfa35135fa6f0a34ce28c5: Status 404 returned error can't find the container with id 7cf4aab17a07efbc4f0a29e775f223f85648180622bfa35135fa6f0a34ce28c5 Jul 06 22:48:22.066290 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:22.066258 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r55k5" event={"ID":"44689168-2d9a-49c7-b7ae-6b8caa09b985","Type":"ContainerStarted","Data":"7cf4aab17a07efbc4f0a29e775f223f85648180622bfa35135fa6f0a34ce28c5"} Jul 06 22:48:23.072428 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:23.072394 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r55k5" event={"ID":"44689168-2d9a-49c7-b7ae-6b8caa09b985","Type":"ContainerStarted","Data":"97f33a71afa0f8e9418c4001f3976fa9b77050300cb385b34a14ad36902d82bd"} Jul 06 22:48:23.072850 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:23.072451 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r55k5" event={"ID":"44689168-2d9a-49c7-b7ae-6b8caa09b985","Type":"ContainerStarted","Data":"7cc4184e1d014ea026f7bedbd5f6cc1f048ce9386e25e74adb75a05e299fe344"} Jul 06 22:48:23.087544 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:23.087475 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r55k5" podStartSLOduration=129.754507246 podStartE2EDuration="2m11.087457435s" totalImagesPullingTime="1.332950189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:48:23.08600721 +0000 UTC m=+131.397175379" watchObservedRunningTime="2026-07-06 22:48:23.087457435 +0000 UTC m=+131.398625601" Jul 06 22:48:40.115156 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.115108 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-669664df4d-wm4kn" podUID="53b4e833-683c-48a5-b6e5-f392d1c0a9b3" containerName="console" containerID="cri-o://0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b" gracePeriod=15 Jul 06 22:48:40.131350 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:48:40.131307 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b4e833_683c_48a5_b6e5_f392d1c0a9b3.slice/crio-0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b.scope\": RecentStats: unable to find data in memory cache]" Jul 06 22:48:40.131537 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:48:40.131354 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b4e833_683c_48a5_b6e5_f392d1c0a9b3.slice/crio-0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b.scope\": RecentStats: unable to find data in memory cache]" Jul 06 22:48:40.418115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.418079 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:48:40.499711 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.499673 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-service-ca\") pod \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " Jul 06 22:48:40.499711 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.499717 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-oauth-config\") pod \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " Jul 06 22:48:40.499930 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.499750 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-serving-cert\") pod \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " Jul 06 22:48:40.499930 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.499805 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-oauth-serving-cert\") pod \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " Jul 06 22:48:40.499930 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.499827 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5hj4\" (UniqueName: \"kubernetes.io/projected/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-kube-api-access-h5hj4\") pod \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " Jul 06 22:48:40.499930 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.499859 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-config\") pod \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\" (UID: \"53b4e833-683c-48a5-b6e5-f392d1c0a9b3\") " Jul 06 22:48:40.500186 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.500154 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-service-ca" (OuterVolumeSpecName: "service-ca") pod "53b4e833-683c-48a5-b6e5-f392d1c0a9b3" (UID: "53b4e833-683c-48a5-b6e5-f392d1c0a9b3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:48:40.500260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.500221 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53b4e833-683c-48a5-b6e5-f392d1c0a9b3" (UID: "53b4e833-683c-48a5-b6e5-f392d1c0a9b3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:48:40.500311 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.500262 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-config" (OuterVolumeSpecName: "console-config") pod "53b4e833-683c-48a5-b6e5-f392d1c0a9b3" (UID: "53b4e833-683c-48a5-b6e5-f392d1c0a9b3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:48:40.502166 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.502133 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53b4e833-683c-48a5-b6e5-f392d1c0a9b3" (UID: "53b4e833-683c-48a5-b6e5-f392d1c0a9b3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:48:40.502166 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.502152 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-kube-api-access-h5hj4" (OuterVolumeSpecName: "kube-api-access-h5hj4") pod "53b4e833-683c-48a5-b6e5-f392d1c0a9b3" (UID: "53b4e833-683c-48a5-b6e5-f392d1c0a9b3"). InnerVolumeSpecName "kube-api-access-h5hj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:48:40.502166 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.502150 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53b4e833-683c-48a5-b6e5-f392d1c0a9b3" (UID: "53b4e833-683c-48a5-b6e5-f392d1c0a9b3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:48:40.600738 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.600702 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:40.600738 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.600730 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-oauth-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:40.600738 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.600741 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5hj4\" (UniqueName: \"kubernetes.io/projected/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-kube-api-access-h5hj4\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:40.600738 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.600752 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:40.601080 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.600761 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-service-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:40.601080 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:40.600768 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b4e833-683c-48a5-b6e5-f392d1c0a9b3-console-oauth-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:48:41.157412 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:41.157374 2568 generic.go:356] "Generic (PLEG): container finished" podID="53b4e833-683c-48a5-b6e5-f392d1c0a9b3" containerID="0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b" exitCode=0 Jul 06 22:48:41.157813 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:41.157423 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669664df4d-wm4kn" Jul 06 22:48:41.157813 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:41.157457 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669664df4d-wm4kn" event={"ID":"53b4e833-683c-48a5-b6e5-f392d1c0a9b3","Type":"ContainerDied","Data":"0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b"} Jul 06 22:48:41.157813 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:41.157530 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669664df4d-wm4kn" event={"ID":"53b4e833-683c-48a5-b6e5-f392d1c0a9b3","Type":"ContainerDied","Data":"ab28a6bbbd89ee64906676783b023fe2ab5ef59487f0fe40053f2a4ad7c7a824"} Jul 06 22:48:41.157813 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:41.157559 2568 scope.go:117] "RemoveContainer" containerID="0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b" Jul 06 22:48:41.166797 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:41.166779 2568 scope.go:117] "RemoveContainer" containerID="0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b" Jul 06 22:48:41.167148 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:48:41.167123 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b\": container with ID starting with 0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b not found: ID does not exist" containerID="0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b" Jul 06 22:48:41.167195 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:41.167157 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b"} err="failed to get container status \"0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b\": rpc error: code = NotFound desc = could not find container \"0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b\": container with ID starting with 0f9617c3ee036ca6b199e51f3e60e4591bf4fed841f990e85c5bcf80ff5bbc3b not found: ID does not exist" Jul 06 22:48:41.178461 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:41.178425 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-669664df4d-wm4kn"] Jul 06 22:48:41.181836 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:41.181806 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-669664df4d-wm4kn"] Jul 06 22:48:42.272990 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:48:42.272962 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53b4e833-683c-48a5-b6e5-f392d1c0a9b3" path="/var/lib/kubelet/pods/53b4e833-683c-48a5-b6e5-f392d1c0a9b3/volumes" Jul 06 22:49:11.620851 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:11.620770 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:49:11.621360 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:11.621040 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="alertmanager" containerID="cri-o://de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f" gracePeriod=120 Jul 06 22:49:11.621360 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:11.621130 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy-metric" containerID="cri-o://3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26" gracePeriod=120 Jul 06 22:49:11.621360 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:11.621157 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy" containerID="cri-o://b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64" gracePeriod=120 Jul 06 22:49:11.621360 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:11.621203 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="prom-label-proxy" containerID="cri-o://4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b" gracePeriod=120 Jul 06 22:49:11.621360 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:11.621136 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy-web" containerID="cri-o://84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a" gracePeriod=120 Jul 06 22:49:11.621360 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:11.621184 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="config-reloader" containerID="cri-o://a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22" gracePeriod=120 Jul 06 22:49:12.283687 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.283658 2568 generic.go:356] "Generic (PLEG): container finished" podID="ac544955-8f59-4292-b1bc-ef966d462b43" containerID="4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b" exitCode=0 Jul 06 22:49:12.283687 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.283682 2568 generic.go:356] "Generic (PLEG): container finished" podID="ac544955-8f59-4292-b1bc-ef966d462b43" containerID="b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64" exitCode=0 Jul 06 22:49:12.283687 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.283689 2568 generic.go:356] "Generic (PLEG): container finished" podID="ac544955-8f59-4292-b1bc-ef966d462b43" containerID="a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22" exitCode=0 Jul 06 22:49:12.283687 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.283694 2568 generic.go:356] "Generic (PLEG): container finished" podID="ac544955-8f59-4292-b1bc-ef966d462b43" containerID="de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f" exitCode=0 Jul 06 22:49:12.283949 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.283736 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerDied","Data":"4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b"} Jul 06 22:49:12.283949 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.283805 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerDied","Data":"b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64"} Jul 06 22:49:12.283949 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.283831 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerDied","Data":"a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22"} Jul 06 22:49:12.283949 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.283856 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerDied","Data":"de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f"} Jul 06 22:49:12.869301 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.869275 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:12.879622 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879599 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-config-out\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879739 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879638 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-trusted-ca-bundle\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879739 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879657 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-main-tls\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879739 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879686 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-web\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879739 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879704 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879739 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879736 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-metrics-client-ca\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879993 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879762 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-web-config\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879993 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879788 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-tls-assets\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879993 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879812 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbgsr\" (UniqueName: \"kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-kube-api-access-kbgsr\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879993 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879840 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-cluster-tls-config\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879993 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879893 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879993 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879932 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-main-db\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.879993 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.879967 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-config-volume\") pod \"ac544955-8f59-4292-b1bc-ef966d462b43\" (UID: \"ac544955-8f59-4292-b1bc-ef966d462b43\") " Jul 06 22:49:12.880349 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.880112 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:12.880349 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.880221 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.880860 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.880621 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:12.881104 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.881017 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:49:12.883251 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.883151 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-config-out" (OuterVolumeSpecName: "config-out") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:49:12.883251 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.883223 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:12.883432 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.883272 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-config-volume" (OuterVolumeSpecName: "config-volume") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:12.884089 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.884061 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-kube-api-access-kbgsr" (OuterVolumeSpecName: "kube-api-access-kbgsr") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "kube-api-access-kbgsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:49:12.884454 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.884411 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:12.884565 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.884514 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:49:12.884754 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.884725 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:12.888320 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.888297 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:12.888400 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.888322 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:12.895223 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.895198 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-web-config" (OuterVolumeSpecName: "web-config") pod "ac544955-8f59-4292-b1bc-ef966d462b43" (UID: "ac544955-8f59-4292-b1bc-ef966d462b43"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:12.980677 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980640 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-main-tls\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.980677 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980675 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.980875 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980686 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.980875 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980696 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac544955-8f59-4292-b1bc-ef966d462b43-metrics-client-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.980875 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980704 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-web-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.980875 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980712 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-tls-assets\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.980875 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980722 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbgsr\" (UniqueName: \"kubernetes.io/projected/ac544955-8f59-4292-b1bc-ef966d462b43-kube-api-access-kbgsr\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.980875 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980732 2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-cluster-tls-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.980875 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980741 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.980875 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980751 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-alertmanager-main-db\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.980875 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980758 2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac544955-8f59-4292-b1bc-ef966d462b43-config-volume\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:12.980875 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:12.980766 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac544955-8f59-4292-b1bc-ef966d462b43-config-out\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:13.290173 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.290082 2568 generic.go:356] "Generic (PLEG): container finished" podID="ac544955-8f59-4292-b1bc-ef966d462b43" containerID="3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26" exitCode=0 Jul 06 22:49:13.290173 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.290114 2568 generic.go:356] "Generic (PLEG): container finished" podID="ac544955-8f59-4292-b1bc-ef966d462b43" containerID="84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a" exitCode=0 Jul 06 22:49:13.290173 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.290157 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerDied","Data":"3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26"} Jul 06 22:49:13.290374 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.290175 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.290374 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.290225 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerDied","Data":"84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a"} Jul 06 22:49:13.290374 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.290255 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac544955-8f59-4292-b1bc-ef966d462b43","Type":"ContainerDied","Data":"a74006236b03913a231b6ef077e2bf2583bc8df0b85e285df93e445470e45a67"} Jul 06 22:49:13.290374 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.290284 2568 scope.go:117] "RemoveContainer" containerID="4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b" Jul 06 22:49:13.298905 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.298881 2568 scope.go:117] "RemoveContainer" containerID="3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26" Jul 06 22:49:13.310869 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.310845 2568 scope.go:117] "RemoveContainer" containerID="b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64" Jul 06 22:49:13.315016 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.314993 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:49:13.317892 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.317866 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:49:13.319061 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.319041 2568 scope.go:117] "RemoveContainer" containerID="84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a" Jul 06 22:49:13.326266 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.326245 2568 scope.go:117] "RemoveContainer" containerID="a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22" Jul 06 22:49:13.333322 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.333303 2568 scope.go:117] "RemoveContainer" containerID="de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f" Jul 06 22:49:13.340640 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340607 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:49:13.340921 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340909 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="config-reloader" Jul 06 22:49:13.340921 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340923 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="config-reloader" Jul 06 22:49:13.340921 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340935 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="prom-label-proxy" Jul 06 22:49:13.340921 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340940 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="prom-label-proxy" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340948 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy-metric" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340954 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy-metric" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340960 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="init-config-reloader" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340967 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="init-config-reloader" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340974 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b4e833-683c-48a5-b6e5-f392d1c0a9b3" containerName="console" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340979 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b4e833-683c-48a5-b6e5-f392d1c0a9b3" containerName="console" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340993 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="alertmanager" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.340998 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="alertmanager" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341005 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy-web" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341010 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy-web" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341015 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341020 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341059 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy-metric" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341070 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341077 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b4e833-683c-48a5-b6e5-f392d1c0a9b3" containerName="console" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341083 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="config-reloader" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341088 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="kube-rbac-proxy-web" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341093 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="alertmanager" Jul 06 22:49:13.341115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341098 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" containerName="prom-label-proxy" Jul 06 22:49:13.341804 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.341150 2568 scope.go:117] "RemoveContainer" containerID="65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878" Jul 06 22:49:13.344677 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.344657 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.347089 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.347066 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 22:49:13.347196 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.347154 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 22:49:13.347259 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.347199 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d7kcz\"" Jul 06 22:49:13.347465 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.347448 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 22:49:13.347588 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.347444 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 22:49:13.347588 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.347574 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 22:49:13.347722 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.347705 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 22:49:13.347894 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.347876 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 22:49:13.347990 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.347882 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 22:49:13.349376 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.349359 2568 scope.go:117] "RemoveContainer" containerID="4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b" Jul 06 22:49:13.349688 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:49:13.349670 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b\": container with ID starting with 4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b not found: ID does not exist" containerID="4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b" Jul 06 22:49:13.349763 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.349695 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b"} err="failed to get container status \"4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b\": rpc error: code = NotFound desc = could not find container \"4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b\": container with ID starting with 4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b not found: ID does not exist" Jul 06 22:49:13.349763 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.349712 2568 scope.go:117] "RemoveContainer" containerID="3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26" Jul 06 22:49:13.350047 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:49:13.350030 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26\": container with ID starting with 3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26 not found: ID does not exist" containerID="3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26" Jul 06 22:49:13.350104 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.350052 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26"} err="failed to get container status \"3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26\": rpc error: code = NotFound desc = could not find container \"3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26\": container with ID starting with 3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26 not found: ID does not exist" Jul 06 22:49:13.350104 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.350067 2568 scope.go:117] "RemoveContainer" containerID="b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64" Jul 06 22:49:13.350319 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:49:13.350300 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64\": container with ID starting with b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64 not found: ID does not exist" containerID="b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64" Jul 06 22:49:13.350375 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.350325 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64"} err="failed to get container status \"b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64\": rpc error: code = NotFound desc = could not find container \"b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64\": container with ID starting with b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64 not found: ID does not exist" Jul 06 22:49:13.350375 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.350339 2568 scope.go:117] "RemoveContainer" containerID="84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a" Jul 06 22:49:13.350917 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:49:13.350898 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a\": container with ID starting with 84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a not found: ID does not exist" containerID="84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a" Jul 06 22:49:13.350994 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.350920 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a"} err="failed to get container status \"84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a\": rpc error: code = NotFound desc = could not find container \"84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a\": container with ID starting with 84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a not found: ID does not exist" Jul 06 22:49:13.350994 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.350935 2568 scope.go:117] "RemoveContainer" containerID="a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22" Jul 06 22:49:13.351268 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:49:13.351237 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22\": container with ID starting with a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22 not found: ID does not exist" containerID="a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22" Jul 06 22:49:13.351367 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.351268 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22"} err="failed to get container status \"a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22\": rpc error: code = NotFound desc = could not find container \"a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22\": container with ID starting with a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22 not found: ID does not exist" Jul 06 22:49:13.351367 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.351290 2568 scope.go:117] "RemoveContainer" containerID="de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f" Jul 06 22:49:13.351560 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:49:13.351536 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f\": container with ID starting with de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f not found: ID does not exist" containerID="de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f" Jul 06 22:49:13.351610 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.351568 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f"} err="failed to get container status \"de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f\": rpc error: code = NotFound desc = could not find container \"de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f\": container with ID starting with de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f not found: ID does not exist" Jul 06 22:49:13.351610 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.351600 2568 scope.go:117] "RemoveContainer" containerID="65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878" Jul 06 22:49:13.351863 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:49:13.351844 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878\": container with ID starting with 65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878 not found: ID does not exist" containerID="65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878" Jul 06 22:49:13.351955 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.351870 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878"} err="failed to get container status \"65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878\": rpc error: code = NotFound desc = could not find container \"65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878\": container with ID starting with 65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878 not found: ID does not exist" Jul 06 22:49:13.351955 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.351893 2568 scope.go:117] "RemoveContainer" containerID="4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b" Jul 06 22:49:13.352178 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.352149 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b"} err="failed to get container status \"4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b\": rpc error: code = NotFound desc = could not find container \"4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b\": container with ID starting with 4c5a2527f48a3023816fbc06390efe71e7876098735741b87ce470be6a18142b not found: ID does not exist" Jul 06 22:49:13.352274 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.352180 2568 scope.go:117] "RemoveContainer" containerID="3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26" Jul 06 22:49:13.352684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.352452 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26"} err="failed to get container status \"3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26\": rpc error: code = NotFound desc = could not find container \"3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26\": container with ID starting with 3033fbfdbd6db98a82c7eeba81967af5c91e80bb8cd47263a609a0e4194c7b26 not found: ID does not exist" Jul 06 22:49:13.352684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.352520 2568 scope.go:117] "RemoveContainer" containerID="b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64" Jul 06 22:49:13.352926 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.352906 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 22:49:13.353068 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.353012 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64"} err="failed to get container status \"b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64\": rpc error: code = NotFound desc = could not find container \"b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64\": container with ID starting with b02177411c9dd35f6bbe1b378be0d55661722c1cb4452db3b4e170d5ecc74e64 not found: ID does not exist" Jul 06 22:49:13.353068 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.353036 2568 scope.go:117] "RemoveContainer" containerID="84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a" Jul 06 22:49:13.353319 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.353268 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a"} err="failed to get container status \"84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a\": rpc error: code = NotFound desc = could not find container \"84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a\": container with ID starting with 84f6caef08ad5f883a2a398a9523ac913030ec6596a581bb9605174d2d167a1a not found: ID does not exist" Jul 06 22:49:13.353319 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.353292 2568 scope.go:117] "RemoveContainer" containerID="a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22" Jul 06 22:49:13.353591 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.353571 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22"} err="failed to get container status \"a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22\": rpc error: code = NotFound desc = could not find container \"a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22\": container with ID starting with a653ba470b7f6dc162efd8a36e9cebce680536e3fcf346488ecf97b66cd1ff22 not found: ID does not exist" Jul 06 22:49:13.353591 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.353590 2568 scope.go:117] "RemoveContainer" containerID="de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f" Jul 06 22:49:13.353853 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.353832 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f"} err="failed to get container status \"de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f\": rpc error: code = NotFound desc = could not find container \"de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f\": container with ID starting with de2fe07fad6b90d3fe020a5be9f94c1a8d40a597347f3c8ba38f26337f88711f not found: ID does not exist" Jul 06 22:49:13.353853 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.353851 2568 scope.go:117] "RemoveContainer" containerID="65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878" Jul 06 22:49:13.354093 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.354072 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878"} err="failed to get container status \"65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878\": rpc error: code = NotFound desc = could not find container \"65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878\": container with ID starting with 65b86bb0db021e3683b2b27799d5c1d511f1b64ed18a6ef46fe483f758d67878 not found: ID does not exist" Jul 06 22:49:13.363548 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.363519 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:49:13.383066 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383031 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3fd9e5e-93e8-4809-9b84-23b462a49189-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383066 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3fd9e5e-93e8-4809-9b84-23b462a49189-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383263 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383094 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383263 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383117 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-web-config\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383263 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383148 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383263 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383181 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383263 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383211 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383263 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383235 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcvfs\" (UniqueName: \"kubernetes.io/projected/c3fd9e5e-93e8-4809-9b84-23b462a49189-kube-api-access-xcvfs\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383263 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3fd9e5e-93e8-4809-9b84-23b462a49189-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383474 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383283 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3fd9e5e-93e8-4809-9b84-23b462a49189-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383474 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383315 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383474 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383334 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.383474 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.383363 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3fd9e5e-93e8-4809-9b84-23b462a49189-config-out\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.483965 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.483930 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3fd9e5e-93e8-4809-9b84-23b462a49189-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484096 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.483974 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484096 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484085 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484176 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484137 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3fd9e5e-93e8-4809-9b84-23b462a49189-config-out\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484176 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3fd9e5e-93e8-4809-9b84-23b462a49189-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484263 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484206 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3fd9e5e-93e8-4809-9b84-23b462a49189-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484263 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484238 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484369 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484261 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-web-config\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484369 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484286 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484369 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484334 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484369 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484349 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3fd9e5e-93e8-4809-9b84-23b462a49189-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484604 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484380 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484604 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcvfs\" (UniqueName: \"kubernetes.io/projected/c3fd9e5e-93e8-4809-9b84-23b462a49189-kube-api-access-xcvfs\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.484604 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.484472 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3fd9e5e-93e8-4809-9b84-23b462a49189-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.485657 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.485160 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3fd9e5e-93e8-4809-9b84-23b462a49189-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.485657 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.485299 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3fd9e5e-93e8-4809-9b84-23b462a49189-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.486959 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.486913 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3fd9e5e-93e8-4809-9b84-23b462a49189-config-out\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.487146 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.487127 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.487258 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.487237 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.487313 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.487277 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.487414 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.487393 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3fd9e5e-93e8-4809-9b84-23b462a49189-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.487585 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.487570 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-web-config\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.488132 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.488110 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.488202 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.488139 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.488771 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.488755 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3fd9e5e-93e8-4809-9b84-23b462a49189-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.492982 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.492964 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcvfs\" (UniqueName: \"kubernetes.io/projected/c3fd9e5e-93e8-4809-9b84-23b462a49189-kube-api-access-xcvfs\") pod \"alertmanager-main-0\" (UID: \"c3fd9e5e-93e8-4809-9b84-23b462a49189\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.655990 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.655900 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:49:13.796597 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:13.796569 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:49:13.798811 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:49:13.798783 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3fd9e5e_93e8_4809_9b84_23b462a49189.slice/crio-2b3c8edf36fe5c2e8c05fee886377ff98611c23d2bb9c88ddc2157ead272e2ea WatchSource:0}: Error finding container 2b3c8edf36fe5c2e8c05fee886377ff98611c23d2bb9c88ddc2157ead272e2ea: Status 404 returned error can't find the container with id 2b3c8edf36fe5c2e8c05fee886377ff98611c23d2bb9c88ddc2157ead272e2ea Jul 06 22:49:14.272418 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:14.272384 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac544955-8f59-4292-b1bc-ef966d462b43" path="/var/lib/kubelet/pods/ac544955-8f59-4292-b1bc-ef966d462b43/volumes" Jul 06 22:49:14.295683 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:14.295650 2568 generic.go:356] "Generic (PLEG): container finished" podID="c3fd9e5e-93e8-4809-9b84-23b462a49189" containerID="7c93318465da815e5cd61dcccd832e83923e3aaaa33ed43f96e9c082d2eda071" exitCode=0 Jul 06 22:49:14.295683 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:14.295688 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3fd9e5e-93e8-4809-9b84-23b462a49189","Type":"ContainerDied","Data":"7c93318465da815e5cd61dcccd832e83923e3aaaa33ed43f96e9c082d2eda071"} Jul 06 22:49:14.295907 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:14.295740 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3fd9e5e-93e8-4809-9b84-23b462a49189","Type":"ContainerStarted","Data":"2b3c8edf36fe5c2e8c05fee886377ff98611c23d2bb9c88ddc2157ead272e2ea"} Jul 06 22:49:15.307115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.307078 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3fd9e5e-93e8-4809-9b84-23b462a49189","Type":"ContainerStarted","Data":"472fcc51ee36baf0ba9bf8cd51e7d3bd5dfa5aeb9c06f41b9d94f57abe7ea089"} Jul 06 22:49:15.307511 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.307172 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3fd9e5e-93e8-4809-9b84-23b462a49189","Type":"ContainerStarted","Data":"9ac074e41843a00e6d42ea1307c74f7a79ef8ecd00fddc5eae187768b3d06e79"} Jul 06 22:49:15.307511 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.307200 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3fd9e5e-93e8-4809-9b84-23b462a49189","Type":"ContainerStarted","Data":"896c82960148b764922bcefbe3396d79bc3d8eadbc4c0422a91b0a7a61b38ad0"} Jul 06 22:49:15.307511 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.307237 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3fd9e5e-93e8-4809-9b84-23b462a49189","Type":"ContainerStarted","Data":"db1825a648025a2c498b8467d4a4647b525309027cd65007f1181fb5920d40d3"} Jul 06 22:49:15.307511 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.307264 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3fd9e5e-93e8-4809-9b84-23b462a49189","Type":"ContainerStarted","Data":"47bd4a919c4e67bc9e615a112a0ffd360ebe5bee720067c9377875041de63fb5"} Jul 06 22:49:15.307511 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.307287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3fd9e5e-93e8-4809-9b84-23b462a49189","Type":"ContainerStarted","Data":"60d8225b0d6527319d602af360a867d276fcdd5d22e7f7ca8c0ad4d803871b18"} Jul 06 22:49:15.332659 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.332588 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.316816869 podStartE2EDuration="2.332565827s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.748958ms" isStatefulPod=false podCreationTimestamp="2026-07-06 22:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:49:15.330513246 +0000 UTC m=+183.641681406" watchObservedRunningTime="2026-07-06 22:49:15.332565827 +0000 UTC m=+183.643733993" Jul 06 22:49:15.642197 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.642113 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h"] Jul 06 22:49:15.644562 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.644546 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.646842 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.646814 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 22:49:15.647012 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.646907 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9vpq4\"" Jul 06 22:49:15.647214 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.647199 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 22:49:15.647269 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.647257 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 22:49:15.647380 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.647357 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 22:49:15.647576 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.647562 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 22:49:15.651845 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.651825 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 22:49:15.657926 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.657896 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h"] Jul 06 22:49:15.700933 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.700895 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-secret-telemeter-client\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.700933 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.700951 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.701215 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.700976 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-telemeter-client-tls\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.701215 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.701090 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-serving-certs-ca-bundle\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.701215 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.701114 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.701215 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.701142 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh2kl\" (UniqueName: \"kubernetes.io/projected/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-kube-api-access-zh2kl\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.701215 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.701202 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-federate-client-tls\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.701397 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.701264 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-metrics-client-ca\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.802534 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.802455 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-telemeter-client-tls\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.802732 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.802555 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-serving-certs-ca-bundle\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.802732 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.802696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.802851 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.802731 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh2kl\" (UniqueName: \"kubernetes.io/projected/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-kube-api-access-zh2kl\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.802851 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.802766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-federate-client-tls\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.802851 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.802819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-metrics-client-ca\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.802988 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.802865 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-secret-telemeter-client\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.802988 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.802902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.803363 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.803335 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-serving-certs-ca-bundle\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.803555 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.803526 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-metrics-client-ca\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.803804 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.803783 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.805323 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.805290 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-secret-telemeter-client\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.805469 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.805445 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-federate-client-tls\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.805557 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.805491 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.805662 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.805643 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-telemeter-client-tls\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.810269 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.810244 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh2kl\" (UniqueName: \"kubernetes.io/projected/b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e-kube-api-access-zh2kl\") pod \"telemeter-client-5c5c75f44c-zgr2h\" (UID: \"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e\") " pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:15.955669 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:15.955619 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" Jul 06 22:49:16.094043 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:16.094013 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h"] Jul 06 22:49:16.096714 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:49:16.096686 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b063b2_0cc8_4a9f_9e4e_f83ec208a72e.slice/crio-a8333c68479874c17aedd45c4ccd9e112e59b844e2384b436211a9a466224583 WatchSource:0}: Error finding container a8333c68479874c17aedd45c4ccd9e112e59b844e2384b436211a9a466224583: Status 404 returned error can't find the container with id a8333c68479874c17aedd45c4ccd9e112e59b844e2384b436211a9a466224583 Jul 06 22:49:16.312134 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:16.312046 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" event={"ID":"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e","Type":"ContainerStarted","Data":"a8333c68479874c17aedd45c4ccd9e112e59b844e2384b436211a9a466224583"} Jul 06 22:49:18.322986 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:18.322949 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" event={"ID":"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e","Type":"ContainerStarted","Data":"ceaf7bb29269e6aefc292764dffa1e2009ba730ce1faea4c0cab73c7a3c7bb30"} Jul 06 22:49:18.323424 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:18.323015 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" event={"ID":"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e","Type":"ContainerStarted","Data":"ba90e259260545b8ab3f7907f1a31a59dbd8bb14ae6d6a700a98a29597e2999b"} Jul 06 22:49:18.323424 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:18.323038 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" event={"ID":"b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e","Type":"ContainerStarted","Data":"495392fa9fb09d508b461efad35a954e71f130a3e580a76023f91fced5bbce50"} Jul 06 22:49:18.345684 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:18.345630 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c5c75f44c-zgr2h" podStartSLOduration=1.343560084 podStartE2EDuration="3.345609299s" totalImagesPullingTime="2.002049215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:49:18.342920856 +0000 UTC m=+186.654089022" watchObservedRunningTime="2026-07-06 22:49:18.345609299 +0000 UTC m=+186.656777464" Jul 06 22:49:19.347781 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.347746 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59d9d9786b-8prpg"] Jul 06 22:49:19.350347 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.350324 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.363891 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.363833 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d9d9786b-8prpg"] Jul 06 22:49:19.436399 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.436365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-oauth-config\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.436637 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.436604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-oauth-serving-cert\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.436709 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.436657 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-trusted-ca-bundle\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.436774 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.436754 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-config\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.436816 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.436787 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdvr6\" (UniqueName: \"kubernetes.io/projected/cd89dd35-2725-48c5-a15b-9e54ccd289da-kube-api-access-pdvr6\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.436875 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.436830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-service-ca\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.436972 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.436950 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-serving-cert\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.537767 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.537718 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-oauth-serving-cert\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.537767 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.537767 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-trusted-ca-bundle\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.538021 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.537808 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-config\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.538021 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.537830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdvr6\" (UniqueName: \"kubernetes.io/projected/cd89dd35-2725-48c5-a15b-9e54ccd289da-kube-api-access-pdvr6\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.538021 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.537854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-service-ca\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.538021 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.537904 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-serving-cert\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.538021 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.537938 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-oauth-config\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.538660 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.538631 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-config\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.538786 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.538675 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-service-ca\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.538786 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.538673 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-oauth-serving-cert\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.538930 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.538903 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-trusted-ca-bundle\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.540379 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.540349 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-oauth-config\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.540563 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.540543 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-serving-cert\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.545437 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.545416 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdvr6\" (UniqueName: \"kubernetes.io/projected/cd89dd35-2725-48c5-a15b-9e54ccd289da-kube-api-access-pdvr6\") pod \"console-59d9d9786b-8prpg\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.659847 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.659746 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:19.798717 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:19.798685 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d9d9786b-8prpg"] Jul 06 22:49:19.801880 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:49:19.801852 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd89dd35_2725_48c5_a15b_9e54ccd289da.slice/crio-6405b3598a023ecb1faffa0d08278f8878f57906a5994c474cb7fc78bb4f3124 WatchSource:0}: Error finding container 6405b3598a023ecb1faffa0d08278f8878f57906a5994c474cb7fc78bb4f3124: Status 404 returned error can't find the container with id 6405b3598a023ecb1faffa0d08278f8878f57906a5994c474cb7fc78bb4f3124 Jul 06 22:49:20.333065 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:20.333026 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d9d9786b-8prpg" event={"ID":"cd89dd35-2725-48c5-a15b-9e54ccd289da","Type":"ContainerStarted","Data":"ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7"} Jul 06 22:49:20.333250 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:20.333086 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d9d9786b-8prpg" event={"ID":"cd89dd35-2725-48c5-a15b-9e54ccd289da","Type":"ContainerStarted","Data":"6405b3598a023ecb1faffa0d08278f8878f57906a5994c474cb7fc78bb4f3124"} Jul 06 22:49:20.349042 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:20.348990 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59d9d9786b-8prpg" podStartSLOduration=1.348974194 podStartE2EDuration="1.348974194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:49:20.347886775 +0000 UTC m=+188.659054941" watchObservedRunningTime="2026-07-06 22:49:20.348974194 +0000 UTC m=+188.660142439" Jul 06 22:49:29.660570 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:29.660531 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:29.661033 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:29.660605 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:29.665463 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:29.665435 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:30.379445 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:30.379414 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:49:30.427161 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:30.427122 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6777968dcf-gpljx"] Jul 06 22:49:55.447855 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.447806 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6777968dcf-gpljx" podUID="96be4d15-9619-46f2-97a6-a2edb55cfdd6" containerName="console" containerID="cri-o://a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda" gracePeriod=15 Jul 06 22:49:55.702287 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.702218 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:49:55.763066 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.763030 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-config\") pod \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " Jul 06 22:49:55.763245 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.763077 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-serving-cert\") pod \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " Jul 06 22:49:55.763245 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.763098 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-service-ca\") pod \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " Jul 06 22:49:55.763245 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.763123 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-trusted-ca-bundle\") pod \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " Jul 06 22:49:55.763245 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.763150 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snqkj\" (UniqueName: \"kubernetes.io/projected/96be4d15-9619-46f2-97a6-a2edb55cfdd6-kube-api-access-snqkj\") pod \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " Jul 06 22:49:55.763245 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.763173 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-oauth-config\") pod \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " Jul 06 22:49:55.763245 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.763188 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-oauth-serving-cert\") pod \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\" (UID: \"96be4d15-9619-46f2-97a6-a2edb55cfdd6\") " Jul 06 22:49:55.763851 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.763626 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-service-ca" (OuterVolumeSpecName: "service-ca") pod "96be4d15-9619-46f2-97a6-a2edb55cfdd6" (UID: "96be4d15-9619-46f2-97a6-a2edb55cfdd6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:55.763851 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.763643 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-config" (OuterVolumeSpecName: "console-config") pod "96be4d15-9619-46f2-97a6-a2edb55cfdd6" (UID: "96be4d15-9619-46f2-97a6-a2edb55cfdd6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:55.763851 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.763748 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "96be4d15-9619-46f2-97a6-a2edb55cfdd6" (UID: "96be4d15-9619-46f2-97a6-a2edb55cfdd6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:55.763851 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.763810 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "96be4d15-9619-46f2-97a6-a2edb55cfdd6" (UID: "96be4d15-9619-46f2-97a6-a2edb55cfdd6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:55.765371 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.765349 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "96be4d15-9619-46f2-97a6-a2edb55cfdd6" (UID: "96be4d15-9619-46f2-97a6-a2edb55cfdd6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:55.765455 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.765374 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "96be4d15-9619-46f2-97a6-a2edb55cfdd6" (UID: "96be4d15-9619-46f2-97a6-a2edb55cfdd6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:55.765546 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.765447 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96be4d15-9619-46f2-97a6-a2edb55cfdd6-kube-api-access-snqkj" (OuterVolumeSpecName: "kube-api-access-snqkj") pod "96be4d15-9619-46f2-97a6-a2edb55cfdd6" (UID: "96be4d15-9619-46f2-97a6-a2edb55cfdd6"). InnerVolumeSpecName "kube-api-access-snqkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:49:55.864323 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.864283 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:55.864323 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.864316 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-service-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:55.864323 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.864325 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-trusted-ca-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:55.864323 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.864335 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snqkj\" (UniqueName: \"kubernetes.io/projected/96be4d15-9619-46f2-97a6-a2edb55cfdd6-kube-api-access-snqkj\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:55.864596 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.864343 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-oauth-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:55.864596 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.864352 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-oauth-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:55.864596 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:55.864360 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96be4d15-9619-46f2-97a6-a2edb55cfdd6-console-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:49:56.480249 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:56.480216 2568 generic.go:356] "Generic (PLEG): container finished" podID="96be4d15-9619-46f2-97a6-a2edb55cfdd6" containerID="a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda" exitCode=0 Jul 06 22:49:56.480748 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:56.480262 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6777968dcf-gpljx" Jul 06 22:49:56.480748 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:56.480307 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6777968dcf-gpljx" event={"ID":"96be4d15-9619-46f2-97a6-a2edb55cfdd6","Type":"ContainerDied","Data":"a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda"} Jul 06 22:49:56.480748 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:56.480367 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6777968dcf-gpljx" event={"ID":"96be4d15-9619-46f2-97a6-a2edb55cfdd6","Type":"ContainerDied","Data":"28d1290bf1cf7f29e7a1eb21a6bfe7fb427165001da53ac9f68346abccd1cf63"} Jul 06 22:49:56.480748 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:56.480399 2568 scope.go:117] "RemoveContainer" containerID="a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda" Jul 06 22:49:56.488705 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:56.488666 2568 scope.go:117] "RemoveContainer" containerID="a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda" Jul 06 22:49:56.488953 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:49:56.488932 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda\": container with ID starting with a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda not found: ID does not exist" containerID="a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda" Jul 06 22:49:56.489018 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:56.488965 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda"} err="failed to get container status \"a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda\": rpc error: code = NotFound desc = could not find container \"a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda\": container with ID starting with a7f299289595c02842ad843dad2c95f69ab9834cddc7dd89deac8f32732d0cda not found: ID does not exist" Jul 06 22:49:56.495337 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:56.495313 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6777968dcf-gpljx"] Jul 06 22:49:56.496905 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:56.496881 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6777968dcf-gpljx"] Jul 06 22:49:58.273775 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:49:58.273743 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96be4d15-9619-46f2-97a6-a2edb55cfdd6" path="/var/lib/kubelet/pods/96be4d15-9619-46f2-97a6-a2edb55cfdd6/volumes" Jul 06 22:50:27.455140 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.455104 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-848d77f5df-hfvw2"] Jul 06 22:50:27.455644 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.455422 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96be4d15-9619-46f2-97a6-a2edb55cfdd6" containerName="console" Jul 06 22:50:27.455644 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.455433 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="96be4d15-9619-46f2-97a6-a2edb55cfdd6" containerName="console" Jul 06 22:50:27.455644 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.455518 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="96be4d15-9619-46f2-97a6-a2edb55cfdd6" containerName="console" Jul 06 22:50:27.459915 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.459890 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.468931 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.468903 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848d77f5df-hfvw2"] Jul 06 22:50:27.542417 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.542375 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-service-ca\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.542417 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.542422 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-console-config\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.542665 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.542451 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw5hr\" (UniqueName: \"kubernetes.io/projected/a9f28620-0a16-47bf-b90f-b65d5961503d-kube-api-access-tw5hr\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.542665 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.542554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-trusted-ca-bundle\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.542665 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.542596 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-oauth-config\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.542665 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.542621 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-serving-cert\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.542805 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.542674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-oauth-serving-cert\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.643208 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.643164 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-service-ca\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.643208 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.643211 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-console-config\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.643416 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.643250 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw5hr\" (UniqueName: \"kubernetes.io/projected/a9f28620-0a16-47bf-b90f-b65d5961503d-kube-api-access-tw5hr\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.643416 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.643290 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-trusted-ca-bundle\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.643416 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.643313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-oauth-config\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.643416 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.643345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-serving-cert\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.643416 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.643403 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-oauth-serving-cert\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.644129 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.644102 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-service-ca\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.644129 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.644124 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-oauth-serving-cert\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.644313 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.644144 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-console-config\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.644313 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.644246 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-trusted-ca-bundle\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.645807 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.645775 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-oauth-config\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.645922 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.645882 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-serving-cert\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.651362 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.651336 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw5hr\" (UniqueName: \"kubernetes.io/projected/a9f28620-0a16-47bf-b90f-b65d5961503d-kube-api-access-tw5hr\") pod \"console-848d77f5df-hfvw2\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.770844 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.770745 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:27.906459 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:27.906428 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848d77f5df-hfvw2"] Jul 06 22:50:27.909123 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:50:27.909089 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f28620_0a16_47bf_b90f_b65d5961503d.slice/crio-ec8976b9e0cc6d9cd579c13ca817fd84e96e22a40673d7d4e8134499ab1f8bbc WatchSource:0}: Error finding container ec8976b9e0cc6d9cd579c13ca817fd84e96e22a40673d7d4e8134499ab1f8bbc: Status 404 returned error can't find the container with id ec8976b9e0cc6d9cd579c13ca817fd84e96e22a40673d7d4e8134499ab1f8bbc Jul 06 22:50:28.614986 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:28.614951 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848d77f5df-hfvw2" event={"ID":"a9f28620-0a16-47bf-b90f-b65d5961503d","Type":"ContainerStarted","Data":"bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1"} Jul 06 22:50:28.615476 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:28.615005 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848d77f5df-hfvw2" event={"ID":"a9f28620-0a16-47bf-b90f-b65d5961503d","Type":"ContainerStarted","Data":"ec8976b9e0cc6d9cd579c13ca817fd84e96e22a40673d7d4e8134499ab1f8bbc"} Jul 06 22:50:28.632175 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:28.632111 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-848d77f5df-hfvw2" podStartSLOduration=1.632090587 podStartE2EDuration="1.632090587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:50:28.630310603 +0000 UTC m=+256.941478769" watchObservedRunningTime="2026-07-06 22:50:28.632090587 +0000 UTC m=+256.943258755" Jul 06 22:50:37.771464 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:37.771356 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:37.771464 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:37.771450 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:37.776150 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:37.776130 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:38.659121 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:38.659094 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:50:38.703979 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:50:38.703934 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d9d9786b-8prpg"] Jul 06 22:51:03.725776 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:03.725713 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59d9d9786b-8prpg" podUID="cd89dd35-2725-48c5-a15b-9e54ccd289da" containerName="console" containerID="cri-o://ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7" gracePeriod=15 Jul 06 22:51:03.976680 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:03.976610 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:51:04.051198 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.051160 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-config\") pod \"cd89dd35-2725-48c5-a15b-9e54ccd289da\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " Jul 06 22:51:04.051198 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.051206 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-oauth-config\") pod \"cd89dd35-2725-48c5-a15b-9e54ccd289da\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " Jul 06 22:51:04.051456 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.051234 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdvr6\" (UniqueName: \"kubernetes.io/projected/cd89dd35-2725-48c5-a15b-9e54ccd289da-kube-api-access-pdvr6\") pod \"cd89dd35-2725-48c5-a15b-9e54ccd289da\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " Jul 06 22:51:04.051456 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.051284 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-oauth-serving-cert\") pod \"cd89dd35-2725-48c5-a15b-9e54ccd289da\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " Jul 06 22:51:04.051456 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.051304 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-service-ca\") pod \"cd89dd35-2725-48c5-a15b-9e54ccd289da\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " Jul 06 22:51:04.051456 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.051325 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-trusted-ca-bundle\") pod \"cd89dd35-2725-48c5-a15b-9e54ccd289da\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " Jul 06 22:51:04.051456 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.051380 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-serving-cert\") pod \"cd89dd35-2725-48c5-a15b-9e54ccd289da\" (UID: \"cd89dd35-2725-48c5-a15b-9e54ccd289da\") " Jul 06 22:51:04.051761 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.051731 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-config" (OuterVolumeSpecName: "console-config") pod "cd89dd35-2725-48c5-a15b-9e54ccd289da" (UID: "cd89dd35-2725-48c5-a15b-9e54ccd289da"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:51:04.051848 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.051814 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd89dd35-2725-48c5-a15b-9e54ccd289da" (UID: "cd89dd35-2725-48c5-a15b-9e54ccd289da"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:51:04.051898 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.051783 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd89dd35-2725-48c5-a15b-9e54ccd289da" (UID: "cd89dd35-2725-48c5-a15b-9e54ccd289da"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:51:04.052014 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.051986 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd89dd35-2725-48c5-a15b-9e54ccd289da" (UID: "cd89dd35-2725-48c5-a15b-9e54ccd289da"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:51:04.053606 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.053582 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd89dd35-2725-48c5-a15b-9e54ccd289da" (UID: "cd89dd35-2725-48c5-a15b-9e54ccd289da"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:51:04.053929 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.053902 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd89dd35-2725-48c5-a15b-9e54ccd289da" (UID: "cd89dd35-2725-48c5-a15b-9e54ccd289da"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:51:04.053975 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.053914 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd89dd35-2725-48c5-a15b-9e54ccd289da-kube-api-access-pdvr6" (OuterVolumeSpecName: "kube-api-access-pdvr6") pod "cd89dd35-2725-48c5-a15b-9e54ccd289da" (UID: "cd89dd35-2725-48c5-a15b-9e54ccd289da"). InnerVolumeSpecName "kube-api-access-pdvr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:51:04.152215 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.152176 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:51:04.152215 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.152207 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:51:04.152215 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.152219 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd89dd35-2725-48c5-a15b-9e54ccd289da-console-oauth-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:51:04.152453 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.152230 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdvr6\" (UniqueName: \"kubernetes.io/projected/cd89dd35-2725-48c5-a15b-9e54ccd289da-kube-api-access-pdvr6\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:51:04.152453 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.152239 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-oauth-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:51:04.152453 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.152247 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-service-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:51:04.152453 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.152255 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd89dd35-2725-48c5-a15b-9e54ccd289da-trusted-ca-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:51:04.761913 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.761880 2568 generic.go:356] "Generic (PLEG): container finished" podID="cd89dd35-2725-48c5-a15b-9e54ccd289da" containerID="ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7" exitCode=0 Jul 06 22:51:04.762349 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.761939 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d9d9786b-8prpg" Jul 06 22:51:04.762349 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.761974 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d9d9786b-8prpg" event={"ID":"cd89dd35-2725-48c5-a15b-9e54ccd289da","Type":"ContainerDied","Data":"ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7"} Jul 06 22:51:04.762349 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.762041 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d9d9786b-8prpg" event={"ID":"cd89dd35-2725-48c5-a15b-9e54ccd289da","Type":"ContainerDied","Data":"6405b3598a023ecb1faffa0d08278f8878f57906a5994c474cb7fc78bb4f3124"} Jul 06 22:51:04.762349 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.762072 2568 scope.go:117] "RemoveContainer" containerID="ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7" Jul 06 22:51:04.770217 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.770201 2568 scope.go:117] "RemoveContainer" containerID="ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7" Jul 06 22:51:04.770479 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:51:04.770463 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7\": container with ID starting with ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7 not found: ID does not exist" containerID="ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7" Jul 06 22:51:04.770555 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.770487 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7"} err="failed to get container status \"ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7\": rpc error: code = NotFound desc = could not find container \"ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7\": container with ID starting with ab89181aac53c096c888d0cac604952ec71082a80ead2f90ac3b63f8263820f7 not found: ID does not exist" Jul 06 22:51:04.777370 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.777342 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d9d9786b-8prpg"] Jul 06 22:51:04.780646 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:04.780620 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59d9d9786b-8prpg"] Jul 06 22:51:06.272765 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:06.272720 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd89dd35-2725-48c5-a15b-9e54ccd289da" path="/var/lib/kubelet/pods/cd89dd35-2725-48c5-a15b-9e54ccd289da/volumes" Jul 06 22:51:12.130091 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:12.130057 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 22:51:12.134265 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:12.134236 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 22:51:12.138324 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:12.138301 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 22:51:31.669290 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.669250 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw"] Jul 06 22:51:31.671790 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.669612 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd89dd35-2725-48c5-a15b-9e54ccd289da" containerName="console" Jul 06 22:51:31.671790 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.669623 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd89dd35-2725-48c5-a15b-9e54ccd289da" containerName="console" Jul 06 22:51:31.671790 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.669680 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd89dd35-2725-48c5-a15b-9e54ccd289da" containerName="console" Jul 06 22:51:31.672726 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.672708 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:31.675235 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.675212 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:51:31.675341 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.675257 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v2rjt\"" Jul 06 22:51:31.676040 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.676025 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:51:31.682199 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.682166 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw"] Jul 06 22:51:31.694957 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.694921 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:31.694957 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.694963 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:31.695231 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.695132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6whh2\" (UniqueName: \"kubernetes.io/projected/1c92f0f8-b388-4be3-b367-97c72bf99e4a-kube-api-access-6whh2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:31.796176 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.796132 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6whh2\" (UniqueName: \"kubernetes.io/projected/1c92f0f8-b388-4be3-b367-97c72bf99e4a-kube-api-access-6whh2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:31.796385 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.796188 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:31.796385 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.796213 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:31.796607 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.796591 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:31.796668 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.796622 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:31.805083 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.805054 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6whh2\" (UniqueName: \"kubernetes.io/projected/1c92f0f8-b388-4be3-b367-97c72bf99e4a-kube-api-access-6whh2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:31.983686 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:31.983646 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:32.122518 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:32.122472 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw"] Jul 06 22:51:32.127273 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:51:32.127240 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c92f0f8_b388_4be3_b367_97c72bf99e4a.slice/crio-6bf16c5b98669d46faddfe469bf9f19e182e8244377cbcb560030c5d3991656e WatchSource:0}: Error finding container 6bf16c5b98669d46faddfe469bf9f19e182e8244377cbcb560030c5d3991656e: Status 404 returned error can't find the container with id 6bf16c5b98669d46faddfe469bf9f19e182e8244377cbcb560030c5d3991656e Jul 06 22:51:32.129369 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:32.129347 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:51:32.873894 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:32.873852 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" event={"ID":"1c92f0f8-b388-4be3-b367-97c72bf99e4a","Type":"ContainerStarted","Data":"6bf16c5b98669d46faddfe469bf9f19e182e8244377cbcb560030c5d3991656e"} Jul 06 22:51:38.900967 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:38.900924 2568 generic.go:356] "Generic (PLEG): container finished" podID="1c92f0f8-b388-4be3-b367-97c72bf99e4a" containerID="d59ea61e32ba5dfdd46bf708735952f28f7c9bd75fdd1709b4e0734d26946471" exitCode=0 Jul 06 22:51:38.901414 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:38.900980 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" event={"ID":"1c92f0f8-b388-4be3-b367-97c72bf99e4a","Type":"ContainerDied","Data":"d59ea61e32ba5dfdd46bf708735952f28f7c9bd75fdd1709b4e0734d26946471"} Jul 06 22:51:41.915045 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:41.915010 2568 generic.go:356] "Generic (PLEG): container finished" podID="1c92f0f8-b388-4be3-b367-97c72bf99e4a" containerID="67534aed60db0f0eb3a1f28e1615befa155e04e8d4c6d65c16fe0466182ba48f" exitCode=0 Jul 06 22:51:41.915543 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:41.915071 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" event={"ID":"1c92f0f8-b388-4be3-b367-97c72bf99e4a","Type":"ContainerDied","Data":"67534aed60db0f0eb3a1f28e1615befa155e04e8d4c6d65c16fe0466182ba48f"} Jul 06 22:51:48.951064 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:48.951028 2568 generic.go:356] "Generic (PLEG): container finished" podID="1c92f0f8-b388-4be3-b367-97c72bf99e4a" containerID="05e8124f341f29374946803381b55b6b1b0362c19464d5fd12c63750598e3e13" exitCode=0 Jul 06 22:51:48.951462 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:48.951123 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" event={"ID":"1c92f0f8-b388-4be3-b367-97c72bf99e4a","Type":"ContainerDied","Data":"05e8124f341f29374946803381b55b6b1b0362c19464d5fd12c63750598e3e13"} Jul 06 22:51:50.082644 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.082618 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:50.153994 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.153963 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-bundle\") pod \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " Jul 06 22:51:50.154187 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.154053 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6whh2\" (UniqueName: \"kubernetes.io/projected/1c92f0f8-b388-4be3-b367-97c72bf99e4a-kube-api-access-6whh2\") pod \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " Jul 06 22:51:50.154187 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.154076 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-util\") pod \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\" (UID: \"1c92f0f8-b388-4be3-b367-97c72bf99e4a\") " Jul 06 22:51:50.154687 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.154659 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-bundle" (OuterVolumeSpecName: "bundle") pod "1c92f0f8-b388-4be3-b367-97c72bf99e4a" (UID: "1c92f0f8-b388-4be3-b367-97c72bf99e4a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:50.156288 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.156264 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c92f0f8-b388-4be3-b367-97c72bf99e4a-kube-api-access-6whh2" (OuterVolumeSpecName: "kube-api-access-6whh2") pod "1c92f0f8-b388-4be3-b367-97c72bf99e4a" (UID: "1c92f0f8-b388-4be3-b367-97c72bf99e4a"). InnerVolumeSpecName "kube-api-access-6whh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:51:50.160377 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.160347 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-util" (OuterVolumeSpecName: "util") pod "1c92f0f8-b388-4be3-b367-97c72bf99e4a" (UID: "1c92f0f8-b388-4be3-b367-97c72bf99e4a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:50.255327 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.255239 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6whh2\" (UniqueName: \"kubernetes.io/projected/1c92f0f8-b388-4be3-b367-97c72bf99e4a-kube-api-access-6whh2\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:51:50.255327 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.255270 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-util\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:51:50.255327 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.255283 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c92f0f8-b388-4be3-b367-97c72bf99e4a-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:51:50.961441 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.961403 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" event={"ID":"1c92f0f8-b388-4be3-b367-97c72bf99e4a","Type":"ContainerDied","Data":"6bf16c5b98669d46faddfe469bf9f19e182e8244377cbcb560030c5d3991656e"} Jul 06 22:51:50.961666 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.961456 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bf16c5b98669d46faddfe469bf9f19e182e8244377cbcb560030c5d3991656e" Jul 06 22:51:50.961666 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:50.961456 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754087lqw" Jul 06 22:51:54.783950 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.783909 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp"] Jul 06 22:51:54.784391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.784237 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c92f0f8-b388-4be3-b367-97c72bf99e4a" containerName="extract" Jul 06 22:51:54.784391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.784249 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c92f0f8-b388-4be3-b367-97c72bf99e4a" containerName="extract" Jul 06 22:51:54.784391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.784260 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c92f0f8-b388-4be3-b367-97c72bf99e4a" containerName="pull" Jul 06 22:51:54.784391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.784265 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c92f0f8-b388-4be3-b367-97c72bf99e4a" containerName="pull" Jul 06 22:51:54.784391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.784278 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c92f0f8-b388-4be3-b367-97c72bf99e4a" containerName="util" Jul 06 22:51:54.784391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.784283 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c92f0f8-b388-4be3-b367-97c72bf99e4a" containerName="util" Jul 06 22:51:54.784391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.784329 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c92f0f8-b388-4be3-b367-97c72bf99e4a" containerName="extract" Jul 06 22:51:54.788351 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.788332 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp" Jul 06 22:51:54.790955 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.790928 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:51:54.791310 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.791294 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4czkq\"" Jul 06 22:51:54.791595 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.791581 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 22:51:54.801483 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.801458 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp"] Jul 06 22:51:54.894973 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.894927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a3184ab-f7e4-4825-9c71-5bfd68c90192-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-r7hmp\" (UID: \"2a3184ab-f7e4-4825-9c71-5bfd68c90192\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp" Jul 06 22:51:54.895158 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.894988 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrd8n\" (UniqueName: \"kubernetes.io/projected/2a3184ab-f7e4-4825-9c71-5bfd68c90192-kube-api-access-mrd8n\") pod \"cert-manager-operator-controller-manager-55c444bf86-r7hmp\" (UID: \"2a3184ab-f7e4-4825-9c71-5bfd68c90192\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp" Jul 06 22:51:54.995812 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.995767 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a3184ab-f7e4-4825-9c71-5bfd68c90192-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-r7hmp\" (UID: \"2a3184ab-f7e4-4825-9c71-5bfd68c90192\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp" Jul 06 22:51:54.996002 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.995830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrd8n\" (UniqueName: \"kubernetes.io/projected/2a3184ab-f7e4-4825-9c71-5bfd68c90192-kube-api-access-mrd8n\") pod \"cert-manager-operator-controller-manager-55c444bf86-r7hmp\" (UID: \"2a3184ab-f7e4-4825-9c71-5bfd68c90192\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp" Jul 06 22:51:54.996196 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:54.996174 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a3184ab-f7e4-4825-9c71-5bfd68c90192-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-r7hmp\" (UID: \"2a3184ab-f7e4-4825-9c71-5bfd68c90192\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp" Jul 06 22:51:55.004792 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:55.004755 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrd8n\" (UniqueName: \"kubernetes.io/projected/2a3184ab-f7e4-4825-9c71-5bfd68c90192-kube-api-access-mrd8n\") pod \"cert-manager-operator-controller-manager-55c444bf86-r7hmp\" (UID: \"2a3184ab-f7e4-4825-9c71-5bfd68c90192\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp" Jul 06 22:51:55.098575 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:55.098464 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp" Jul 06 22:51:55.260701 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:55.260666 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp"] Jul 06 22:51:55.263651 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:51:55.263615 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3184ab_f7e4_4825_9c71_5bfd68c90192.slice/crio-d530ffdae2e79a30c5f6d61cd53560a96813cce2ef5132e3cc23798164e3aac6 WatchSource:0}: Error finding container d530ffdae2e79a30c5f6d61cd53560a96813cce2ef5132e3cc23798164e3aac6: Status 404 returned error can't find the container with id d530ffdae2e79a30c5f6d61cd53560a96813cce2ef5132e3cc23798164e3aac6 Jul 06 22:51:55.984568 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:55.984531 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp" event={"ID":"2a3184ab-f7e4-4825-9c71-5bfd68c90192","Type":"ContainerStarted","Data":"d530ffdae2e79a30c5f6d61cd53560a96813cce2ef5132e3cc23798164e3aac6"} Jul 06 22:51:56.992122 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:56.992082 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp" event={"ID":"2a3184ab-f7e4-4825-9c71-5bfd68c90192","Type":"ContainerStarted","Data":"63ada857e44a1240b51d8f5da6fabd0f3ce1f9b2048a5cc62b025fe388702473"} Jul 06 22:51:57.034819 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:57.034762 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r7hmp" podStartSLOduration=1.621973989 podStartE2EDuration="3.034741526s" totalImagesPullingTime="1.412767537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:51:57.027277433 +0000 UTC m=+345.338445602" watchObservedRunningTime="2026-07-06 22:51:57.034741526 +0000 UTC m=+345.345909694" Jul 06 22:51:58.579632 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.579595 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh"] Jul 06 22:51:58.582164 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.582146 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:51:58.584947 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.584912 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:51:58.585641 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.585623 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v2rjt\"" Jul 06 22:51:58.585760 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.585656 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:51:58.594956 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.594897 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh"] Jul 06 22:51:58.633527 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.633476 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tln64\" (UniqueName: \"kubernetes.io/projected/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-kube-api-access-tln64\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:51:58.633527 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.633535 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:51:58.633741 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.633608 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:51:58.735138 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.735092 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tln64\" (UniqueName: \"kubernetes.io/projected/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-kube-api-access-tln64\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:51:58.735138 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.735139 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:51:58.735352 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.735177 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:51:58.735607 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.735587 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:51:58.735651 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.735617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:51:58.745202 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.745174 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tln64\" (UniqueName: \"kubernetes.io/projected/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-kube-api-access-tln64\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:51:58.892065 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:58.891969 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:51:59.032634 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.032602 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh"] Jul 06 22:51:59.033875 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:51:59.033850 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b795413_36af_4ed6_a2ec_8a82eb9e6eb1.slice/crio-f5deb76b52ba939b7331e2d40232c037cd393f32aae02c23e143972ca7179701 WatchSource:0}: Error finding container f5deb76b52ba939b7331e2d40232c037cd393f32aae02c23e143972ca7179701: Status 404 returned error can't find the container with id f5deb76b52ba939b7331e2d40232c037cd393f32aae02c23e143972ca7179701 Jul 06 22:51:59.604654 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.604622 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-w68dc"] Jul 06 22:51:59.606964 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.606946 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" Jul 06 22:51:59.609610 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.609579 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-v7z5r\"" Jul 06 22:51:59.609610 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.609579 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 22:51:59.610353 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.610330 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 22:51:59.616789 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.616763 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-w68dc"] Jul 06 22:51:59.743922 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.743885 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nvlp\" (UniqueName: \"kubernetes.io/projected/3f5acfbe-d82c-4488-8e6c-df27f1814747-kube-api-access-2nvlp\") pod \"cert-manager-webhook-6486ffd997-w68dc\" (UID: \"3f5acfbe-d82c-4488-8e6c-df27f1814747\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" Jul 06 22:51:59.744109 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.743952 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f5acfbe-d82c-4488-8e6c-df27f1814747-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-w68dc\" (UID: \"3f5acfbe-d82c-4488-8e6c-df27f1814747\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" Jul 06 22:51:59.845027 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.844972 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f5acfbe-d82c-4488-8e6c-df27f1814747-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-w68dc\" (UID: \"3f5acfbe-d82c-4488-8e6c-df27f1814747\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" Jul 06 22:51:59.845242 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.845103 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nvlp\" (UniqueName: \"kubernetes.io/projected/3f5acfbe-d82c-4488-8e6c-df27f1814747-kube-api-access-2nvlp\") pod \"cert-manager-webhook-6486ffd997-w68dc\" (UID: \"3f5acfbe-d82c-4488-8e6c-df27f1814747\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" Jul 06 22:51:59.853444 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.853407 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f5acfbe-d82c-4488-8e6c-df27f1814747-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-w68dc\" (UID: \"3f5acfbe-d82c-4488-8e6c-df27f1814747\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" Jul 06 22:51:59.853597 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.853489 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nvlp\" (UniqueName: \"kubernetes.io/projected/3f5acfbe-d82c-4488-8e6c-df27f1814747-kube-api-access-2nvlp\") pod \"cert-manager-webhook-6486ffd997-w68dc\" (UID: \"3f5acfbe-d82c-4488-8e6c-df27f1814747\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" Jul 06 22:51:59.929076 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:51:59.928993 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" Jul 06 22:52:00.015277 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:00.015248 2568 generic.go:356] "Generic (PLEG): container finished" podID="7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" containerID="4919f2717847b0b7e73a9fbcaf36799737050d5ed789c4864b6030ad1d9756cf" exitCode=0 Jul 06 22:52:00.015464 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:00.015311 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" event={"ID":"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1","Type":"ContainerDied","Data":"4919f2717847b0b7e73a9fbcaf36799737050d5ed789c4864b6030ad1d9756cf"} Jul 06 22:52:00.015464 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:00.015347 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" event={"ID":"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1","Type":"ContainerStarted","Data":"f5deb76b52ba939b7331e2d40232c037cd393f32aae02c23e143972ca7179701"} Jul 06 22:52:00.062292 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:00.062267 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-w68dc"] Jul 06 22:52:00.064641 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:52:00.064606 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f5acfbe_d82c_4488_8e6c_df27f1814747.slice/crio-bba3b9e70248582f43005235456f4f931e2a305f87f9fd1db2b7a79f4a176aeb WatchSource:0}: Error finding container bba3b9e70248582f43005235456f4f931e2a305f87f9fd1db2b7a79f4a176aeb: Status 404 returned error can't find the container with id bba3b9e70248582f43005235456f4f931e2a305f87f9fd1db2b7a79f4a176aeb Jul 06 22:52:01.023841 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:01.023794 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" event={"ID":"3f5acfbe-d82c-4488-8e6c-df27f1814747","Type":"ContainerStarted","Data":"bba3b9e70248582f43005235456f4f931e2a305f87f9fd1db2b7a79f4a176aeb"} Jul 06 22:52:02.031726 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:02.031677 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" event={"ID":"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1","Type":"ContainerStarted","Data":"918d11a01d9ac8d7fb4fa467336115f92412940ae49a1e0f08e3a71e97f7e870"} Jul 06 22:52:03.043489 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:03.043456 2568 generic.go:356] "Generic (PLEG): container finished" podID="7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" containerID="918d11a01d9ac8d7fb4fa467336115f92412940ae49a1e0f08e3a71e97f7e870" exitCode=0 Jul 06 22:52:03.043960 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:03.043528 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" event={"ID":"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1","Type":"ContainerDied","Data":"918d11a01d9ac8d7fb4fa467336115f92412940ae49a1e0f08e3a71e97f7e870"} Jul 06 22:52:04.049567 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:04.049532 2568 generic.go:356] "Generic (PLEG): container finished" podID="7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" containerID="fcf98644f2703e98c2715fd64c58784ce8374eb08de720c989bfb692a1b0fba4" exitCode=0 Jul 06 22:52:04.050038 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:04.049622 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" event={"ID":"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1","Type":"ContainerDied","Data":"fcf98644f2703e98c2715fd64c58784ce8374eb08de720c989bfb692a1b0fba4"} Jul 06 22:52:04.051111 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:04.051079 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" event={"ID":"3f5acfbe-d82c-4488-8e6c-df27f1814747","Type":"ContainerStarted","Data":"1cab54826fcf6a89e869240cc2e9d2206dc1b68dbbf3bb8754f63f0356ab4170"} Jul 06 22:52:04.051250 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:04.051137 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" Jul 06 22:52:04.086786 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:04.086719 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" podStartSLOduration=2.168397834 podStartE2EDuration="5.08669775s" totalImagesPullingTime="2.918299916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:52:04.086488074 +0000 UTC m=+352.397656244" watchObservedRunningTime="2026-07-06 22:52:04.08669775 +0000 UTC m=+352.397865917" Jul 06 22:52:05.185364 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:05.185336 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:52:05.295142 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:05.295102 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-util\") pod \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " Jul 06 22:52:05.295435 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:05.295208 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tln64\" (UniqueName: \"kubernetes.io/projected/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-kube-api-access-tln64\") pod \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " Jul 06 22:52:05.295435 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:05.295228 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-bundle\") pod \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\" (UID: \"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1\") " Jul 06 22:52:05.295702 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:05.295677 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-bundle" (OuterVolumeSpecName: "bundle") pod "7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" (UID: "7b795413-36af-4ed6-a2ec-8a82eb9e6eb1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:05.297365 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:05.297334 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-kube-api-access-tln64" (OuterVolumeSpecName: "kube-api-access-tln64") pod "7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" (UID: "7b795413-36af-4ed6-a2ec-8a82eb9e6eb1"). InnerVolumeSpecName "kube-api-access-tln64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:52:05.299709 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:05.299672 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-util" (OuterVolumeSpecName: "util") pod "7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" (UID: "7b795413-36af-4ed6-a2ec-8a82eb9e6eb1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:05.396426 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:05.396335 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-util\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:52:05.396426 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:05.396367 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tln64\" (UniqueName: \"kubernetes.io/projected/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-kube-api-access-tln64\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:52:05.396426 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:05.396378 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b795413-36af-4ed6-a2ec-8a82eb9e6eb1-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:52:06.062251 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.062221 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" Jul 06 22:52:06.062436 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.062221 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqlsfh" event={"ID":"7b795413-36af-4ed6-a2ec-8a82eb9e6eb1","Type":"ContainerDied","Data":"f5deb76b52ba939b7331e2d40232c037cd393f32aae02c23e143972ca7179701"} Jul 06 22:52:06.062436 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.062345 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5deb76b52ba939b7331e2d40232c037cd393f32aae02c23e143972ca7179701" Jul 06 22:52:06.628777 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.628742 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9"] Jul 06 22:52:06.629169 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.629073 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" containerName="extract" Jul 06 22:52:06.629169 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.629085 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" containerName="extract" Jul 06 22:52:06.629169 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.629094 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" containerName="util" Jul 06 22:52:06.629169 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.629125 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" containerName="util" Jul 06 22:52:06.629169 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.629140 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" containerName="pull" Jul 06 22:52:06.629169 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.629147 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" containerName="pull" Jul 06 22:52:06.629357 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.629206 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b795413-36af-4ed6-a2ec-8a82eb9e6eb1" containerName="extract" Jul 06 22:52:06.632087 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.632064 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9" Jul 06 22:52:06.634633 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.634613 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dnbfn\"" Jul 06 22:52:06.642601 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.642576 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9"] Jul 06 22:52:06.709177 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.709135 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb296f6d-a6df-4df3-928b-e7ae8e622d31-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rjbd9\" (UID: \"bb296f6d-a6df-4df3-928b-e7ae8e622d31\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9" Jul 06 22:52:06.709352 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.709193 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr26s\" (UniqueName: \"kubernetes.io/projected/bb296f6d-a6df-4df3-928b-e7ae8e622d31-kube-api-access-lr26s\") pod \"cert-manager-cainjector-559cdd8c87-rjbd9\" (UID: \"bb296f6d-a6df-4df3-928b-e7ae8e622d31\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9" Jul 06 22:52:06.809712 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.809679 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb296f6d-a6df-4df3-928b-e7ae8e622d31-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rjbd9\" (UID: \"bb296f6d-a6df-4df3-928b-e7ae8e622d31\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9" Jul 06 22:52:06.809900 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.809732 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr26s\" (UniqueName: \"kubernetes.io/projected/bb296f6d-a6df-4df3-928b-e7ae8e622d31-kube-api-access-lr26s\") pod \"cert-manager-cainjector-559cdd8c87-rjbd9\" (UID: \"bb296f6d-a6df-4df3-928b-e7ae8e622d31\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9" Jul 06 22:52:06.817578 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.817546 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb296f6d-a6df-4df3-928b-e7ae8e622d31-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rjbd9\" (UID: \"bb296f6d-a6df-4df3-928b-e7ae8e622d31\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9" Jul 06 22:52:06.817697 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.817657 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr26s\" (UniqueName: \"kubernetes.io/projected/bb296f6d-a6df-4df3-928b-e7ae8e622d31-kube-api-access-lr26s\") pod \"cert-manager-cainjector-559cdd8c87-rjbd9\" (UID: \"bb296f6d-a6df-4df3-928b-e7ae8e622d31\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9" Jul 06 22:52:06.940990 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:06.940897 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9" Jul 06 22:52:07.065623 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:07.065599 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9"] Jul 06 22:52:07.067368 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:52:07.067342 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb296f6d_a6df_4df3_928b_e7ae8e622d31.slice/crio-33cb670e9627a81dbf275c5d28e144f4ae9bb1fdedc46236874905db10a727c8 WatchSource:0}: Error finding container 33cb670e9627a81dbf275c5d28e144f4ae9bb1fdedc46236874905db10a727c8: Status 404 returned error can't find the container with id 33cb670e9627a81dbf275c5d28e144f4ae9bb1fdedc46236874905db10a727c8 Jul 06 22:52:08.073784 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:08.073746 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9" event={"ID":"bb296f6d-a6df-4df3-928b-e7ae8e622d31","Type":"ContainerStarted","Data":"2b798759f6ec9c48efd4d79e2775b84de293b7684c96ac281f883ec36e19915c"} Jul 06 22:52:08.073784 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:08.073788 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9" event={"ID":"bb296f6d-a6df-4df3-928b-e7ae8e622d31","Type":"ContainerStarted","Data":"33cb670e9627a81dbf275c5d28e144f4ae9bb1fdedc46236874905db10a727c8"} Jul 06 22:52:08.095911 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:08.095859 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rjbd9" podStartSLOduration=2.095844017 podStartE2EDuration="2.095844017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:52:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:52:08.094084964 +0000 UTC m=+356.405253130" watchObservedRunningTime="2026-07-06 22:52:08.095844017 +0000 UTC m=+356.407012183" Jul 06 22:52:10.057830 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:10.057796 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-w68dc" Jul 06 22:52:19.211438 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.211394 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v42pz"] Jul 06 22:52:19.215136 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.215110 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v42pz" Jul 06 22:52:19.218390 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.218369 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vjbzf\"" Jul 06 22:52:19.224470 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.224440 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v42pz"] Jul 06 22:52:19.319246 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.319195 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz4tr\" (UniqueName: \"kubernetes.io/projected/55e528c3-2daa-4522-b664-ae2e0b927758-kube-api-access-rz4tr\") pod \"cert-manager-55b4d954d5-v42pz\" (UID: \"55e528c3-2daa-4522-b664-ae2e0b927758\") " pod="cert-manager/cert-manager-55b4d954d5-v42pz" Jul 06 22:52:19.319429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.319308 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55e528c3-2daa-4522-b664-ae2e0b927758-bound-sa-token\") pod \"cert-manager-55b4d954d5-v42pz\" (UID: \"55e528c3-2daa-4522-b664-ae2e0b927758\") " pod="cert-manager/cert-manager-55b4d954d5-v42pz" Jul 06 22:52:19.420632 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.420588 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55e528c3-2daa-4522-b664-ae2e0b927758-bound-sa-token\") pod \"cert-manager-55b4d954d5-v42pz\" (UID: \"55e528c3-2daa-4522-b664-ae2e0b927758\") " pod="cert-manager/cert-manager-55b4d954d5-v42pz" Jul 06 22:52:19.420773 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.420758 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz4tr\" (UniqueName: \"kubernetes.io/projected/55e528c3-2daa-4522-b664-ae2e0b927758-kube-api-access-rz4tr\") pod \"cert-manager-55b4d954d5-v42pz\" (UID: \"55e528c3-2daa-4522-b664-ae2e0b927758\") " pod="cert-manager/cert-manager-55b4d954d5-v42pz" Jul 06 22:52:19.428942 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.428902 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55e528c3-2daa-4522-b664-ae2e0b927758-bound-sa-token\") pod \"cert-manager-55b4d954d5-v42pz\" (UID: \"55e528c3-2daa-4522-b664-ae2e0b927758\") " pod="cert-manager/cert-manager-55b4d954d5-v42pz" Jul 06 22:52:19.429061 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.429026 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz4tr\" (UniqueName: \"kubernetes.io/projected/55e528c3-2daa-4522-b664-ae2e0b927758-kube-api-access-rz4tr\") pod \"cert-manager-55b4d954d5-v42pz\" (UID: \"55e528c3-2daa-4522-b664-ae2e0b927758\") " pod="cert-manager/cert-manager-55b4d954d5-v42pz" Jul 06 22:52:19.525980 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.525877 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v42pz" Jul 06 22:52:19.672898 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:19.672849 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v42pz"] Jul 06 22:52:19.675172 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:52:19.675140 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55e528c3_2daa_4522_b664_ae2e0b927758.slice/crio-8e7085d51d50a2fe5e74da2d4acafcf30155eccbeb3121c166928d22e92e8721 WatchSource:0}: Error finding container 8e7085d51d50a2fe5e74da2d4acafcf30155eccbeb3121c166928d22e92e8721: Status 404 returned error can't find the container with id 8e7085d51d50a2fe5e74da2d4acafcf30155eccbeb3121c166928d22e92e8721 Jul 06 22:52:20.134898 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.134858 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v42pz" event={"ID":"55e528c3-2daa-4522-b664-ae2e0b927758","Type":"ContainerStarted","Data":"8a468322fa9b4cb0abf93da8ec7d21d6f7b1c171bbb1dffcc6d535ff049e4250"} Jul 06 22:52:20.134898 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.134906 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v42pz" event={"ID":"55e528c3-2daa-4522-b664-ae2e0b927758","Type":"ContainerStarted","Data":"8e7085d51d50a2fe5e74da2d4acafcf30155eccbeb3121c166928d22e92e8721"} Jul 06 22:52:20.151315 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.151256 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-v42pz" podStartSLOduration=1.151238578 podStartE2EDuration="1.151238578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:52:20.149490897 +0000 UTC m=+368.460659062" watchObservedRunningTime="2026-07-06 22:52:20.151238578 +0000 UTC m=+368.462406744" Jul 06 22:52:20.570804 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.570770 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6"] Jul 06 22:52:20.586399 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.586363 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6"] Jul 06 22:52:20.586595 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.586526 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:20.589118 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.589093 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:52:20.589982 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.589961 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:52:20.590081 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.590041 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v2rjt\"" Jul 06 22:52:20.735260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.735219 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7bpz\" (UniqueName: \"kubernetes.io/projected/1a11c005-0f99-4297-8ba4-9ab8872d2ada-kube-api-access-l7bpz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:20.735260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.735265 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:20.735518 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.735331 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:20.836409 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.836306 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bpz\" (UniqueName: \"kubernetes.io/projected/1a11c005-0f99-4297-8ba4-9ab8872d2ada-kube-api-access-l7bpz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:20.836409 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.836366 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:20.836650 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.836431 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:20.836810 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.836792 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:20.836847 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.836822 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:20.844893 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.844863 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7bpz\" (UniqueName: \"kubernetes.io/projected/1a11c005-0f99-4297-8ba4-9ab8872d2ada-kube-api-access-l7bpz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:20.897123 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:20.897089 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:21.046112 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:21.045951 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6"] Jul 06 22:52:21.048279 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:52:21.048248 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a11c005_0f99_4297_8ba4_9ab8872d2ada.slice/crio-3a1f7102aaad9da05dab40cb7a85d67b539fb9e0ac14f6cd412f4b6e5c4d57cb WatchSource:0}: Error finding container 3a1f7102aaad9da05dab40cb7a85d67b539fb9e0ac14f6cd412f4b6e5c4d57cb: Status 404 returned error can't find the container with id 3a1f7102aaad9da05dab40cb7a85d67b539fb9e0ac14f6cd412f4b6e5c4d57cb Jul 06 22:52:21.141963 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:21.141929 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" event={"ID":"1a11c005-0f99-4297-8ba4-9ab8872d2ada","Type":"ContainerStarted","Data":"3a1f7102aaad9da05dab40cb7a85d67b539fb9e0ac14f6cd412f4b6e5c4d57cb"} Jul 06 22:52:22.148069 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:22.148034 2568 generic.go:356] "Generic (PLEG): container finished" podID="1a11c005-0f99-4297-8ba4-9ab8872d2ada" containerID="0ddccde1001089cf43d41d3fdd619da20acc28d236720cb405e96b11a740fc1a" exitCode=0 Jul 06 22:52:22.148512 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:22.148119 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" event={"ID":"1a11c005-0f99-4297-8ba4-9ab8872d2ada","Type":"ContainerDied","Data":"0ddccde1001089cf43d41d3fdd619da20acc28d236720cb405e96b11a740fc1a"} Jul 06 22:52:23.154397 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:23.154360 2568 generic.go:356] "Generic (PLEG): container finished" podID="1a11c005-0f99-4297-8ba4-9ab8872d2ada" containerID="0eca9074449d840ce03e725ec70746915cb512e672508d24e2c238c1405d79e5" exitCode=0 Jul 06 22:52:23.154815 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:23.154444 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" event={"ID":"1a11c005-0f99-4297-8ba4-9ab8872d2ada","Type":"ContainerDied","Data":"0eca9074449d840ce03e725ec70746915cb512e672508d24e2c238c1405d79e5"} Jul 06 22:52:24.161393 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:24.161355 2568 generic.go:356] "Generic (PLEG): container finished" podID="1a11c005-0f99-4297-8ba4-9ab8872d2ada" containerID="30f9e4bb3ec38bf011f2b15e3341adaa2a4273ed37d808973e159b8a8df25387" exitCode=0 Jul 06 22:52:24.161802 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:24.161428 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" event={"ID":"1a11c005-0f99-4297-8ba4-9ab8872d2ada","Type":"ContainerDied","Data":"30f9e4bb3ec38bf011f2b15e3341adaa2a4273ed37d808973e159b8a8df25387"} Jul 06 22:52:25.313725 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:25.313694 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:25.473775 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:25.473736 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7bpz\" (UniqueName: \"kubernetes.io/projected/1a11c005-0f99-4297-8ba4-9ab8872d2ada-kube-api-access-l7bpz\") pod \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " Jul 06 22:52:25.473961 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:25.473812 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-bundle\") pod \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " Jul 06 22:52:25.473961 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:25.473864 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-util\") pod \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\" (UID: \"1a11c005-0f99-4297-8ba4-9ab8872d2ada\") " Jul 06 22:52:25.474612 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:25.474585 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-bundle" (OuterVolumeSpecName: "bundle") pod "1a11c005-0f99-4297-8ba4-9ab8872d2ada" (UID: "1a11c005-0f99-4297-8ba4-9ab8872d2ada"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:25.476149 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:25.476128 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a11c005-0f99-4297-8ba4-9ab8872d2ada-kube-api-access-l7bpz" (OuterVolumeSpecName: "kube-api-access-l7bpz") pod "1a11c005-0f99-4297-8ba4-9ab8872d2ada" (UID: "1a11c005-0f99-4297-8ba4-9ab8872d2ada"). InnerVolumeSpecName "kube-api-access-l7bpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:52:25.479291 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:25.479265 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-util" (OuterVolumeSpecName: "util") pod "1a11c005-0f99-4297-8ba4-9ab8872d2ada" (UID: "1a11c005-0f99-4297-8ba4-9ab8872d2ada"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:25.575401 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:25.575355 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7bpz\" (UniqueName: \"kubernetes.io/projected/1a11c005-0f99-4297-8ba4-9ab8872d2ada-kube-api-access-l7bpz\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:52:25.575401 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:25.575393 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:52:25.575401 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:25.575402 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a11c005-0f99-4297-8ba4-9ab8872d2ada-util\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:52:26.173135 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:26.173101 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" Jul 06 22:52:26.173404 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:26.173099 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnhsl6" event={"ID":"1a11c005-0f99-4297-8ba4-9ab8872d2ada","Type":"ContainerDied","Data":"3a1f7102aaad9da05dab40cb7a85d67b539fb9e0ac14f6cd412f4b6e5c4d57cb"} Jul 06 22:52:26.173404 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:26.173227 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a1f7102aaad9da05dab40cb7a85d67b539fb9e0ac14f6cd412f4b6e5c4d57cb" Jul 06 22:52:37.606647 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.606605 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf"] Jul 06 22:52:37.607040 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.606949 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a11c005-0f99-4297-8ba4-9ab8872d2ada" containerName="pull" Jul 06 22:52:37.607040 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.606961 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a11c005-0f99-4297-8ba4-9ab8872d2ada" containerName="pull" Jul 06 22:52:37.607040 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.606973 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a11c005-0f99-4297-8ba4-9ab8872d2ada" containerName="extract" Jul 06 22:52:37.607040 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.606978 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a11c005-0f99-4297-8ba4-9ab8872d2ada" containerName="extract" Jul 06 22:52:37.607040 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.606995 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a11c005-0f99-4297-8ba4-9ab8872d2ada" containerName="util" Jul 06 22:52:37.607040 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.607000 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a11c005-0f99-4297-8ba4-9ab8872d2ada" containerName="util" Jul 06 22:52:37.607226 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.607059 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a11c005-0f99-4297-8ba4-9ab8872d2ada" containerName="extract" Jul 06 22:52:37.610805 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.610777 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.614082 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.614056 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 22:52:37.614082 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.614072 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8grvv\"" Jul 06 22:52:37.614372 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.614357 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 22:52:37.614561 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.614538 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 22:52:37.614663 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.614567 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 22:52:37.635146 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.635113 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf"] Jul 06 22:52:37.663986 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.663931 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7550ae46-4faf-4754-82c6-4e5041e7f70d-tmp\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.664191 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.664005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7550ae46-4faf-4754-82c6-4e5041e7f70d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.664191 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.664029 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7550ae46-4faf-4754-82c6-4e5041e7f70d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.664191 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.664086 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7550ae46-4faf-4754-82c6-4e5041e7f70d-manifests\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.664191 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.664163 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4ffx\" (UniqueName: \"kubernetes.io/projected/7550ae46-4faf-4754-82c6-4e5041e7f70d-kube-api-access-f4ffx\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.764945 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.764903 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7550ae46-4faf-4754-82c6-4e5041e7f70d-tmp\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.765157 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.764969 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7550ae46-4faf-4754-82c6-4e5041e7f70d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.765157 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.764993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7550ae46-4faf-4754-82c6-4e5041e7f70d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.765157 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.765023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7550ae46-4faf-4754-82c6-4e5041e7f70d-manifests\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.765157 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.765073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4ffx\" (UniqueName: \"kubernetes.io/projected/7550ae46-4faf-4754-82c6-4e5041e7f70d-kube-api-access-f4ffx\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.765451 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.765423 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7550ae46-4faf-4754-82c6-4e5041e7f70d-manifests\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.767441 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.767418 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7550ae46-4faf-4754-82c6-4e5041e7f70d-tmp\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.767568 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.767547 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7550ae46-4faf-4754-82c6-4e5041e7f70d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.767644 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.767579 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7550ae46-4faf-4754-82c6-4e5041e7f70d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.774103 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.774062 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4ffx\" (UniqueName: \"kubernetes.io/projected/7550ae46-4faf-4754-82c6-4e5041e7f70d-kube-api-access-f4ffx\") pod \"opendatahub-operator-controller-manager-6b8c6df956-bxckf\" (UID: \"7550ae46-4faf-4754-82c6-4e5041e7f70d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:37.922107 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:37.922006 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:38.068574 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:38.068547 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf"] Jul 06 22:52:38.071307 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:52:38.071276 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7550ae46_4faf_4754_82c6_4e5041e7f70d.slice/crio-b72a3195f67e6cf17842ab01895a89d7cadc49a8bfc6441b38348883805429ad WatchSource:0}: Error finding container b72a3195f67e6cf17842ab01895a89d7cadc49a8bfc6441b38348883805429ad: Status 404 returned error can't find the container with id b72a3195f67e6cf17842ab01895a89d7cadc49a8bfc6441b38348883805429ad Jul 06 22:52:38.236083 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:38.236048 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" event={"ID":"7550ae46-4faf-4754-82c6-4e5041e7f70d","Type":"ContainerStarted","Data":"b72a3195f67e6cf17842ab01895a89d7cadc49a8bfc6441b38348883805429ad"} Jul 06 22:52:42.261260 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:42.261216 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" event={"ID":"7550ae46-4faf-4754-82c6-4e5041e7f70d","Type":"ContainerStarted","Data":"3b478dd934bf43226cf4273d996efc8e282d6c4a2e73d8e8c187371c3ed1333d"} Jul 06 22:52:43.267251 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:43.267215 2568 generic.go:356] "Generic (PLEG): container finished" podID="7550ae46-4faf-4754-82c6-4e5041e7f70d" containerID="3b478dd934bf43226cf4273d996efc8e282d6c4a2e73d8e8c187371c3ed1333d" exitCode=0 Jul 06 22:52:43.267716 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:43.267287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" event={"ID":"7550ae46-4faf-4754-82c6-4e5041e7f70d","Type":"ContainerDied","Data":"3b478dd934bf43226cf4273d996efc8e282d6c4a2e73d8e8c187371c3ed1333d"} Jul 06 22:52:44.279848 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:44.279815 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" event={"ID":"7550ae46-4faf-4754-82c6-4e5041e7f70d","Type":"ContainerStarted","Data":"c7ca9401c8991fa3ef8ed784221b9235fc70b1ebbe4a1a18ee4306bb8f36a5a3"} Jul 06 22:52:44.280242 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:44.279887 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:44.301429 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:44.301377 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" podStartSLOduration=2.465400871 podStartE2EDuration="7.301359404s" totalImagesPullingTime="3.757739683s" totalInitContainerRuntime="1.07821885s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:52:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:52:44.299363656 +0000 UTC m=+392.610531819" watchObservedRunningTime="2026-07-06 22:52:44.301359404 +0000 UTC m=+392.612527550" Jul 06 22:52:55.286631 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:55.286596 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-bxckf" Jul 06 22:52:58.023974 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.023924 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-69w4k"] Jul 06 22:52:58.032028 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.032008 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" Jul 06 22:52:58.038329 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.038287 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 06 22:52:58.038715 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.038691 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-drx7d\"" Jul 06 22:52:58.055561 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.055537 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-69w4k"] Jul 06 22:52:58.145691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.145653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm9xw\" (UniqueName: \"kubernetes.io/projected/837aaa7a-b53b-464b-bda8-3b78c20932ce-kube-api-access-dm9xw\") pod \"odh-model-controller-7998c67dc4-69w4k\" (UID: \"837aaa7a-b53b-464b-bda8-3b78c20932ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" Jul 06 22:52:58.145868 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.145703 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/837aaa7a-b53b-464b-bda8-3b78c20932ce-cert\") pod \"odh-model-controller-7998c67dc4-69w4k\" (UID: \"837aaa7a-b53b-464b-bda8-3b78c20932ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" Jul 06 22:52:58.246436 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.246399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm9xw\" (UniqueName: \"kubernetes.io/projected/837aaa7a-b53b-464b-bda8-3b78c20932ce-kube-api-access-dm9xw\") pod \"odh-model-controller-7998c67dc4-69w4k\" (UID: \"837aaa7a-b53b-464b-bda8-3b78c20932ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" Jul 06 22:52:58.246634 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.246449 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/837aaa7a-b53b-464b-bda8-3b78c20932ce-cert\") pod \"odh-model-controller-7998c67dc4-69w4k\" (UID: \"837aaa7a-b53b-464b-bda8-3b78c20932ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" Jul 06 22:52:58.246634 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:52:58.246572 2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 06 22:52:58.246634 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:52:58.246625 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837aaa7a-b53b-464b-bda8-3b78c20932ce-cert podName:837aaa7a-b53b-464b-bda8-3b78c20932ce nodeName:}" failed. No retries permitted until 2026-07-06 22:52:58.746609198 +0000 UTC m=+407.057777342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/837aaa7a-b53b-464b-bda8-3b78c20932ce-cert") pod "odh-model-controller-7998c67dc4-69w4k" (UID: "837aaa7a-b53b-464b-bda8-3b78c20932ce") : secret "odh-model-controller-webhook-cert" not found Jul 06 22:52:58.282004 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.281927 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm9xw\" (UniqueName: \"kubernetes.io/projected/837aaa7a-b53b-464b-bda8-3b78c20932ce-kube-api-access-dm9xw\") pod \"odh-model-controller-7998c67dc4-69w4k\" (UID: \"837aaa7a-b53b-464b-bda8-3b78c20932ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" Jul 06 22:52:58.750041 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.750002 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/837aaa7a-b53b-464b-bda8-3b78c20932ce-cert\") pod \"odh-model-controller-7998c67dc4-69w4k\" (UID: \"837aaa7a-b53b-464b-bda8-3b78c20932ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" Jul 06 22:52:58.752471 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.752443 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/837aaa7a-b53b-464b-bda8-3b78c20932ce-cert\") pod \"odh-model-controller-7998c67dc4-69w4k\" (UID: \"837aaa7a-b53b-464b-bda8-3b78c20932ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" Jul 06 22:52:58.942358 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:58.942316 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" Jul 06 22:52:59.103762 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:59.103719 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-69w4k"] Jul 06 22:52:59.106166 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:52:59.106139 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod837aaa7a_b53b_464b_bda8_3b78c20932ce.slice/crio-f5ec7a9be76d1ba22a268f25905b871d0faf1e2a24ac86a97c1d4c0e778fbecb WatchSource:0}: Error finding container f5ec7a9be76d1ba22a268f25905b871d0faf1e2a24ac86a97c1d4c0e778fbecb: Status 404 returned error can't find the container with id f5ec7a9be76d1ba22a268f25905b871d0faf1e2a24ac86a97c1d4c0e778fbecb Jul 06 22:52:59.353546 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:52:59.353445 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" event={"ID":"837aaa7a-b53b-464b-bda8-3b78c20932ce","Type":"ContainerStarted","Data":"f5ec7a9be76d1ba22a268f25905b871d0faf1e2a24ac86a97c1d4c0e778fbecb"} Jul 06 22:53:02.374000 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:02.373953 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" event={"ID":"837aaa7a-b53b-464b-bda8-3b78c20932ce","Type":"ContainerStarted","Data":"a9acd0f762fa56a5f6aedae692bd5d62fcab0dfb1f3495c3d6a884aa0b22f7d0"} Jul 06 22:53:02.374434 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:02.374115 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" Jul 06 22:53:02.412906 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:02.412848 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" podStartSLOduration=3.017333004 podStartE2EDuration="5.412828764s" totalImagesPullingTime="2.39549576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:53:02.412352766 +0000 UTC m=+410.723520932" watchObservedRunningTime="2026-07-06 22:53:02.412828764 +0000 UTC m=+410.723996929" Jul 06 22:53:06.040379 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.040339 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7"] Jul 06 22:53:06.044085 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.044061 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.054211 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.054188 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 22:53:06.054983 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.054965 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:53:06.055071 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.054965 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 22:53:06.055071 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.054965 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ctqwn\"" Jul 06 22:53:06.055814 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.055801 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 22:53:06.055856 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.055828 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 22:53:06.063269 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.063242 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7"] Jul 06 22:53:06.125947 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.125870 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bbe4855-c1e0-4dea-9db2-ce8d91176651-cert\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.126172 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.125989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0bbe4855-c1e0-4dea-9db2-ce8d91176651-metrics-cert\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.126172 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.126073 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0bbe4855-c1e0-4dea-9db2-ce8d91176651-manager-config\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.126172 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.126122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lrb9\" (UniqueName: \"kubernetes.io/projected/0bbe4855-c1e0-4dea-9db2-ce8d91176651-kube-api-access-8lrb9\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.227253 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.227211 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bbe4855-c1e0-4dea-9db2-ce8d91176651-cert\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.227456 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.227265 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0bbe4855-c1e0-4dea-9db2-ce8d91176651-metrics-cert\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.227456 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.227314 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0bbe4855-c1e0-4dea-9db2-ce8d91176651-manager-config\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.227456 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.227345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lrb9\" (UniqueName: \"kubernetes.io/projected/0bbe4855-c1e0-4dea-9db2-ce8d91176651-kube-api-access-8lrb9\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.228110 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.228086 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0bbe4855-c1e0-4dea-9db2-ce8d91176651-manager-config\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.229862 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.229841 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bbe4855-c1e0-4dea-9db2-ce8d91176651-cert\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.229954 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.229899 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0bbe4855-c1e0-4dea-9db2-ce8d91176651-metrics-cert\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.248171 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.248141 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lrb9\" (UniqueName: \"kubernetes.io/projected/0bbe4855-c1e0-4dea-9db2-ce8d91176651-kube-api-access-8lrb9\") pod \"lws-controller-manager-55f7b57db4-vccg7\" (UID: \"0bbe4855-c1e0-4dea-9db2-ce8d91176651\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.354263 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.354165 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:06.511211 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:06.511184 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7"] Jul 06 22:53:06.512511 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:53:06.512462 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bbe4855_c1e0_4dea_9db2_ce8d91176651.slice/crio-640bb271bba9a0a2b77b2fd17c6a45b2805804abe0b42c6646de2fba93007b6d WatchSource:0}: Error finding container 640bb271bba9a0a2b77b2fd17c6a45b2805804abe0b42c6646de2fba93007b6d: Status 404 returned error can't find the container with id 640bb271bba9a0a2b77b2fd17c6a45b2805804abe0b42c6646de2fba93007b6d Jul 06 22:53:07.412870 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:07.412832 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" event={"ID":"0bbe4855-c1e0-4dea-9db2-ce8d91176651","Type":"ContainerStarted","Data":"640bb271bba9a0a2b77b2fd17c6a45b2805804abe0b42c6646de2fba93007b6d"} Jul 06 22:53:08.419968 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:08.419920 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" event={"ID":"0bbe4855-c1e0-4dea-9db2-ce8d91176651","Type":"ContainerStarted","Data":"7df9551bfbe82cf81aaa60ed82f547b70fbff71665e2a3cb3b32e534744f0574"} Jul 06 22:53:08.420436 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:08.420075 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:53:08.468516 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:08.468438 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" podStartSLOduration=2.243266131 podStartE2EDuration="3.468421137s" totalImagesPullingTime="1.225155006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:53:08.465963807 +0000 UTC m=+416.777131974" watchObservedRunningTime="2026-07-06 22:53:08.468421137 +0000 UTC m=+416.779589303" Jul 06 22:53:09.243379 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.243340 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz"] Jul 06 22:53:09.246864 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.246846 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.249477 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.249446 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8m8wg\"" Jul 06 22:53:09.249680 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.249656 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 22:53:09.249734 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.249680 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 22:53:09.249944 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.249929 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 22:53:09.250133 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.250120 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 22:53:09.250218 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.250203 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 22:53:09.250218 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.250212 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 22:53:09.261316 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.261288 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz"] Jul 06 22:53:09.353896 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.353851 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrpn7\" (UniqueName: \"kubernetes.io/projected/4fbcebf7-bb95-42b5-97e9-177dc0519be4-kube-api-access-qrpn7\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.353896 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.353903 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.354175 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.354029 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fbcebf7-bb95-42b5-97e9-177dc0519be4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.354297 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.354193 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.354398 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.354363 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.354464 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.354412 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4fbcebf7-bb95-42b5-97e9-177dc0519be4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.354550 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.354453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.456076 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.456033 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.456450 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.456095 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.456450 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.456278 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4fbcebf7-bb95-42b5-97e9-177dc0519be4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.456450 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.456306 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.456450 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.456374 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrpn7\" (UniqueName: \"kubernetes.io/projected/4fbcebf7-bb95-42b5-97e9-177dc0519be4-kube-api-access-qrpn7\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.456450 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.456403 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.456450 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.456451 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fbcebf7-bb95-42b5-97e9-177dc0519be4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.457191 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.457157 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.458650 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.458624 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.458748 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.458661 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fbcebf7-bb95-42b5-97e9-177dc0519be4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.458748 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.458670 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.458821 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.458744 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4fbcebf7-bb95-42b5-97e9-177dc0519be4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.482412 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.482376 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrpn7\" (UniqueName: \"kubernetes.io/projected/4fbcebf7-bb95-42b5-97e9-177dc0519be4-kube-api-access-qrpn7\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.487523 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.487473 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fbcebf7-bb95-42b5-97e9-177dc0519be4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cjchz\" (UID: \"4fbcebf7-bb95-42b5-97e9-177dc0519be4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.557187 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.557094 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:09.720214 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:09.720184 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz"] Jul 06 22:53:09.721823 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:53:09.721792 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbcebf7_bb95_42b5_97e9_177dc0519be4.slice/crio-460a169e7de2d34d431e6931b36c8cd0423c8ed02cbe3d67d1632346ac2d0803 WatchSource:0}: Error finding container 460a169e7de2d34d431e6931b36c8cd0423c8ed02cbe3d67d1632346ac2d0803: Status 404 returned error can't find the container with id 460a169e7de2d34d431e6931b36c8cd0423c8ed02cbe3d67d1632346ac2d0803 Jul 06 22:53:10.434697 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:10.434646 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" event={"ID":"4fbcebf7-bb95-42b5-97e9-177dc0519be4","Type":"ContainerStarted","Data":"460a169e7de2d34d431e6931b36c8cd0423c8ed02cbe3d67d1632346ac2d0803"} Jul 06 22:53:12.516693 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:12.516638 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:53:12.517080 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:12.516722 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:53:13.380667 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:13.380634 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-69w4k" Jul 06 22:53:13.452476 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:13.452434 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" event={"ID":"4fbcebf7-bb95-42b5-97e9-177dc0519be4","Type":"ContainerStarted","Data":"916f9be3bcf880b7a4caca42ed3eb51df46c3262a8684e4a2603fb4532986345"} Jul 06 22:53:13.452686 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:13.452603 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:13.454233 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:13.454213 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" Jul 06 22:53:13.545426 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:13.545358 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cjchz" podStartSLOduration=1.752879511 podStartE2EDuration="4.545333318s" totalImagesPullingTime="2.792453807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:53:13.544969706 +0000 UTC m=+421.856137871" watchObservedRunningTime="2026-07-06 22:53:13.545333318 +0000 UTC m=+421.856501487" Jul 06 22:53:19.427795 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:53:19.427762 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 22:54:13.888142 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:13.888095 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc"] Jul 06 22:54:13.891636 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:13.891616 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:13.893858 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:13.893818 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 22:54:13.894000 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:13.893972 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 22:54:13.894657 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:13.894635 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wn2q7\"" Jul 06 22:54:13.898036 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:13.897996 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc"] Jul 06 22:54:13.931211 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:13.931169 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:13.931397 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:13.931224 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:13.931397 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:13.931294 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qclk\" (UniqueName: \"kubernetes.io/projected/8ee1257b-108b-4cb7-a3bd-8111e52c933f-kube-api-access-2qclk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:14.032266 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.032215 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:14.032266 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.032278 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:14.032531 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.032330 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qclk\" (UniqueName: \"kubernetes.io/projected/8ee1257b-108b-4cb7-a3bd-8111e52c933f-kube-api-access-2qclk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:14.032669 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.032647 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:14.032709 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.032667 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:14.040438 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.040397 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qclk\" (UniqueName: \"kubernetes.io/projected/8ee1257b-108b-4cb7-a3bd-8111e52c933f-kube-api-access-2qclk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:14.202602 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.202566 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:14.344438 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.344409 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc"] Jul 06 22:54:14.346891 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:54:14.346864 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee1257b_108b_4cb7_a3bd_8111e52c933f.slice/crio-d0fb77ad8c4f740b6a6c46b71b82babdd4463dccabe1e97adbf27551f31efea2 WatchSource:0}: Error finding container d0fb77ad8c4f740b6a6c46b71b82babdd4463dccabe1e97adbf27551f31efea2: Status 404 returned error can't find the container with id d0fb77ad8c4f740b6a6c46b71b82babdd4463dccabe1e97adbf27551f31efea2 Jul 06 22:54:14.682734 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.682694 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb"] Jul 06 22:54:14.686244 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.686224 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:14.692944 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.692911 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb"] Jul 06 22:54:14.739453 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.739349 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzl58\" (UniqueName: \"kubernetes.io/projected/a850271e-416c-4de0-9c9f-4c24bb781a09-kube-api-access-lzl58\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:14.739453 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.739408 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:14.739728 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.739480 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:14.762688 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.762649 2568 generic.go:356] "Generic (PLEG): container finished" podID="8ee1257b-108b-4cb7-a3bd-8111e52c933f" containerID="f558f6be94da56b43476b864112e26f246bd07f9ab3c90ef85c221aa21032213" exitCode=0 Jul 06 22:54:14.762854 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.762714 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" event={"ID":"8ee1257b-108b-4cb7-a3bd-8111e52c933f","Type":"ContainerDied","Data":"f558f6be94da56b43476b864112e26f246bd07f9ab3c90ef85c221aa21032213"} Jul 06 22:54:14.762854 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.762757 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" event={"ID":"8ee1257b-108b-4cb7-a3bd-8111e52c933f","Type":"ContainerStarted","Data":"d0fb77ad8c4f740b6a6c46b71b82babdd4463dccabe1e97adbf27551f31efea2"} Jul 06 22:54:14.840833 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.840763 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzl58\" (UniqueName: \"kubernetes.io/projected/a850271e-416c-4de0-9c9f-4c24bb781a09-kube-api-access-lzl58\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:14.840833 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.840833 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:14.841123 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.840876 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:14.841279 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.841252 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:14.841333 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.841265 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:14.848256 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.848227 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzl58\" (UniqueName: \"kubernetes.io/projected/a850271e-416c-4de0-9c9f-4c24bb781a09-kube-api-access-lzl58\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:14.997054 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:14.996965 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:15.081211 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.081176 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r"] Jul 06 22:54:15.085059 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.085034 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:15.091424 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.091389 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r"] Jul 06 22:54:15.144492 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.144453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:15.144704 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.144587 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:15.144704 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.144633 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqnkh\" (UniqueName: \"kubernetes.io/projected/b044c8cb-62d3-447d-897e-d476ad93acf1-kube-api-access-jqnkh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:15.149985 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.149954 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb"] Jul 06 22:54:15.152281 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:54:15.152252 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda850271e_416c_4de0_9c9f_4c24bb781a09.slice/crio-736b8abdfec75672f139ba210b9c0b1200620df7744eff63f33b1955ead0bc73 WatchSource:0}: Error finding container 736b8abdfec75672f139ba210b9c0b1200620df7744eff63f33b1955ead0bc73: Status 404 returned error can't find the container with id 736b8abdfec75672f139ba210b9c0b1200620df7744eff63f33b1955ead0bc73 Jul 06 22:54:15.246113 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.246079 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:15.246289 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.246146 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqnkh\" (UniqueName: \"kubernetes.io/projected/b044c8cb-62d3-447d-897e-d476ad93acf1-kube-api-access-jqnkh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:15.246289 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.246198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:15.246565 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.246535 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:15.246721 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.246538 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:15.253808 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.253733 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqnkh\" (UniqueName: \"kubernetes.io/projected/b044c8cb-62d3-447d-897e-d476ad93acf1-kube-api-access-jqnkh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:15.399296 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.399252 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:15.480481 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.480446 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j"] Jul 06 22:54:15.485730 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.485701 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:15.491244 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.491212 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j"] Jul 06 22:54:15.549412 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.549378 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvsl5\" (UniqueName: \"kubernetes.io/projected/ff10ffc3-e07c-45b7-99ff-c79bc7388891-kube-api-access-qvsl5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:15.549602 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.549536 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:15.549602 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.549588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:15.564164 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.564113 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r"] Jul 06 22:54:15.587635 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:54:15.587601 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb044c8cb_62d3_447d_897e_d476ad93acf1.slice/crio-82a6f8c3ed65fc85f54ca595c47031de754d91ec00c9981b84cdb949dfac46d6 WatchSource:0}: Error finding container 82a6f8c3ed65fc85f54ca595c47031de754d91ec00c9981b84cdb949dfac46d6: Status 404 returned error can't find the container with id 82a6f8c3ed65fc85f54ca595c47031de754d91ec00c9981b84cdb949dfac46d6 Jul 06 22:54:15.650055 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.650021 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvsl5\" (UniqueName: \"kubernetes.io/projected/ff10ffc3-e07c-45b7-99ff-c79bc7388891-kube-api-access-qvsl5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:15.650227 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.650120 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:15.650227 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.650158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:15.650479 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.650460 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:15.650554 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.650481 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:15.658116 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.658086 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvsl5\" (UniqueName: \"kubernetes.io/projected/ff10ffc3-e07c-45b7-99ff-c79bc7388891-kube-api-access-qvsl5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:15.769293 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.769193 2568 generic.go:356] "Generic (PLEG): container finished" podID="b044c8cb-62d3-447d-897e-d476ad93acf1" containerID="c2db8ca8fbd2e9fe7b6219303d9a9065773b2be4146bef58668f2b496f30aef0" exitCode=0 Jul 06 22:54:15.769293 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.769274 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" event={"ID":"b044c8cb-62d3-447d-897e-d476ad93acf1","Type":"ContainerDied","Data":"c2db8ca8fbd2e9fe7b6219303d9a9065773b2be4146bef58668f2b496f30aef0"} Jul 06 22:54:15.769540 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.769320 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" event={"ID":"b044c8cb-62d3-447d-897e-d476ad93acf1","Type":"ContainerStarted","Data":"82a6f8c3ed65fc85f54ca595c47031de754d91ec00c9981b84cdb949dfac46d6"} Jul 06 22:54:15.770979 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.770954 2568 generic.go:356] "Generic (PLEG): container finished" podID="a850271e-416c-4de0-9c9f-4c24bb781a09" containerID="f7af78732c7b480660f7510b8f6075b14d410065a6b81b39afce6671ad383baf" exitCode=0 Jul 06 22:54:15.771097 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.771037 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" event={"ID":"a850271e-416c-4de0-9c9f-4c24bb781a09","Type":"ContainerDied","Data":"f7af78732c7b480660f7510b8f6075b14d410065a6b81b39afce6671ad383baf"} Jul 06 22:54:15.771097 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.771087 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" event={"ID":"a850271e-416c-4de0-9c9f-4c24bb781a09","Type":"ContainerStarted","Data":"736b8abdfec75672f139ba210b9c0b1200620df7744eff63f33b1955ead0bc73"} Jul 06 22:54:15.773148 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.773118 2568 generic.go:356] "Generic (PLEG): container finished" podID="8ee1257b-108b-4cb7-a3bd-8111e52c933f" containerID="36660af0bd2406c876d448b7a52d00bf4a9f01482d6ebfd3f31e88423eeecc24" exitCode=0 Jul 06 22:54:15.773264 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.773188 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" event={"ID":"8ee1257b-108b-4cb7-a3bd-8111e52c933f","Type":"ContainerDied","Data":"36660af0bd2406c876d448b7a52d00bf4a9f01482d6ebfd3f31e88423eeecc24"} Jul 06 22:54:15.798220 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.798180 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:15.971945 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:15.971894 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j"] Jul 06 22:54:16.006429 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:54:16.006387 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff10ffc3_e07c_45b7_99ff_c79bc7388891.slice/crio-8b3641e47d9720b5cbc661d47a19cc7004e2b1f6f6616fe4e6506acb8932db2f WatchSource:0}: Error finding container 8b3641e47d9720b5cbc661d47a19cc7004e2b1f6f6616fe4e6506acb8932db2f: Status 404 returned error can't find the container with id 8b3641e47d9720b5cbc661d47a19cc7004e2b1f6f6616fe4e6506acb8932db2f Jul 06 22:54:16.780286 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:16.780252 2568 generic.go:356] "Generic (PLEG): container finished" podID="b044c8cb-62d3-447d-897e-d476ad93acf1" containerID="6f5a89813032fdc58a63a22e28e240412d1509b320b125f65a4f976b593a4a16" exitCode=0 Jul 06 22:54:16.780475 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:16.780341 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" event={"ID":"b044c8cb-62d3-447d-897e-d476ad93acf1","Type":"ContainerDied","Data":"6f5a89813032fdc58a63a22e28e240412d1509b320b125f65a4f976b593a4a16"} Jul 06 22:54:16.782319 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:16.782287 2568 generic.go:356] "Generic (PLEG): container finished" podID="a850271e-416c-4de0-9c9f-4c24bb781a09" containerID="4e7f2238d9df83b8fc9a18c48bf83318847717bad8d514c1ad90eb9a6aa9c14f" exitCode=0 Jul 06 22:54:16.782470 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:16.782382 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" event={"ID":"a850271e-416c-4de0-9c9f-4c24bb781a09","Type":"ContainerDied","Data":"4e7f2238d9df83b8fc9a18c48bf83318847717bad8d514c1ad90eb9a6aa9c14f"} Jul 06 22:54:16.784766 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:16.784744 2568 generic.go:356] "Generic (PLEG): container finished" podID="8ee1257b-108b-4cb7-a3bd-8111e52c933f" containerID="33159d792714c742ba3359e0559b346392d47542e038e7ad1c822b02ccd1a16b" exitCode=0 Jul 06 22:54:16.784854 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:16.784766 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" event={"ID":"8ee1257b-108b-4cb7-a3bd-8111e52c933f","Type":"ContainerDied","Data":"33159d792714c742ba3359e0559b346392d47542e038e7ad1c822b02ccd1a16b"} Jul 06 22:54:16.786326 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:16.786304 2568 generic.go:356] "Generic (PLEG): container finished" podID="ff10ffc3-e07c-45b7-99ff-c79bc7388891" containerID="5210afb7c9b5693e00deab3b9489c31984e4fd18599b0a795c938cf4bef0fdd3" exitCode=0 Jul 06 22:54:16.786422 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:16.786358 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" event={"ID":"ff10ffc3-e07c-45b7-99ff-c79bc7388891","Type":"ContainerDied","Data":"5210afb7c9b5693e00deab3b9489c31984e4fd18599b0a795c938cf4bef0fdd3"} Jul 06 22:54:16.786422 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:16.786392 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" event={"ID":"ff10ffc3-e07c-45b7-99ff-c79bc7388891","Type":"ContainerStarted","Data":"8b3641e47d9720b5cbc661d47a19cc7004e2b1f6f6616fe4e6506acb8932db2f"} Jul 06 22:54:17.801643 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.801605 2568 generic.go:356] "Generic (PLEG): container finished" podID="a850271e-416c-4de0-9c9f-4c24bb781a09" containerID="04b78e5cc1a5d312850726318b38dea00d48fc3aa6d1c5bd33b1bbfb67abcf87" exitCode=0 Jul 06 22:54:17.802055 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.801683 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" event={"ID":"a850271e-416c-4de0-9c9f-4c24bb781a09","Type":"ContainerDied","Data":"04b78e5cc1a5d312850726318b38dea00d48fc3aa6d1c5bd33b1bbfb67abcf87"} Jul 06 22:54:17.803489 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.803466 2568 generic.go:356] "Generic (PLEG): container finished" podID="ff10ffc3-e07c-45b7-99ff-c79bc7388891" containerID="e59a8ff690bc43504dd9865a42eca307e2ca755d4d440547f62dc41a69f6a5e4" exitCode=0 Jul 06 22:54:17.803626 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.803530 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" event={"ID":"ff10ffc3-e07c-45b7-99ff-c79bc7388891","Type":"ContainerDied","Data":"e59a8ff690bc43504dd9865a42eca307e2ca755d4d440547f62dc41a69f6a5e4"} Jul 06 22:54:17.805966 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.805944 2568 generic.go:356] "Generic (PLEG): container finished" podID="b044c8cb-62d3-447d-897e-d476ad93acf1" containerID="d4539b190d29d31ae9acc15a9a69f422442cdb9ae89404e3445a2d556fa45f8f" exitCode=0 Jul 06 22:54:17.806051 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.806010 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" event={"ID":"b044c8cb-62d3-447d-897e-d476ad93acf1","Type":"ContainerDied","Data":"d4539b190d29d31ae9acc15a9a69f422442cdb9ae89404e3445a2d556fa45f8f"} Jul 06 22:54:17.949897 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.949868 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:17.972986 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.972955 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-bundle\") pod \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " Jul 06 22:54:17.973160 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.973009 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qclk\" (UniqueName: \"kubernetes.io/projected/8ee1257b-108b-4cb7-a3bd-8111e52c933f-kube-api-access-2qclk\") pod \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " Jul 06 22:54:17.973160 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.973053 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-util\") pod \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\" (UID: \"8ee1257b-108b-4cb7-a3bd-8111e52c933f\") " Jul 06 22:54:17.973563 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.973537 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-bundle" (OuterVolumeSpecName: "bundle") pod "8ee1257b-108b-4cb7-a3bd-8111e52c933f" (UID: "8ee1257b-108b-4cb7-a3bd-8111e52c933f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:17.976806 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.976778 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee1257b-108b-4cb7-a3bd-8111e52c933f-kube-api-access-2qclk" (OuterVolumeSpecName: "kube-api-access-2qclk") pod "8ee1257b-108b-4cb7-a3bd-8111e52c933f" (UID: "8ee1257b-108b-4cb7-a3bd-8111e52c933f"). InnerVolumeSpecName "kube-api-access-2qclk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:54:17.981785 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:17.981748 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-util" (OuterVolumeSpecName: "util") pod "8ee1257b-108b-4cb7-a3bd-8111e52c933f" (UID: "8ee1257b-108b-4cb7-a3bd-8111e52c933f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:18.073826 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.073735 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-util\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:18.073826 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.073770 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ee1257b-108b-4cb7-a3bd-8111e52c933f-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:18.073826 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.073780 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qclk\" (UniqueName: \"kubernetes.io/projected/8ee1257b-108b-4cb7-a3bd-8111e52c933f-kube-api-access-2qclk\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:18.813948 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.813917 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" Jul 06 22:54:18.813948 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.813931 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc" event={"ID":"8ee1257b-108b-4cb7-a3bd-8111e52c933f","Type":"ContainerDied","Data":"d0fb77ad8c4f740b6a6c46b71b82babdd4463dccabe1e97adbf27551f31efea2"} Jul 06 22:54:18.814423 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.813981 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0fb77ad8c4f740b6a6c46b71b82babdd4463dccabe1e97adbf27551f31efea2" Jul 06 22:54:18.816423 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.816394 2568 generic.go:356] "Generic (PLEG): container finished" podID="ff10ffc3-e07c-45b7-99ff-c79bc7388891" containerID="d036647e03c00825d67116079da8f5a7d8cb6d0431a4c1a85ba6f161cd0a9d92" exitCode=0 Jul 06 22:54:18.816578 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.816432 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" event={"ID":"ff10ffc3-e07c-45b7-99ff-c79bc7388891","Type":"ContainerDied","Data":"d036647e03c00825d67116079da8f5a7d8cb6d0431a4c1a85ba6f161cd0a9d92"} Jul 06 22:54:18.958433 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.958398 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:18.983439 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.983404 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-bundle\") pod \"b044c8cb-62d3-447d-897e-d476ad93acf1\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " Jul 06 22:54:18.983439 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.983455 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-util\") pod \"b044c8cb-62d3-447d-897e-d476ad93acf1\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " Jul 06 22:54:18.983691 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.983597 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqnkh\" (UniqueName: \"kubernetes.io/projected/b044c8cb-62d3-447d-897e-d476ad93acf1-kube-api-access-jqnkh\") pod \"b044c8cb-62d3-447d-897e-d476ad93acf1\" (UID: \"b044c8cb-62d3-447d-897e-d476ad93acf1\") " Jul 06 22:54:18.984068 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.984040 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-bundle" (OuterVolumeSpecName: "bundle") pod "b044c8cb-62d3-447d-897e-d476ad93acf1" (UID: "b044c8cb-62d3-447d-897e-d476ad93acf1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:18.986620 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.986587 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b044c8cb-62d3-447d-897e-d476ad93acf1-kube-api-access-jqnkh" (OuterVolumeSpecName: "kube-api-access-jqnkh") pod "b044c8cb-62d3-447d-897e-d476ad93acf1" (UID: "b044c8cb-62d3-447d-897e-d476ad93acf1"). InnerVolumeSpecName "kube-api-access-jqnkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:54:18.990106 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.990033 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-util" (OuterVolumeSpecName: "util") pod "b044c8cb-62d3-447d-897e-d476ad93acf1" (UID: "b044c8cb-62d3-447d-897e-d476ad93acf1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:18.996115 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:18.996084 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:19.084910 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.084813 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-bundle\") pod \"a850271e-416c-4de0-9c9f-4c24bb781a09\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " Jul 06 22:54:19.084910 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.084876 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzl58\" (UniqueName: \"kubernetes.io/projected/a850271e-416c-4de0-9c9f-4c24bb781a09-kube-api-access-lzl58\") pod \"a850271e-416c-4de0-9c9f-4c24bb781a09\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " Jul 06 22:54:19.085146 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.084924 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-util\") pod \"a850271e-416c-4de0-9c9f-4c24bb781a09\" (UID: \"a850271e-416c-4de0-9c9f-4c24bb781a09\") " Jul 06 22:54:19.085146 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.085120 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:19.085146 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.085130 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b044c8cb-62d3-447d-897e-d476ad93acf1-util\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:19.085146 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.085139 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqnkh\" (UniqueName: \"kubernetes.io/projected/b044c8cb-62d3-447d-897e-d476ad93acf1-kube-api-access-jqnkh\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:19.085319 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.085229 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-bundle" (OuterVolumeSpecName: "bundle") pod "a850271e-416c-4de0-9c9f-4c24bb781a09" (UID: "a850271e-416c-4de0-9c9f-4c24bb781a09"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:19.087180 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.087153 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a850271e-416c-4de0-9c9f-4c24bb781a09-kube-api-access-lzl58" (OuterVolumeSpecName: "kube-api-access-lzl58") pod "a850271e-416c-4de0-9c9f-4c24bb781a09" (UID: "a850271e-416c-4de0-9c9f-4c24bb781a09"). InnerVolumeSpecName "kube-api-access-lzl58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:54:19.090342 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.090311 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-util" (OuterVolumeSpecName: "util") pod "a850271e-416c-4de0-9c9f-4c24bb781a09" (UID: "a850271e-416c-4de0-9c9f-4c24bb781a09"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:19.185810 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.185766 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:19.185810 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.185803 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzl58\" (UniqueName: \"kubernetes.io/projected/a850271e-416c-4de0-9c9f-4c24bb781a09-kube-api-access-lzl58\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:19.185810 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.185815 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a850271e-416c-4de0-9c9f-4c24bb781a09-util\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:19.824784 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.824751 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" Jul 06 22:54:19.824784 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.824759 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r" event={"ID":"b044c8cb-62d3-447d-897e-d476ad93acf1","Type":"ContainerDied","Data":"82a6f8c3ed65fc85f54ca595c47031de754d91ec00c9981b84cdb949dfac46d6"} Jul 06 22:54:19.825391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.824807 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82a6f8c3ed65fc85f54ca595c47031de754d91ec00c9981b84cdb949dfac46d6" Jul 06 22:54:19.826865 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.826840 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" Jul 06 22:54:19.827006 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.826846 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb" event={"ID":"a850271e-416c-4de0-9c9f-4c24bb781a09","Type":"ContainerDied","Data":"736b8abdfec75672f139ba210b9c0b1200620df7744eff63f33b1955ead0bc73"} Jul 06 22:54:19.827006 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.826962 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="736b8abdfec75672f139ba210b9c0b1200620df7744eff63f33b1955ead0bc73" Jul 06 22:54:19.969269 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.969240 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:19.992896 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.992862 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvsl5\" (UniqueName: \"kubernetes.io/projected/ff10ffc3-e07c-45b7-99ff-c79bc7388891-kube-api-access-qvsl5\") pod \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " Jul 06 22:54:19.993034 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.992910 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-bundle\") pod \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " Jul 06 22:54:19.993034 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.992948 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-util\") pod \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\" (UID: \"ff10ffc3-e07c-45b7-99ff-c79bc7388891\") " Jul 06 22:54:19.993620 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.993592 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-bundle" (OuterVolumeSpecName: "bundle") pod "ff10ffc3-e07c-45b7-99ff-c79bc7388891" (UID: "ff10ffc3-e07c-45b7-99ff-c79bc7388891"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:19.995090 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.995059 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff10ffc3-e07c-45b7-99ff-c79bc7388891-kube-api-access-qvsl5" (OuterVolumeSpecName: "kube-api-access-qvsl5") pod "ff10ffc3-e07c-45b7-99ff-c79bc7388891" (UID: "ff10ffc3-e07c-45b7-99ff-c79bc7388891"). InnerVolumeSpecName "kube-api-access-qvsl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:54:19.998491 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:19.998463 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-util" (OuterVolumeSpecName: "util") pod "ff10ffc3-e07c-45b7-99ff-c79bc7388891" (UID: "ff10ffc3-e07c-45b7-99ff-c79bc7388891"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:20.093706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:20.093615 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvsl5\" (UniqueName: \"kubernetes.io/projected/ff10ffc3-e07c-45b7-99ff-c79bc7388891-kube-api-access-qvsl5\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:20.093706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:20.093645 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:20.093706 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:20.093655 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff10ffc3-e07c-45b7-99ff-c79bc7388891-util\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:20.834669 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:20.834628 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" event={"ID":"ff10ffc3-e07c-45b7-99ff-c79bc7388891","Type":"ContainerDied","Data":"8b3641e47d9720b5cbc661d47a19cc7004e2b1f6f6616fe4e6506acb8932db2f"} Jul 06 22:54:20.835051 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:20.834690 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b3641e47d9720b5cbc661d47a19cc7004e2b1f6f6616fe4e6506acb8932db2f" Jul 06 22:54:20.835051 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:20.834649 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j" Jul 06 22:54:22.557805 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.557768 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8b7d79695-j8jgt"] Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558130 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee1257b-108b-4cb7-a3bd-8111e52c933f" containerName="util" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558141 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee1257b-108b-4cb7-a3bd-8111e52c933f" containerName="util" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558149 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee1257b-108b-4cb7-a3bd-8111e52c933f" containerName="pull" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558154 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee1257b-108b-4cb7-a3bd-8111e52c933f" containerName="pull" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558161 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b044c8cb-62d3-447d-897e-d476ad93acf1" containerName="util" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558168 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b044c8cb-62d3-447d-897e-d476ad93acf1" containerName="util" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558178 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b044c8cb-62d3-447d-897e-d476ad93acf1" containerName="pull" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558183 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b044c8cb-62d3-447d-897e-d476ad93acf1" containerName="pull" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558188 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff10ffc3-e07c-45b7-99ff-c79bc7388891" containerName="extract" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558194 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff10ffc3-e07c-45b7-99ff-c79bc7388891" containerName="extract" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558202 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff10ffc3-e07c-45b7-99ff-c79bc7388891" containerName="pull" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558207 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff10ffc3-e07c-45b7-99ff-c79bc7388891" containerName="pull" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558215 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a850271e-416c-4de0-9c9f-4c24bb781a09" containerName="util" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558220 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a850271e-416c-4de0-9c9f-4c24bb781a09" containerName="util" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558240 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a850271e-416c-4de0-9c9f-4c24bb781a09" containerName="pull" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558246 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a850271e-416c-4de0-9c9f-4c24bb781a09" containerName="pull" Jul 06 22:54:22.558248 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558256 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee1257b-108b-4cb7-a3bd-8111e52c933f" containerName="extract" Jul 06 22:54:22.559165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558261 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee1257b-108b-4cb7-a3bd-8111e52c933f" containerName="extract" Jul 06 22:54:22.559165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558267 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a850271e-416c-4de0-9c9f-4c24bb781a09" containerName="extract" Jul 06 22:54:22.559165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558273 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a850271e-416c-4de0-9c9f-4c24bb781a09" containerName="extract" Jul 06 22:54:22.559165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558284 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff10ffc3-e07c-45b7-99ff-c79bc7388891" containerName="util" Jul 06 22:54:22.559165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558289 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff10ffc3-e07c-45b7-99ff-c79bc7388891" containerName="util" Jul 06 22:54:22.559165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558296 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b044c8cb-62d3-447d-897e-d476ad93acf1" containerName="extract" Jul 06 22:54:22.559165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558301 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b044c8cb-62d3-447d-897e-d476ad93acf1" containerName="extract" Jul 06 22:54:22.559165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558358 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ee1257b-108b-4cb7-a3bd-8111e52c933f" containerName="extract" Jul 06 22:54:22.559165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558365 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b044c8cb-62d3-447d-897e-d476ad93acf1" containerName="extract" Jul 06 22:54:22.559165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558373 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff10ffc3-e07c-45b7-99ff-c79bc7388891" containerName="extract" Jul 06 22:54:22.559165 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.558380 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a850271e-416c-4de0-9c9f-4c24bb781a09" containerName="extract" Jul 06 22:54:22.561737 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.561715 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.571391 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.571363 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b7d79695-j8jgt"] Jul 06 22:54:22.618710 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.618667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-console-serving-cert\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.618710 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.618713 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-service-ca\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.618930 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.618808 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-console-config\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.618930 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.618835 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-trusted-ca-bundle\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.618930 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.618852 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8spc2\" (UniqueName: \"kubernetes.io/projected/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-kube-api-access-8spc2\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.619041 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.618953 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-oauth-serving-cert\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.619041 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.618991 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-console-oauth-config\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.719920 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.719877 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-console-config\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.719920 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.719916 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-trusted-ca-bundle\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.720187 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.719933 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8spc2\" (UniqueName: \"kubernetes.io/projected/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-kube-api-access-8spc2\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.720187 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.719994 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-oauth-serving-cert\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.720187 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.720021 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-console-oauth-config\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.720187 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.720045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-console-serving-cert\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.720187 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.720076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-service-ca\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.720796 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.720764 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-console-config\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.720926 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.720772 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-oauth-serving-cert\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.720926 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.720815 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-service-ca\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.720926 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.720856 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-trusted-ca-bundle\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.723251 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.723224 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-console-serving-cert\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.723317 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.723232 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-console-oauth-config\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.728663 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.728629 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8spc2\" (UniqueName: \"kubernetes.io/projected/e4100594-8807-4c5b-b8f9-3d9d9bc086b1-kube-api-access-8spc2\") pod \"console-8b7d79695-j8jgt\" (UID: \"e4100594-8807-4c5b-b8f9-3d9d9bc086b1\") " pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:22.873177 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:22.873075 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:23.017599 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:23.017561 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b7d79695-j8jgt"] Jul 06 22:54:23.020877 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:54:23.020849 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4100594_8807_4c5b_b8f9_3d9d9bc086b1.slice/crio-22f033ae7dadc63e3b9455742039831d87be32e644d20648ff74ea70f7d284cc WatchSource:0}: Error finding container 22f033ae7dadc63e3b9455742039831d87be32e644d20648ff74ea70f7d284cc: Status 404 returned error can't find the container with id 22f033ae7dadc63e3b9455742039831d87be32e644d20648ff74ea70f7d284cc Jul 06 22:54:23.853989 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:23.853954 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b7d79695-j8jgt" event={"ID":"e4100594-8807-4c5b-b8f9-3d9d9bc086b1","Type":"ContainerStarted","Data":"83e3c84fd8000a6faa8e476639e952dceedceaa6c5744b98430453c97fa1e501"} Jul 06 22:54:23.854402 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:23.854004 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b7d79695-j8jgt" event={"ID":"e4100594-8807-4c5b-b8f9-3d9d9bc086b1","Type":"ContainerStarted","Data":"22f033ae7dadc63e3b9455742039831d87be32e644d20648ff74ea70f7d284cc"} Jul 06 22:54:23.871311 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:23.870971 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8b7d79695-j8jgt" podStartSLOduration=1.8709465299999999 podStartE2EDuration="1.87094653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:54:23.870301202 +0000 UTC m=+492.181469369" watchObservedRunningTime="2026-07-06 22:54:23.87094653 +0000 UTC m=+492.182114699" Jul 06 22:54:32.873732 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:32.873685 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:32.874162 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:32.873767 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:32.878812 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:32.878783 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:32.905340 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:32.905309 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8b7d79695-j8jgt" Jul 06 22:54:32.967886 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:32.967847 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848d77f5df-hfvw2"] Jul 06 22:54:57.990321 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:57.990243 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-848d77f5df-hfvw2" podUID="a9f28620-0a16-47bf-b90f-b65d5961503d" containerName="console" containerID="cri-o://bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1" gracePeriod=15 Jul 06 22:54:58.258457 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.258427 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:54:58.359343 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.359304 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-serving-cert\") pod \"a9f28620-0a16-47bf-b90f-b65d5961503d\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " Jul 06 22:54:58.359575 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.359364 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-oauth-serving-cert\") pod \"a9f28620-0a16-47bf-b90f-b65d5961503d\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " Jul 06 22:54:58.359575 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.359414 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-service-ca\") pod \"a9f28620-0a16-47bf-b90f-b65d5961503d\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " Jul 06 22:54:58.359575 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.359449 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-trusted-ca-bundle\") pod \"a9f28620-0a16-47bf-b90f-b65d5961503d\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " Jul 06 22:54:58.359575 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.359485 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw5hr\" (UniqueName: \"kubernetes.io/projected/a9f28620-0a16-47bf-b90f-b65d5961503d-kube-api-access-tw5hr\") pod \"a9f28620-0a16-47bf-b90f-b65d5961503d\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " Jul 06 22:54:58.359575 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.359557 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-console-config\") pod \"a9f28620-0a16-47bf-b90f-b65d5961503d\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " Jul 06 22:54:58.359842 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.359601 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-oauth-config\") pod \"a9f28620-0a16-47bf-b90f-b65d5961503d\" (UID: \"a9f28620-0a16-47bf-b90f-b65d5961503d\") " Jul 06 22:54:58.360195 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.359971 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-service-ca" (OuterVolumeSpecName: "service-ca") pod "a9f28620-0a16-47bf-b90f-b65d5961503d" (UID: "a9f28620-0a16-47bf-b90f-b65d5961503d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:54:58.360195 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.360111 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a9f28620-0a16-47bf-b90f-b65d5961503d" (UID: "a9f28620-0a16-47bf-b90f-b65d5961503d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:54:58.360195 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.360142 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-console-config" (OuterVolumeSpecName: "console-config") pod "a9f28620-0a16-47bf-b90f-b65d5961503d" (UID: "a9f28620-0a16-47bf-b90f-b65d5961503d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:54:58.360195 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.360155 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a9f28620-0a16-47bf-b90f-b65d5961503d" (UID: "a9f28620-0a16-47bf-b90f-b65d5961503d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:54:58.361794 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.361761 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a9f28620-0a16-47bf-b90f-b65d5961503d" (UID: "a9f28620-0a16-47bf-b90f-b65d5961503d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:54:58.361888 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.361779 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a9f28620-0a16-47bf-b90f-b65d5961503d" (UID: "a9f28620-0a16-47bf-b90f-b65d5961503d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:54:58.361888 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.361867 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9f28620-0a16-47bf-b90f-b65d5961503d-kube-api-access-tw5hr" (OuterVolumeSpecName: "kube-api-access-tw5hr") pod "a9f28620-0a16-47bf-b90f-b65d5961503d" (UID: "a9f28620-0a16-47bf-b90f-b65d5961503d"). InnerVolumeSpecName "kube-api-access-tw5hr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:54:58.461001 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.460960 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-trusted-ca-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:58.461001 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.460993 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw5hr\" (UniqueName: \"kubernetes.io/projected/a9f28620-0a16-47bf-b90f-b65d5961503d-kube-api-access-tw5hr\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:58.461001 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.461003 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-console-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:58.461001 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.461012 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-oauth-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:58.461284 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.461022 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f28620-0a16-47bf-b90f-b65d5961503d-console-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:58.461284 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.461030 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-oauth-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:58.461284 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:58.461039 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f28620-0a16-47bf-b90f-b65d5961503d-service-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 22:54:59.044426 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:59.044386 2568 generic.go:356] "Generic (PLEG): container finished" podID="a9f28620-0a16-47bf-b90f-b65d5961503d" containerID="bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1" exitCode=0 Jul 06 22:54:59.044944 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:59.044438 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848d77f5df-hfvw2" Jul 06 22:54:59.044944 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:59.044475 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848d77f5df-hfvw2" event={"ID":"a9f28620-0a16-47bf-b90f-b65d5961503d","Type":"ContainerDied","Data":"bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1"} Jul 06 22:54:59.044944 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:59.044569 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848d77f5df-hfvw2" event={"ID":"a9f28620-0a16-47bf-b90f-b65d5961503d","Type":"ContainerDied","Data":"ec8976b9e0cc6d9cd579c13ca817fd84e96e22a40673d7d4e8134499ab1f8bbc"} Jul 06 22:54:59.044944 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:59.044604 2568 scope.go:117] "RemoveContainer" containerID="bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1" Jul 06 22:54:59.054910 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:59.054888 2568 scope.go:117] "RemoveContainer" containerID="bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1" Jul 06 22:54:59.055244 ip-10-0-142-117 kubenswrapper[2568]: E0706 22:54:59.055224 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1\": container with ID starting with bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1 not found: ID does not exist" containerID="bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1" Jul 06 22:54:59.055312 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:59.055250 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1"} err="failed to get container status \"bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1\": rpc error: code = NotFound desc = could not find container \"bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1\": container with ID starting with bc8662f3e4e8baae8c956496e5f2ec8d4b627094af4fd21d81b22814aedb42d1 not found: ID does not exist" Jul 06 22:54:59.069363 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:59.069333 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848d77f5df-hfvw2"] Jul 06 22:54:59.085827 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:54:59.085787 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-848d77f5df-hfvw2"] Jul 06 22:55:00.273908 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:00.273871 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9f28620-0a16-47bf-b90f-b65d5961503d" path="/var/lib/kubelet/pods/a9f28620-0a16-47bf-b90f-b65d5961503d/volumes" Jul 06 22:55:46.360109 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.360071 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 22:55:46.360745 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.360576 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f28620-0a16-47bf-b90f-b65d5961503d" containerName="console" Jul 06 22:55:46.360745 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.360591 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f28620-0a16-47bf-b90f-b65d5961503d" containerName="console" Jul 06 22:55:46.360745 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.360658 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9f28620-0a16-47bf-b90f-b65d5961503d" containerName="console" Jul 06 22:55:46.363413 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.363396 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" Jul 06 22:55:46.365779 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.365753 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 22:55:46.365779 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.365775 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 22:55:46.366549 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.366534 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wn2q7\"" Jul 06 22:55:46.366606 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.366568 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 22:55:46.371166 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.370987 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 22:55:46.404936 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.404892 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 22:55:46.410170 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.410149 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8293d3c8-9128-4d7a-8fed-bbe14e277561-config-file\") pod \"limitador-limitador-54d6d988d5-d5k2g\" (UID: \"8293d3c8-9128-4d7a-8fed-bbe14e277561\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" Jul 06 22:55:46.410268 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.410198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52d5h\" (UniqueName: \"kubernetes.io/projected/8293d3c8-9128-4d7a-8fed-bbe14e277561-kube-api-access-52d5h\") pod \"limitador-limitador-54d6d988d5-d5k2g\" (UID: \"8293d3c8-9128-4d7a-8fed-bbe14e277561\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" Jul 06 22:55:46.510890 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.510846 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52d5h\" (UniqueName: \"kubernetes.io/projected/8293d3c8-9128-4d7a-8fed-bbe14e277561-kube-api-access-52d5h\") pod \"limitador-limitador-54d6d988d5-d5k2g\" (UID: \"8293d3c8-9128-4d7a-8fed-bbe14e277561\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" Jul 06 22:55:46.511105 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.510936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8293d3c8-9128-4d7a-8fed-bbe14e277561-config-file\") pod \"limitador-limitador-54d6d988d5-d5k2g\" (UID: \"8293d3c8-9128-4d7a-8fed-bbe14e277561\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" Jul 06 22:55:46.511579 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.511560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8293d3c8-9128-4d7a-8fed-bbe14e277561-config-file\") pod \"limitador-limitador-54d6d988d5-d5k2g\" (UID: \"8293d3c8-9128-4d7a-8fed-bbe14e277561\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" Jul 06 22:55:46.519196 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.519171 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52d5h\" (UniqueName: \"kubernetes.io/projected/8293d3c8-9128-4d7a-8fed-bbe14e277561-kube-api-access-52d5h\") pod \"limitador-limitador-54d6d988d5-d5k2g\" (UID: \"8293d3c8-9128-4d7a-8fed-bbe14e277561\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" Jul 06 22:55:46.675387 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.675276 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" Jul 06 22:55:46.823511 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:46.823464 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 22:55:46.825488 ip-10-0-142-117 kubenswrapper[2568]: W0706 22:55:46.825460 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8293d3c8_9128_4d7a_8fed_bbe14e277561.slice/crio-23ad08f4ff91bbdae2d34ad74193d639bde80ad89d1403507d1064501ecede54 WatchSource:0}: Error finding container 23ad08f4ff91bbdae2d34ad74193d639bde80ad89d1403507d1064501ecede54: Status 404 returned error can't find the container with id 23ad08f4ff91bbdae2d34ad74193d639bde80ad89d1403507d1064501ecede54 Jul 06 22:55:47.304634 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:47.304590 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" event={"ID":"8293d3c8-9128-4d7a-8fed-bbe14e277561","Type":"ContainerStarted","Data":"23ad08f4ff91bbdae2d34ad74193d639bde80ad89d1403507d1064501ecede54"} Jul 06 22:55:50.323008 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:50.322971 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" event={"ID":"8293d3c8-9128-4d7a-8fed-bbe14e277561","Type":"ContainerStarted","Data":"33a949b0b5c0b44a882f74aa3ea9ff9dcc7e59bf7c5fb7f68620cc9ced42d1ca"} Jul 06 22:55:50.323412 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:50.323114 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" Jul 06 22:55:50.340377 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:55:50.340320 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" podStartSLOduration=1.843239501 podStartE2EDuration="4.340303802s" totalImagesPullingTime="2.497064301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:55:50.3379746 +0000 UTC m=+578.649142767" watchObservedRunningTime="2026-07-06 22:55:50.340303802 +0000 UTC m=+578.651472015" Jul 06 22:56:01.329639 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:56:01.329600 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d5k2g" Jul 06 22:56:12.172228 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:56:12.172193 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 22:56:12.175402 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:56:12.175375 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 22:57:00.708933 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:57:00.708891 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 22:57:16.721773 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:57:16.721732 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 22:57:38.481447 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:57:38.481409 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 22:57:56.972094 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:57:56.972052 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 22:58:28.279984 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:58:28.279886 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 22:58:43.980529 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:58:43.980472 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 22:58:53.607635 ip-10-0-142-117 kubenswrapper[2568]: I0706 22:58:53.607594 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:00:00.147896 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:00.147850 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722980-9dd27"] Jul 06 23:00:00.151746 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:00.151720 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-9dd27" Jul 06 23:00:00.154023 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:00.153999 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-tjzvc\"" Jul 06 23:00:00.159205 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:00.159173 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722980-9dd27"] Jul 06 23:00:00.245861 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:00.245829 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd9lt\" (UniqueName: \"kubernetes.io/projected/a8332e1f-95cc-44a0-b784-5ed162244998-kube-api-access-gd9lt\") pod \"maas-api-key-cleanup-29722980-9dd27\" (UID: \"a8332e1f-95cc-44a0-b784-5ed162244998\") " pod="opendatahub/maas-api-key-cleanup-29722980-9dd27" Jul 06 23:00:00.346562 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:00.346489 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd9lt\" (UniqueName: \"kubernetes.io/projected/a8332e1f-95cc-44a0-b784-5ed162244998-kube-api-access-gd9lt\") pod \"maas-api-key-cleanup-29722980-9dd27\" (UID: \"a8332e1f-95cc-44a0-b784-5ed162244998\") " pod="opendatahub/maas-api-key-cleanup-29722980-9dd27" Jul 06 23:00:00.357117 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:00.357087 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd9lt\" (UniqueName: \"kubernetes.io/projected/a8332e1f-95cc-44a0-b784-5ed162244998-kube-api-access-gd9lt\") pod \"maas-api-key-cleanup-29722980-9dd27\" (UID: \"a8332e1f-95cc-44a0-b784-5ed162244998\") " pod="opendatahub/maas-api-key-cleanup-29722980-9dd27" Jul 06 23:00:00.464936 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:00.464896 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-9dd27" Jul 06 23:00:00.612947 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:00.612917 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722980-9dd27"] Jul 06 23:00:00.615097 ip-10-0-142-117 kubenswrapper[2568]: W0706 23:00:00.615070 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8332e1f_95cc_44a0_b784_5ed162244998.slice/crio-e46e986d6a7f0719fbdf9aeb617d4f3b41e55c1405a490161b5f4b941dd92953 WatchSource:0}: Error finding container e46e986d6a7f0719fbdf9aeb617d4f3b41e55c1405a490161b5f4b941dd92953: Status 404 returned error can't find the container with id e46e986d6a7f0719fbdf9aeb617d4f3b41e55c1405a490161b5f4b941dd92953 Jul 06 23:00:00.617527 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:00.617492 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:00:00.651343 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:00.651309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722980-9dd27" event={"ID":"a8332e1f-95cc-44a0-b784-5ed162244998","Type":"ContainerStarted","Data":"e46e986d6a7f0719fbdf9aeb617d4f3b41e55c1405a490161b5f4b941dd92953"} Jul 06 23:00:22.767123 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:22.767031 2568 generic.go:356] "Generic (PLEG): container finished" podID="a8332e1f-95cc-44a0-b784-5ed162244998" containerID="5bc8e8d13a07e6c76ef590a5f314983fecc640118634db518d10480e07fe3051" exitCode=0 Jul 06 23:00:22.767123 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:22.767102 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722980-9dd27" event={"ID":"a8332e1f-95cc-44a0-b784-5ed162244998","Type":"ContainerDied","Data":"5bc8e8d13a07e6c76ef590a5f314983fecc640118634db518d10480e07fe3051"} Jul 06 23:00:23.910169 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:23.910143 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-9dd27" Jul 06 23:00:23.963556 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:23.963516 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd9lt\" (UniqueName: \"kubernetes.io/projected/a8332e1f-95cc-44a0-b784-5ed162244998-kube-api-access-gd9lt\") pod \"a8332e1f-95cc-44a0-b784-5ed162244998\" (UID: \"a8332e1f-95cc-44a0-b784-5ed162244998\") " Jul 06 23:00:23.965802 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:23.965774 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8332e1f-95cc-44a0-b784-5ed162244998-kube-api-access-gd9lt" (OuterVolumeSpecName: "kube-api-access-gd9lt") pod "a8332e1f-95cc-44a0-b784-5ed162244998" (UID: "a8332e1f-95cc-44a0-b784-5ed162244998"). InnerVolumeSpecName "kube-api-access-gd9lt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:24.065084 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:24.064972 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd9lt\" (UniqueName: \"kubernetes.io/projected/a8332e1f-95cc-44a0-b784-5ed162244998-kube-api-access-gd9lt\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:00:24.778624 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:24.778592 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-9dd27" Jul 06 23:00:24.778624 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:24.778606 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722980-9dd27" event={"ID":"a8332e1f-95cc-44a0-b784-5ed162244998","Type":"ContainerDied","Data":"e46e986d6a7f0719fbdf9aeb617d4f3b41e55c1405a490161b5f4b941dd92953"} Jul 06 23:00:24.778891 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:24.778654 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e46e986d6a7f0719fbdf9aeb617d4f3b41e55c1405a490161b5f4b941dd92953" Jul 06 23:00:26.470706 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:26.470661 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:00:36.362804 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:36.362761 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:00:46.669153 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:46.669113 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:00:57.071220 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:00:57.071178 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:01:07.174247 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:01:07.174160 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:01:12.212191 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:01:12.212163 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:01:12.212191 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:01:12.212176 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:01:34.578313 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:01:34.578277 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:01:45.270852 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:01:45.270815 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:02:20.061544 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:02:20.061489 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:02:29.563394 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:02:29.563354 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:02:39.576006 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:02:39.575917 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:02:46.572608 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:02:46.570143 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:02:56.577573 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:02:56.577528 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:03:05.670904 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:03:05.670862 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:03:17.569850 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:03:17.569813 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:03:26.870669 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:03:26.870625 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:03:49.984428 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:03:49.984387 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:04:01.376781 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:04:01.376746 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:04:24.274606 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:04:24.274571 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:04:34.074630 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:04:34.074586 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:04:49.386120 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:04:49.386079 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:05:00.776706 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:05:00.776670 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:05:09.479745 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:05:09.479699 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:05:18.662809 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:05:18.662764 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:05:28.176688 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:05:28.176648 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:06:12.256757 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:06:12.256727 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:06:12.258598 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:06:12.258576 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:07:16.668416 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:07:16.668323 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:07:26.766218 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:07:26.766177 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:07:36.975837 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:07:36.975801 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:07:47.772985 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:07:47.772946 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:07:59.166216 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:07:59.166170 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:08:09.876270 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:08:09.876221 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:08:18.467280 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:08:18.467240 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:08:28.773350 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:08:28.773301 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:08:40.375773 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:08:40.375678 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:08:50.275982 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:08:50.275938 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:09:03.678519 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:09:03.678458 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:09:23.883113 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:09:23.883070 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:09:30.977279 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:09:30.977241 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:09:40.671136 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:09:40.671091 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:09:53.174026 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:09:53.173989 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:10:08.678919 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:10:08.678807 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:10:19.669862 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:10:19.669823 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:10:28.366275 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:10:28.366234 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:10:37.866093 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:10:37.866053 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:10:48.277725 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:10:48.277687 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:10:57.465812 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:10:57.465775 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:11:10.169133 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:11:10.169096 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:11:12.294173 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:11:12.294144 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:11:12.298881 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:11:12.298855 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:11:18.672160 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:11:18.672118 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:11:29.383442 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:11:29.383409 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:11:40.768407 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:11:40.768315 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:11:51.569172 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:11:51.569128 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:11:59.472388 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:11:59.472344 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:12:10.382312 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:12:10.382268 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:12:21.568549 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:12:21.568493 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:12:33.870461 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:12:33.870421 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:12:46.273701 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:12:46.273669 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:12:55.168383 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:12:55.168343 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:13:04.475384 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:13:04.475293 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:13:21.477703 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:13:21.477662 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:13:32.173693 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:13:32.173652 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:13:40.367562 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:13:40.367513 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:13:48.474945 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:13:48.474902 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:15:00.143005 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.142965 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722995-5ncdp"] Jul 06 23:15:00.143488 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.143353 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8332e1f-95cc-44a0-b784-5ed162244998" containerName="cleanup" Jul 06 23:15:00.143488 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.143363 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8332e1f-95cc-44a0-b784-5ed162244998" containerName="cleanup" Jul 06 23:15:00.143488 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.143437 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8332e1f-95cc-44a0-b784-5ed162244998" containerName="cleanup" Jul 06 23:15:00.146492 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.146476 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722995-5ncdp" Jul 06 23:15:00.149101 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.149081 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-tjzvc\"" Jul 06 23:15:00.158313 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.158289 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722995-5ncdp"] Jul 06 23:15:00.214754 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.214718 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsz68\" (UniqueName: \"kubernetes.io/projected/e283238c-9baa-4ac3-88e2-8651aa823f92-kube-api-access-qsz68\") pod \"maas-api-key-cleanup-29722995-5ncdp\" (UID: \"e283238c-9baa-4ac3-88e2-8651aa823f92\") " pod="opendatahub/maas-api-key-cleanup-29722995-5ncdp" Jul 06 23:15:00.315589 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.315544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsz68\" (UniqueName: \"kubernetes.io/projected/e283238c-9baa-4ac3-88e2-8651aa823f92-kube-api-access-qsz68\") pod \"maas-api-key-cleanup-29722995-5ncdp\" (UID: \"e283238c-9baa-4ac3-88e2-8651aa823f92\") " pod="opendatahub/maas-api-key-cleanup-29722995-5ncdp" Jul 06 23:15:00.324919 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.324887 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsz68\" (UniqueName: \"kubernetes.io/projected/e283238c-9baa-4ac3-88e2-8651aa823f92-kube-api-access-qsz68\") pod \"maas-api-key-cleanup-29722995-5ncdp\" (UID: \"e283238c-9baa-4ac3-88e2-8651aa823f92\") " pod="opendatahub/maas-api-key-cleanup-29722995-5ncdp" Jul 06 23:15:00.457110 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.457078 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722995-5ncdp" Jul 06 23:15:00.600236 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:00.600205 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722995-5ncdp"] Jul 06 23:15:00.601737 ip-10-0-142-117 kubenswrapper[2568]: W0706 23:15:00.601704 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode283238c_9baa_4ac3_88e2_8651aa823f92.slice/crio-cdfb171a5474ac7c1e9b6d9b9f587f368aa04614f8fa1c258a1f30d580c39f1f WatchSource:0}: Error finding container cdfb171a5474ac7c1e9b6d9b9f587f368aa04614f8fa1c258a1f30d580c39f1f: Status 404 returned error can't find the container with id cdfb171a5474ac7c1e9b6d9b9f587f368aa04614f8fa1c258a1f30d580c39f1f Jul 06 23:15:01.580079 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:01.580028 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722995-5ncdp" event={"ID":"e283238c-9baa-4ac3-88e2-8651aa823f92","Type":"ContainerStarted","Data":"cec885c44dd9067bd310319b170ffac88a3b9f4c9c811882628369819785630e"} Jul 06 23:15:01.580577 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:01.580102 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722995-5ncdp" event={"ID":"e283238c-9baa-4ac3-88e2-8651aa823f92","Type":"ContainerStarted","Data":"cdfb171a5474ac7c1e9b6d9b9f587f368aa04614f8fa1c258a1f30d580c39f1f"} Jul 06 23:15:02.587740 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:02.587700 2568 generic.go:356] "Generic (PLEG): container finished" podID="e283238c-9baa-4ac3-88e2-8651aa823f92" containerID="cec885c44dd9067bd310319b170ffac88a3b9f4c9c811882628369819785630e" exitCode=0 Jul 06 23:15:02.588177 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:02.587744 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722995-5ncdp" event={"ID":"e283238c-9baa-4ac3-88e2-8651aa823f92","Type":"ContainerDied","Data":"cec885c44dd9067bd310319b170ffac88a3b9f4c9c811882628369819785630e"} Jul 06 23:15:03.727573 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:03.727545 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722995-5ncdp" Jul 06 23:15:03.849288 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:03.849191 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsz68\" (UniqueName: \"kubernetes.io/projected/e283238c-9baa-4ac3-88e2-8651aa823f92-kube-api-access-qsz68\") pod \"e283238c-9baa-4ac3-88e2-8651aa823f92\" (UID: \"e283238c-9baa-4ac3-88e2-8651aa823f92\") " Jul 06 23:15:03.851252 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:03.851225 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e283238c-9baa-4ac3-88e2-8651aa823f92-kube-api-access-qsz68" (OuterVolumeSpecName: "kube-api-access-qsz68") pod "e283238c-9baa-4ac3-88e2-8651aa823f92" (UID: "e283238c-9baa-4ac3-88e2-8651aa823f92"). InnerVolumeSpecName "kube-api-access-qsz68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:15:03.949808 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:03.949770 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsz68\" (UniqueName: \"kubernetes.io/projected/e283238c-9baa-4ac3-88e2-8651aa823f92-kube-api-access-qsz68\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:15:04.601390 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:04.601309 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722995-5ncdp" Jul 06 23:15:04.601560 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:04.601311 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722995-5ncdp" event={"ID":"e283238c-9baa-4ac3-88e2-8651aa823f92","Type":"ContainerDied","Data":"cdfb171a5474ac7c1e9b6d9b9f587f368aa04614f8fa1c258a1f30d580c39f1f"} Jul 06 23:15:04.601560 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:04.601440 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdfb171a5474ac7c1e9b6d9b9f587f368aa04614f8fa1c258a1f30d580c39f1f" Jul 06 23:15:10.073164 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:10.073126 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:15:18.763840 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:18.763800 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:15:31.975751 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:31.975704 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:15:40.074149 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:15:40.074113 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:16:11.466057 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:16:11.466015 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:16:12.332859 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:16:12.332822 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:16:12.339683 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:16:12.339655 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:16:28.069080 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:16:28.069043 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:16:46.663200 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:16:46.663163 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:16:58.072710 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:16:58.072668 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:17:37.667191 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:17:37.667091 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:18:45.880693 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:45.880645 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm"] Jul 06 23:18:45.881195 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:45.881131 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e283238c-9baa-4ac3-88e2-8651aa823f92" containerName="cleanup" Jul 06 23:18:45.881195 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:45.881146 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e283238c-9baa-4ac3-88e2-8651aa823f92" containerName="cleanup" Jul 06 23:18:45.881285 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:45.881235 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e283238c-9baa-4ac3-88e2-8651aa823f92" containerName="cleanup" Jul 06 23:18:45.884331 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:45.884309 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:45.886824 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:45.886799 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-639686-serving-cert\"" Jul 06 23:18:45.887055 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:45.886868 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-tjzvc\"" Jul 06 23:18:45.900270 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:45.900243 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm"] Jul 06 23:18:45.965762 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:45.965732 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh9v7\" (UniqueName: \"kubernetes.io/projected/1836ca18-013c-42fe-8102-5f708d3cd36b-kube-api-access-gh9v7\") pod \"maas-api-e2e-inf-b-639686-55498f4d9-p46nm\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:45.965932 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:45.965795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1836ca18-013c-42fe-8102-5f708d3cd36b-maas-api-tls\") pod \"maas-api-e2e-inf-b-639686-55498f4d9-p46nm\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:45.965932 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:45.965817 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1836ca18-013c-42fe-8102-5f708d3cd36b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-639686-55498f4d9-p46nm\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:46.066538 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:46.066476 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9v7\" (UniqueName: \"kubernetes.io/projected/1836ca18-013c-42fe-8102-5f708d3cd36b-kube-api-access-gh9v7\") pod \"maas-api-e2e-inf-b-639686-55498f4d9-p46nm\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:46.066749 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:46.066596 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1836ca18-013c-42fe-8102-5f708d3cd36b-maas-api-tls\") pod \"maas-api-e2e-inf-b-639686-55498f4d9-p46nm\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:46.066749 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:46.066622 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1836ca18-013c-42fe-8102-5f708d3cd36b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-639686-55498f4d9-p46nm\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:46.066749 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:18:46.066733 2568 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-639686-serving-cert: secret "maas-api-e2e-inf-b-639686-serving-cert" not found Jul 06 23:18:46.066918 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:18:46.066793 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1836ca18-013c-42fe-8102-5f708d3cd36b-maas-api-tls podName:1836ca18-013c-42fe-8102-5f708d3cd36b nodeName:}" failed. No retries permitted until 2026-07-06 23:18:46.56677808 +0000 UTC m=+1954.877946227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1836ca18-013c-42fe-8102-5f708d3cd36b-maas-api-tls") pod "maas-api-e2e-inf-b-639686-55498f4d9-p46nm" (UID: "1836ca18-013c-42fe-8102-5f708d3cd36b") : secret "maas-api-e2e-inf-b-639686-serving-cert" not found Jul 06 23:18:46.067341 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:46.067318 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1836ca18-013c-42fe-8102-5f708d3cd36b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-639686-55498f4d9-p46nm\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:46.074580 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:46.074558 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh9v7\" (UniqueName: \"kubernetes.io/projected/1836ca18-013c-42fe-8102-5f708d3cd36b-kube-api-access-gh9v7\") pod \"maas-api-e2e-inf-b-639686-55498f4d9-p46nm\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:46.083566 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:46.083473 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:18:46.571341 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:46.571298 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1836ca18-013c-42fe-8102-5f708d3cd36b-maas-api-tls\") pod \"maas-api-e2e-inf-b-639686-55498f4d9-p46nm\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:46.573973 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:46.573941 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1836ca18-013c-42fe-8102-5f708d3cd36b-maas-api-tls\") pod \"maas-api-e2e-inf-b-639686-55498f4d9-p46nm\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:46.795402 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:46.795357 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:46.936485 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:46.936457 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm"] Jul 06 23:18:46.938548 ip-10-0-142-117 kubenswrapper[2568]: W0706 23:18:46.938518 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1836ca18_013c_42fe_8102_5f708d3cd36b.slice/crio-ed12eda73f2a5ad715d486c4eaab2c6bb3412f577bb98f9677e6481614f60faf WatchSource:0}: Error finding container ed12eda73f2a5ad715d486c4eaab2c6bb3412f577bb98f9677e6481614f60faf: Status 404 returned error can't find the container with id ed12eda73f2a5ad715d486c4eaab2c6bb3412f577bb98f9677e6481614f60faf Jul 06 23:18:46.939871 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:46.939855 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:18:47.860193 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:47.860151 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" event={"ID":"1836ca18-013c-42fe-8102-5f708d3cd36b","Type":"ContainerStarted","Data":"ed12eda73f2a5ad715d486c4eaab2c6bb3412f577bb98f9677e6481614f60faf"} Jul 06 23:18:49.876235 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:49.876197 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" event={"ID":"1836ca18-013c-42fe-8102-5f708d3cd36b","Type":"ContainerStarted","Data":"4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb"} Jul 06 23:18:49.876664 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:49.876321 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:49.895407 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:49.895355 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" podStartSLOduration=2.7890725769999998 podStartE2EDuration="4.895339586s" totalImagesPullingTime="2.106267009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:18:49.892596578 +0000 UTC m=+1958.203764746" watchObservedRunningTime="2026-07-06 23:18:49.895339586 +0000 UTC m=+1958.206507753" Jul 06 23:18:55.887629 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:55.887595 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:18:58.776004 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:18:58.775963 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:19:26.080744 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:19:26.080709 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:19:41.980952 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:19:41.980918 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:19:54.181758 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:19:54.181722 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:20:33.782549 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:33.782448 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm"] Jul 06 23:20:33.783025 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:33.782702 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" podUID="1836ca18-013c-42fe-8102-5f708d3cd36b" containerName="maas-api" containerID="cri-o://4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb" gracePeriod=30 Jul 06 23:20:34.032612 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.032546 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:20:34.164428 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.164388 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1836ca18-013c-42fe-8102-5f708d3cd36b-openshift-service-ca\") pod \"1836ca18-013c-42fe-8102-5f708d3cd36b\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " Jul 06 23:20:34.164643 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.164446 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh9v7\" (UniqueName: \"kubernetes.io/projected/1836ca18-013c-42fe-8102-5f708d3cd36b-kube-api-access-gh9v7\") pod \"1836ca18-013c-42fe-8102-5f708d3cd36b\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " Jul 06 23:20:34.164643 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.164538 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1836ca18-013c-42fe-8102-5f708d3cd36b-maas-api-tls\") pod \"1836ca18-013c-42fe-8102-5f708d3cd36b\" (UID: \"1836ca18-013c-42fe-8102-5f708d3cd36b\") " Jul 06 23:20:34.164805 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.164772 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1836ca18-013c-42fe-8102-5f708d3cd36b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1836ca18-013c-42fe-8102-5f708d3cd36b" (UID: "1836ca18-013c-42fe-8102-5f708d3cd36b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:20:34.164935 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.164915 2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1836ca18-013c-42fe-8102-5f708d3cd36b-openshift-service-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:20:34.166657 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.166624 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1836ca18-013c-42fe-8102-5f708d3cd36b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1836ca18-013c-42fe-8102-5f708d3cd36b" (UID: "1836ca18-013c-42fe-8102-5f708d3cd36b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:20:34.166766 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.166719 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1836ca18-013c-42fe-8102-5f708d3cd36b-kube-api-access-gh9v7" (OuterVolumeSpecName: "kube-api-access-gh9v7") pod "1836ca18-013c-42fe-8102-5f708d3cd36b" (UID: "1836ca18-013c-42fe-8102-5f708d3cd36b"). InnerVolumeSpecName "kube-api-access-gh9v7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:20:34.266373 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.266333 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh9v7\" (UniqueName: \"kubernetes.io/projected/1836ca18-013c-42fe-8102-5f708d3cd36b-kube-api-access-gh9v7\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:20:34.266373 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.266368 2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1836ca18-013c-42fe-8102-5f708d3cd36b-maas-api-tls\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:20:34.452969 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.452926 2568 generic.go:356] "Generic (PLEG): container finished" podID="1836ca18-013c-42fe-8102-5f708d3cd36b" containerID="4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb" exitCode=0 Jul 06 23:20:34.452969 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.452970 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" Jul 06 23:20:34.453233 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.452982 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" event={"ID":"1836ca18-013c-42fe-8102-5f708d3cd36b","Type":"ContainerDied","Data":"4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb"} Jul 06 23:20:34.453233 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.453046 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm" event={"ID":"1836ca18-013c-42fe-8102-5f708d3cd36b","Type":"ContainerDied","Data":"ed12eda73f2a5ad715d486c4eaab2c6bb3412f577bb98f9677e6481614f60faf"} Jul 06 23:20:34.453233 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.453070 2568 scope.go:117] "RemoveContainer" containerID="4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb" Jul 06 23:20:34.462649 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.462632 2568 scope.go:117] "RemoveContainer" containerID="4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb" Jul 06 23:20:34.462942 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:20:34.462917 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb\": container with ID starting with 4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb not found: ID does not exist" containerID="4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb" Jul 06 23:20:34.462982 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.462952 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb"} err="failed to get container status \"4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb\": rpc error: code = NotFound desc = could not find container \"4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb\": container with ID starting with 4cf1abf04a7e9c0953222285c5e8c16bcab355258e9ed04e5579fae0415b61cb not found: ID does not exist" Jul 06 23:20:34.471180 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.471149 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm"] Jul 06 23:20:34.476686 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:34.476661 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-639686-55498f4d9-p46nm"] Jul 06 23:20:36.273907 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:36.273867 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1836ca18-013c-42fe-8102-5f708d3cd36b" path="/var/lib/kubelet/pods/1836ca18-013c-42fe-8102-5f708d3cd36b/volumes" Jul 06 23:20:36.577456 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:36.577357 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:20:43.819245 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:43.819210 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8"] Jul 06 23:20:43.819647 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:43.819637 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1836ca18-013c-42fe-8102-5f708d3cd36b" containerName="maas-api" Jul 06 23:20:43.819689 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:43.819651 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1836ca18-013c-42fe-8102-5f708d3cd36b" containerName="maas-api" Jul 06 23:20:43.819724 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:43.819719 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1836ca18-013c-42fe-8102-5f708d3cd36b" containerName="maas-api" Jul 06 23:20:43.824064 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:43.824043 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:43.827033 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:43.827008 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-e0bef8-serving-cert\"" Jul 06 23:20:43.827140 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:43.827053 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-tjzvc\"" Jul 06 23:20:43.835906 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:43.835878 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8"] Jul 06 23:20:43.951915 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:43.951871 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef2816a-0a76-4530-aa39-7c0be584db53-maas-api-tls\") pod \"maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:43.952108 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:43.951981 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef2816a-0a76-4530-aa39-7c0be584db53-openshift-service-ca\") pod \"maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:43.952108 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:43.952027 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62ldk\" (UniqueName: \"kubernetes.io/projected/8ef2816a-0a76-4530-aa39-7c0be584db53-kube-api-access-62ldk\") pod \"maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:44.053463 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:44.053414 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62ldk\" (UniqueName: \"kubernetes.io/projected/8ef2816a-0a76-4530-aa39-7c0be584db53-kube-api-access-62ldk\") pod \"maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:44.053714 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:44.053494 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef2816a-0a76-4530-aa39-7c0be584db53-maas-api-tls\") pod \"maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:44.053714 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:44.053585 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef2816a-0a76-4530-aa39-7c0be584db53-openshift-service-ca\") pod \"maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:44.053714 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:20:44.053600 2568 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-e0bef8-serving-cert: secret "maas-api-e2e-api-a-e0bef8-serving-cert" not found Jul 06 23:20:44.053714 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:20:44.053666 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef2816a-0a76-4530-aa39-7c0be584db53-maas-api-tls podName:8ef2816a-0a76-4530-aa39-7c0be584db53 nodeName:}" failed. No retries permitted until 2026-07-06 23:20:44.55364932 +0000 UTC m=+2072.864817479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8ef2816a-0a76-4530-aa39-7c0be584db53-maas-api-tls") pod "maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" (UID: "8ef2816a-0a76-4530-aa39-7c0be584db53") : secret "maas-api-e2e-api-a-e0bef8-serving-cert" not found Jul 06 23:20:44.054304 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:44.054279 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef2816a-0a76-4530-aa39-7c0be584db53-openshift-service-ca\") pod \"maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:44.072895 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:44.072821 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62ldk\" (UniqueName: \"kubernetes.io/projected/8ef2816a-0a76-4530-aa39-7c0be584db53-kube-api-access-62ldk\") pod \"maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:44.558965 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:44.558924 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef2816a-0a76-4530-aa39-7c0be584db53-maas-api-tls\") pod \"maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:44.561421 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:44.561388 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef2816a-0a76-4530-aa39-7c0be584db53-maas-api-tls\") pod \"maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:44.735764 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:44.735721 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:44.888542 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:44.888491 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8"] Jul 06 23:20:44.892000 ip-10-0-142-117 kubenswrapper[2568]: W0706 23:20:44.891972 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef2816a_0a76_4530_aa39_7c0be584db53.slice/crio-d35db13f7c6ec5171942aa43f4388b4a76b83cbdabf3f760236d9651ad56e95d WatchSource:0}: Error finding container d35db13f7c6ec5171942aa43f4388b4a76b83cbdabf3f760236d9651ad56e95d: Status 404 returned error can't find the container with id d35db13f7c6ec5171942aa43f4388b4a76b83cbdabf3f760236d9651ad56e95d Jul 06 23:20:45.521489 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:45.521439 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" event={"ID":"8ef2816a-0a76-4530-aa39-7c0be584db53","Type":"ContainerStarted","Data":"82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80"} Jul 06 23:20:45.521746 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:45.521525 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" event={"ID":"8ef2816a-0a76-4530-aa39-7c0be584db53","Type":"ContainerStarted","Data":"d35db13f7c6ec5171942aa43f4388b4a76b83cbdabf3f760236d9651ad56e95d"} Jul 06 23:20:45.521746 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:45.521656 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:45.541277 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:45.541221 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" podStartSLOduration=2.079689215 podStartE2EDuration="2.54120557s" totalImagesPullingTime="461.516355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:20:45.539492094 +0000 UTC m=+2073.850660260" watchObservedRunningTime="2026-07-06 23:20:45.54120557 +0000 UTC m=+2073.852373756" Jul 06 23:20:49.586705 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:49.586666 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:20:51.535321 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:51.535290 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:20:52.519294 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.519255 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx"] Jul 06 23:20:52.523037 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.523015 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:52.525914 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.525890 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-d792b0-serving-cert\"" Jul 06 23:20:52.535396 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.535363 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx"] Jul 06 23:20:52.641423 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.641372 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b35e5e-43ff-4aef-9e7b-113f1e04b084-openshift-service-ca\") pod \"maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:52.641633 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.641526 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gzhs\" (UniqueName: \"kubernetes.io/projected/48b35e5e-43ff-4aef-9e7b-113f1e04b084-kube-api-access-9gzhs\") pod \"maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:52.641633 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.641575 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b35e5e-43ff-4aef-9e7b-113f1e04b084-maas-api-tls\") pod \"maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:52.742930 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.742879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b35e5e-43ff-4aef-9e7b-113f1e04b084-openshift-service-ca\") pod \"maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:52.743112 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.742956 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gzhs\" (UniqueName: \"kubernetes.io/projected/48b35e5e-43ff-4aef-9e7b-113f1e04b084-kube-api-access-9gzhs\") pod \"maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:52.743112 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.742983 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b35e5e-43ff-4aef-9e7b-113f1e04b084-maas-api-tls\") pod \"maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:52.743191 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:20:52.743119 2568 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-d792b0-serving-cert: secret "maas-api-e2e-api-b-d792b0-serving-cert" not found Jul 06 23:20:52.743191 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:20:52.743186 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b35e5e-43ff-4aef-9e7b-113f1e04b084-maas-api-tls podName:48b35e5e-43ff-4aef-9e7b-113f1e04b084 nodeName:}" failed. No retries permitted until 2026-07-06 23:20:53.243168316 +0000 UTC m=+2081.554336461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/48b35e5e-43ff-4aef-9e7b-113f1e04b084-maas-api-tls") pod "maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" (UID: "48b35e5e-43ff-4aef-9e7b-113f1e04b084") : secret "maas-api-e2e-api-b-d792b0-serving-cert" not found Jul 06 23:20:52.743637 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.743617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b35e5e-43ff-4aef-9e7b-113f1e04b084-openshift-service-ca\") pod \"maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:52.765245 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:52.765212 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gzhs\" (UniqueName: \"kubernetes.io/projected/48b35e5e-43ff-4aef-9e7b-113f1e04b084-kube-api-access-9gzhs\") pod \"maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:53.248222 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:53.248179 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b35e5e-43ff-4aef-9e7b-113f1e04b084-maas-api-tls\") pod \"maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:53.250758 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:53.250722 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b35e5e-43ff-4aef-9e7b-113f1e04b084-maas-api-tls\") pod \"maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:53.436378 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:53.436332 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:53.589392 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:53.589359 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx"] Jul 06 23:20:53.591234 ip-10-0-142-117 kubenswrapper[2568]: W0706 23:20:53.591201 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b35e5e_43ff_4aef_9e7b_113f1e04b084.slice/crio-0ffbb995653030a2b93a25da86658747e53702b36d0141e8d7297b851bdf34e9 WatchSource:0}: Error finding container 0ffbb995653030a2b93a25da86658747e53702b36d0141e8d7297b851bdf34e9: Status 404 returned error can't find the container with id 0ffbb995653030a2b93a25da86658747e53702b36d0141e8d7297b851bdf34e9 Jul 06 23:20:54.578760 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:54.578716 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" event={"ID":"48b35e5e-43ff-4aef-9e7b-113f1e04b084","Type":"ContainerStarted","Data":"2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b"} Jul 06 23:20:54.578982 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:54.578851 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:20:54.578982 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:54.578872 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" event={"ID":"48b35e5e-43ff-4aef-9e7b-113f1e04b084","Type":"ContainerStarted","Data":"0ffbb995653030a2b93a25da86658747e53702b36d0141e8d7297b851bdf34e9"} Jul 06 23:20:54.595782 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:54.595728 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" podStartSLOduration=2.161003527 podStartE2EDuration="2.595711036s" totalImagesPullingTime="434.707509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:20:54.594078807 +0000 UTC m=+2082.905246973" watchObservedRunningTime="2026-07-06 23:20:54.595711036 +0000 UTC m=+2082.906879206" Jul 06 23:20:59.708900 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:20:59.708849 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:21:00.589524 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:00.589471 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:21:05.597718 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:05.594201 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8"] Jul 06 23:21:05.597718 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:05.594541 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" podUID="8ef2816a-0a76-4530-aa39-7c0be584db53" containerName="maas-api" containerID="cri-o://82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80" gracePeriod=30 Jul 06 23:21:05.852796 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:05.852728 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:21:05.958562 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:05.958488 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef2816a-0a76-4530-aa39-7c0be584db53-maas-api-tls\") pod \"8ef2816a-0a76-4530-aa39-7c0be584db53\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " Jul 06 23:21:05.958735 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:05.958607 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef2816a-0a76-4530-aa39-7c0be584db53-openshift-service-ca\") pod \"8ef2816a-0a76-4530-aa39-7c0be584db53\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " Jul 06 23:21:05.958735 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:05.958657 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62ldk\" (UniqueName: \"kubernetes.io/projected/8ef2816a-0a76-4530-aa39-7c0be584db53-kube-api-access-62ldk\") pod \"8ef2816a-0a76-4530-aa39-7c0be584db53\" (UID: \"8ef2816a-0a76-4530-aa39-7c0be584db53\") " Jul 06 23:21:05.958943 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:05.958907 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ef2816a-0a76-4530-aa39-7c0be584db53-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ef2816a-0a76-4530-aa39-7c0be584db53" (UID: "8ef2816a-0a76-4530-aa39-7c0be584db53"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:21:05.960847 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:05.960805 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ef2816a-0a76-4530-aa39-7c0be584db53-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ef2816a-0a76-4530-aa39-7c0be584db53" (UID: "8ef2816a-0a76-4530-aa39-7c0be584db53"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:21:05.960847 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:05.960819 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ef2816a-0a76-4530-aa39-7c0be584db53-kube-api-access-62ldk" (OuterVolumeSpecName: "kube-api-access-62ldk") pod "8ef2816a-0a76-4530-aa39-7c0be584db53" (UID: "8ef2816a-0a76-4530-aa39-7c0be584db53"). InnerVolumeSpecName "kube-api-access-62ldk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:21:06.060337 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.060293 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62ldk\" (UniqueName: \"kubernetes.io/projected/8ef2816a-0a76-4530-aa39-7c0be584db53-kube-api-access-62ldk\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:21:06.060337 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.060329 2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef2816a-0a76-4530-aa39-7c0be584db53-maas-api-tls\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:21:06.060337 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.060339 2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef2816a-0a76-4530-aa39-7c0be584db53-openshift-service-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:21:06.649014 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.648922 2568 generic.go:356] "Generic (PLEG): container finished" podID="8ef2816a-0a76-4530-aa39-7c0be584db53" containerID="82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80" exitCode=0 Jul 06 23:21:06.649014 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.648967 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" Jul 06 23:21:06.649450 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.649009 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" event={"ID":"8ef2816a-0a76-4530-aa39-7c0be584db53","Type":"ContainerDied","Data":"82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80"} Jul 06 23:21:06.649450 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.649064 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8" event={"ID":"8ef2816a-0a76-4530-aa39-7c0be584db53","Type":"ContainerDied","Data":"d35db13f7c6ec5171942aa43f4388b4a76b83cbdabf3f760236d9651ad56e95d"} Jul 06 23:21:06.649450 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.649089 2568 scope.go:117] "RemoveContainer" containerID="82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80" Jul 06 23:21:06.658615 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.658592 2568 scope.go:117] "RemoveContainer" containerID="82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80" Jul 06 23:21:06.658981 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:21:06.658959 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80\": container with ID starting with 82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80 not found: ID does not exist" containerID="82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80" Jul 06 23:21:06.659044 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.658990 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80"} err="failed to get container status \"82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80\": rpc error: code = NotFound desc = could not find container \"82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80\": container with ID starting with 82c52f025def1b25471fce818e5bfa23fd66a162d79d3fd7972e9afc0f084c80 not found: ID does not exist" Jul 06 23:21:06.683391 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.683356 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8"] Jul 06 23:21:06.698311 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:06.698267 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e0bef8-fbbc49ff-tv2z8"] Jul 06 23:21:08.273774 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:08.273733 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ef2816a-0a76-4530-aa39-7c0be584db53" path="/var/lib/kubelet/pods/8ef2816a-0a76-4530-aa39-7c0be584db53/volumes" Jul 06 23:21:12.375868 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:12.375834 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:21:12.382612 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:12.382586 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:21:12.701891 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:12.701852 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx"] Jul 06 23:21:12.702195 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:12.702140 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" podUID="48b35e5e-43ff-4aef-9e7b-113f1e04b084" containerName="maas-api" containerID="cri-o://2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b" gracePeriod=30 Jul 06 23:21:12.967771 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:12.967690 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:21:13.028652 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.028621 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b35e5e-43ff-4aef-9e7b-113f1e04b084-openshift-service-ca\") pod \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " Jul 06 23:21:13.028822 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.028693 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b35e5e-43ff-4aef-9e7b-113f1e04b084-maas-api-tls\") pod \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " Jul 06 23:21:13.028822 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.028771 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gzhs\" (UniqueName: \"kubernetes.io/projected/48b35e5e-43ff-4aef-9e7b-113f1e04b084-kube-api-access-9gzhs\") pod \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\" (UID: \"48b35e5e-43ff-4aef-9e7b-113f1e04b084\") " Jul 06 23:21:13.029076 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.029047 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b35e5e-43ff-4aef-9e7b-113f1e04b084-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48b35e5e-43ff-4aef-9e7b-113f1e04b084" (UID: "48b35e5e-43ff-4aef-9e7b-113f1e04b084"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:21:13.030929 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.030900 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b35e5e-43ff-4aef-9e7b-113f1e04b084-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48b35e5e-43ff-4aef-9e7b-113f1e04b084" (UID: "48b35e5e-43ff-4aef-9e7b-113f1e04b084"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:21:13.031043 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.030939 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b35e5e-43ff-4aef-9e7b-113f1e04b084-kube-api-access-9gzhs" (OuterVolumeSpecName: "kube-api-access-9gzhs") pod "48b35e5e-43ff-4aef-9e7b-113f1e04b084" (UID: "48b35e5e-43ff-4aef-9e7b-113f1e04b084"). InnerVolumeSpecName "kube-api-access-9gzhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:21:13.129939 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.129898 2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b35e5e-43ff-4aef-9e7b-113f1e04b084-openshift-service-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:21:13.129939 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.129934 2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b35e5e-43ff-4aef-9e7b-113f1e04b084-maas-api-tls\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:21:13.129939 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.129944 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gzhs\" (UniqueName: \"kubernetes.io/projected/48b35e5e-43ff-4aef-9e7b-113f1e04b084-kube-api-access-9gzhs\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:21:13.696391 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.696352 2568 generic.go:356] "Generic (PLEG): container finished" podID="48b35e5e-43ff-4aef-9e7b-113f1e04b084" containerID="2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b" exitCode=0 Jul 06 23:21:13.696391 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.696391 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" Jul 06 23:21:13.696918 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.696422 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" event={"ID":"48b35e5e-43ff-4aef-9e7b-113f1e04b084","Type":"ContainerDied","Data":"2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b"} Jul 06 23:21:13.696918 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.696470 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx" event={"ID":"48b35e5e-43ff-4aef-9e7b-113f1e04b084","Type":"ContainerDied","Data":"0ffbb995653030a2b93a25da86658747e53702b36d0141e8d7297b851bdf34e9"} Jul 06 23:21:13.696918 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.696523 2568 scope.go:117] "RemoveContainer" containerID="2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b" Jul 06 23:21:13.706236 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.706215 2568 scope.go:117] "RemoveContainer" containerID="2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b" Jul 06 23:21:13.706613 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:21:13.706591 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b\": container with ID starting with 2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b not found: ID does not exist" containerID="2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b" Jul 06 23:21:13.706674 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.706623 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b"} err="failed to get container status \"2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b\": rpc error: code = NotFound desc = could not find container \"2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b\": container with ID starting with 2f8e275d7e5b3152ac64bfa0109415303fdbf756493e01de4c6cf9e7a6a86c4b not found: ID does not exist" Jul 06 23:21:13.719091 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.719049 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx"] Jul 06 23:21:13.722919 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:13.722889 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d792b0-7559bbcd7b-wrdtx"] Jul 06 23:21:14.274200 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:14.274164 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48b35e5e-43ff-4aef-9e7b-113f1e04b084" path="/var/lib/kubelet/pods/48b35e5e-43ff-4aef-9e7b-113f1e04b084/volumes" Jul 06 23:21:17.196268 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:17.196228 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:21:23.041004 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.040968 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg"] Jul 06 23:21:23.041566 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.041417 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ef2816a-0a76-4530-aa39-7c0be584db53" containerName="maas-api" Jul 06 23:21:23.041566 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.041437 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ef2816a-0a76-4530-aa39-7c0be584db53" containerName="maas-api" Jul 06 23:21:23.041566 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.041463 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b35e5e-43ff-4aef-9e7b-113f1e04b084" containerName="maas-api" Jul 06 23:21:23.041566 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.041472 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b35e5e-43ff-4aef-9e7b-113f1e04b084" containerName="maas-api" Jul 06 23:21:23.041788 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.041589 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b35e5e-43ff-4aef-9e7b-113f1e04b084" containerName="maas-api" Jul 06 23:21:23.041788 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.041609 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ef2816a-0a76-4530-aa39-7c0be584db53" containerName="maas-api" Jul 06 23:21:23.044713 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.044696 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:23.047081 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.047062 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-tjzvc\"" Jul 06 23:21:23.047376 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.047357 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-669fee-serving-cert\"" Jul 06 23:21:23.062171 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.062136 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg"] Jul 06 23:21:23.123463 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.123415 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86f17a08-6094-412e-9eab-f46398659616-maas-api-tls\") pod \"maas-api-e2e-shared-a-669fee-54759f459-bzrrg\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:23.123463 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.123470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86f17a08-6094-412e-9eab-f46398659616-openshift-service-ca\") pod \"maas-api-e2e-shared-a-669fee-54759f459-bzrrg\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:23.123726 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.123538 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p99xf\" (UniqueName: \"kubernetes.io/projected/86f17a08-6094-412e-9eab-f46398659616-kube-api-access-p99xf\") pod \"maas-api-e2e-shared-a-669fee-54759f459-bzrrg\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:23.224633 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.224589 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86f17a08-6094-412e-9eab-f46398659616-openshift-service-ca\") pod \"maas-api-e2e-shared-a-669fee-54759f459-bzrrg\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:23.224823 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.224652 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p99xf\" (UniqueName: \"kubernetes.io/projected/86f17a08-6094-412e-9eab-f46398659616-kube-api-access-p99xf\") pod \"maas-api-e2e-shared-a-669fee-54759f459-bzrrg\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:23.224823 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.224748 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86f17a08-6094-412e-9eab-f46398659616-maas-api-tls\") pod \"maas-api-e2e-shared-a-669fee-54759f459-bzrrg\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:23.224902 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:21:23.224854 2568 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-669fee-serving-cert: secret "maas-api-e2e-shared-a-669fee-serving-cert" not found Jul 06 23:21:23.224975 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:21:23.224950 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86f17a08-6094-412e-9eab-f46398659616-maas-api-tls podName:86f17a08-6094-412e-9eab-f46398659616 nodeName:}" failed. No retries permitted until 2026-07-06 23:21:23.724926762 +0000 UTC m=+2112.036094909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/86f17a08-6094-412e-9eab-f46398659616-maas-api-tls") pod "maas-api-e2e-shared-a-669fee-54759f459-bzrrg" (UID: "86f17a08-6094-412e-9eab-f46398659616") : secret "maas-api-e2e-shared-a-669fee-serving-cert" not found Jul 06 23:21:23.225326 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.225306 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86f17a08-6094-412e-9eab-f46398659616-openshift-service-ca\") pod \"maas-api-e2e-shared-a-669fee-54759f459-bzrrg\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:23.239133 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.239095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p99xf\" (UniqueName: \"kubernetes.io/projected/86f17a08-6094-412e-9eab-f46398659616-kube-api-access-p99xf\") pod \"maas-api-e2e-shared-a-669fee-54759f459-bzrrg\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:23.731424 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.731379 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86f17a08-6094-412e-9eab-f46398659616-maas-api-tls\") pod \"maas-api-e2e-shared-a-669fee-54759f459-bzrrg\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:23.733869 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.733847 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86f17a08-6094-412e-9eab-f46398659616-maas-api-tls\") pod \"maas-api-e2e-shared-a-669fee-54759f459-bzrrg\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:23.955460 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:23.955414 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:24.098200 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:24.098158 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg"] Jul 06 23:21:24.099419 ip-10-0-142-117 kubenswrapper[2568]: W0706 23:21:24.099392 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f17a08_6094_412e_9eab_f46398659616.slice/crio-46df83f2da06630bbe3eba713df762ba0f9fd6eb70fd1b7ea0761f0704fce2b6 WatchSource:0}: Error finding container 46df83f2da06630bbe3eba713df762ba0f9fd6eb70fd1b7ea0761f0704fce2b6: Status 404 returned error can't find the container with id 46df83f2da06630bbe3eba713df762ba0f9fd6eb70fd1b7ea0761f0704fce2b6 Jul 06 23:21:24.773474 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:24.773436 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" event={"ID":"86f17a08-6094-412e-9eab-f46398659616","Type":"ContainerStarted","Data":"46df83f2da06630bbe3eba713df762ba0f9fd6eb70fd1b7ea0761f0704fce2b6"} Jul 06 23:21:25.779903 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:25.779866 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" event={"ID":"86f17a08-6094-412e-9eab-f46398659616","Type":"ContainerStarted","Data":"2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de"} Jul 06 23:21:25.780359 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:25.779956 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:25.803354 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:25.803299 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" podStartSLOduration=2.150496626 podStartE2EDuration="2.803281259s" totalImagesPullingTime="652.784633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:21:25.801824315 +0000 UTC m=+2114.112992482" watchObservedRunningTime="2026-07-06 23:21:25.803281259 +0000 UTC m=+2114.114449424" Jul 06 23:21:28.204380 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:28.204332 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:21:30.733491 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:30.733453 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2"] Jul 06 23:21:30.737622 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:30.737595 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:30.740182 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:30.740155 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-d3a5b8-serving-cert\"" Jul 06 23:21:30.749491 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:30.749463 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2"] Jul 06 23:21:30.899144 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:30.899108 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a16584d-7b4d-4070-9d60-38510781dc57-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:30.899144 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:30.899155 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a16584d-7b4d-4070-9d60-38510781dc57-maas-api-tls\") pod \"maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:30.899430 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:30.899198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxw8l\" (UniqueName: \"kubernetes.io/projected/2a16584d-7b4d-4070-9d60-38510781dc57-kube-api-access-pxw8l\") pod \"maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:31.000234 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:31.000130 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a16584d-7b4d-4070-9d60-38510781dc57-maas-api-tls\") pod \"maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:31.000234 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:31.000183 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxw8l\" (UniqueName: \"kubernetes.io/projected/2a16584d-7b4d-4070-9d60-38510781dc57-kube-api-access-pxw8l\") pod \"maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:31.000437 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:31.000253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a16584d-7b4d-4070-9d60-38510781dc57-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:31.000437 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:21:31.000305 2568 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-d3a5b8-serving-cert: secret "maas-api-e2e-shared-b-d3a5b8-serving-cert" not found Jul 06 23:21:31.000437 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:21:31.000388 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a16584d-7b4d-4070-9d60-38510781dc57-maas-api-tls podName:2a16584d-7b4d-4070-9d60-38510781dc57 nodeName:}" failed. No retries permitted until 2026-07-06 23:21:31.500368465 +0000 UTC m=+2119.811536629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2a16584d-7b4d-4070-9d60-38510781dc57-maas-api-tls") pod "maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" (UID: "2a16584d-7b4d-4070-9d60-38510781dc57") : secret "maas-api-e2e-shared-b-d3a5b8-serving-cert" not found Jul 06 23:21:31.000943 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:31.000924 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a16584d-7b4d-4070-9d60-38510781dc57-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:31.012807 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:31.012780 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxw8l\" (UniqueName: \"kubernetes.io/projected/2a16584d-7b4d-4070-9d60-38510781dc57-kube-api-access-pxw8l\") pod \"maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:31.506063 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:31.506014 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a16584d-7b4d-4070-9d60-38510781dc57-maas-api-tls\") pod \"maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:31.508543 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:31.508493 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a16584d-7b4d-4070-9d60-38510781dc57-maas-api-tls\") pod \"maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:31.650228 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:31.650181 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:31.791154 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:31.791068 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:21:31.808241 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:31.808204 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2"] Jul 06 23:21:31.809860 ip-10-0-142-117 kubenswrapper[2568]: W0706 23:21:31.809817 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a16584d_7b4d_4070_9d60_38510781dc57.slice/crio-1c776de0d35762d1914a8cb77ed5fe2a07896f103522ee3fc302a41b9c19638f WatchSource:0}: Error finding container 1c776de0d35762d1914a8cb77ed5fe2a07896f103522ee3fc302a41b9c19638f: Status 404 returned error can't find the container with id 1c776de0d35762d1914a8cb77ed5fe2a07896f103522ee3fc302a41b9c19638f Jul 06 23:21:32.822700 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:32.822662 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" event={"ID":"2a16584d-7b4d-4070-9d60-38510781dc57","Type":"ContainerStarted","Data":"37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280"} Jul 06 23:21:32.823204 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:32.822715 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" event={"ID":"2a16584d-7b4d-4070-9d60-38510781dc57","Type":"ContainerStarted","Data":"1c776de0d35762d1914a8cb77ed5fe2a07896f103522ee3fc302a41b9c19638f"} Jul 06 23:21:32.823204 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:32.822808 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:32.842547 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:32.842470 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" podStartSLOduration=2.5238031640000003 podStartE2EDuration="2.842451708s" totalImagesPullingTime="318.648544ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:21:32.841361933 +0000 UTC m=+2121.152530102" watchObservedRunningTime="2026-07-06 23:21:32.842451708 +0000 UTC m=+2121.153619873" Jul 06 23:21:38.834525 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:38.834470 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:21:41.079321 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:41.079284 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:21:49.979461 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:49.979420 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:21:53.938932 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:53.938841 2568 generic.go:356] "Generic (PLEG): container finished" podID="0bbe4855-c1e0-4dea-9db2-ce8d91176651" containerID="7df9551bfbe82cf81aaa60ed82f547b70fbff71665e2a3cb3b32e534744f0574" exitCode=1 Jul 06 23:21:53.938932 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:53.938918 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" event={"ID":"0bbe4855-c1e0-4dea-9db2-ce8d91176651","Type":"ContainerDied","Data":"7df9551bfbe82cf81aaa60ed82f547b70fbff71665e2a3cb3b32e534744f0574"} Jul 06 23:21:53.939356 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:53.939256 2568 scope.go:117] "RemoveContainer" containerID="7df9551bfbe82cf81aaa60ed82f547b70fbff71665e2a3cb3b32e534744f0574" Jul 06 23:21:54.946606 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:54.946569 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" event={"ID":"0bbe4855-c1e0-4dea-9db2-ce8d91176651","Type":"ContainerStarted","Data":"b2a2c67e81f414f63779c4294ecf450979305c667a6fa61e6747959304f3524e"} Jul 06 23:21:54.947070 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:21:54.946769 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 23:22:05.954057 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:22:05.953974 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-vccg7" Jul 06 23:23:01.786195 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:23:01.786159 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:23:17.471020 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:23:17.470974 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:23:34.970145 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:23:34.970052 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:23:47.867309 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:23:47.867268 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:24:03.767458 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:24:03.767417 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:24:19.971306 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:24:19.971263 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:24:37.962601 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:24:37.962559 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:24:53.668820 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:24:53.668778 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:25:09.666901 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:25:09.666865 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:25:39.673014 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:25:39.672977 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:26:12.411326 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:26:12.411295 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:26:12.421002 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:26:12.420976 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qvqv_5e812039-235d-4e1f-b0f4-597162219a9a/ovn-acl-logging/0.log" Jul 06 23:26:12.974853 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:26:12.974812 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:26:30.363951 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:26:30.363902 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:26:48.182693 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:26:48.182651 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:27:06.771865 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:27:06.771824 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:27:35.974370 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:27:35.974330 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:27:53.166570 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:27:53.166525 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:28:10.571471 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:10.571430 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:28:19.551472 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:19.551432 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg"] Jul 06 23:28:19.552097 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:19.551738 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" podUID="86f17a08-6094-412e-9eab-f46398659616" containerName="maas-api" containerID="cri-o://2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de" gracePeriod=30 Jul 06 23:28:19.814245 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:19.814173 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:28:19.954604 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:19.954565 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p99xf\" (UniqueName: \"kubernetes.io/projected/86f17a08-6094-412e-9eab-f46398659616-kube-api-access-p99xf\") pod \"86f17a08-6094-412e-9eab-f46398659616\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " Jul 06 23:28:19.954809 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:19.954665 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86f17a08-6094-412e-9eab-f46398659616-maas-api-tls\") pod \"86f17a08-6094-412e-9eab-f46398659616\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " Jul 06 23:28:19.954809 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:19.954721 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86f17a08-6094-412e-9eab-f46398659616-openshift-service-ca\") pod \"86f17a08-6094-412e-9eab-f46398659616\" (UID: \"86f17a08-6094-412e-9eab-f46398659616\") " Jul 06 23:28:19.955097 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:19.955071 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86f17a08-6094-412e-9eab-f46398659616-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "86f17a08-6094-412e-9eab-f46398659616" (UID: "86f17a08-6094-412e-9eab-f46398659616"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:28:19.956770 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:19.956751 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86f17a08-6094-412e-9eab-f46398659616-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "86f17a08-6094-412e-9eab-f46398659616" (UID: "86f17a08-6094-412e-9eab-f46398659616"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:28:19.956841 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:19.956775 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86f17a08-6094-412e-9eab-f46398659616-kube-api-access-p99xf" (OuterVolumeSpecName: "kube-api-access-p99xf") pod "86f17a08-6094-412e-9eab-f46398659616" (UID: "86f17a08-6094-412e-9eab-f46398659616"). InnerVolumeSpecName "kube-api-access-p99xf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:28:20.056131 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.056090 2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86f17a08-6094-412e-9eab-f46398659616-maas-api-tls\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:28:20.056131 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.056131 2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86f17a08-6094-412e-9eab-f46398659616-openshift-service-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:28:20.056131 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.056141 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p99xf\" (UniqueName: \"kubernetes.io/projected/86f17a08-6094-412e-9eab-f46398659616-kube-api-access-p99xf\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:28:20.078852 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.078754 2568 generic.go:356] "Generic (PLEG): container finished" podID="86f17a08-6094-412e-9eab-f46398659616" containerID="2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de" exitCode=0 Jul 06 23:28:20.078852 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.078806 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" Jul 06 23:28:20.079095 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.078843 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" event={"ID":"86f17a08-6094-412e-9eab-f46398659616","Type":"ContainerDied","Data":"2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de"} Jul 06 23:28:20.079095 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.078909 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg" event={"ID":"86f17a08-6094-412e-9eab-f46398659616","Type":"ContainerDied","Data":"46df83f2da06630bbe3eba713df762ba0f9fd6eb70fd1b7ea0761f0704fce2b6"} Jul 06 23:28:20.079095 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.078938 2568 scope.go:117] "RemoveContainer" containerID="2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de" Jul 06 23:28:20.090103 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.090084 2568 scope.go:117] "RemoveContainer" containerID="2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de" Jul 06 23:28:20.090413 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:28:20.090389 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de\": container with ID starting with 2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de not found: ID does not exist" containerID="2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de" Jul 06 23:28:20.090511 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.090425 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de"} err="failed to get container status \"2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de\": rpc error: code = NotFound desc = could not find container \"2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de\": container with ID starting with 2dc7d0c5081bf668947250fcdf4c69bb099e5a022f922edf91fc48e6e34cc4de not found: ID does not exist" Jul 06 23:28:20.103522 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.102094 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg"] Jul 06 23:28:20.107221 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.107186 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-669fee-54759f459-bzrrg"] Jul 06 23:28:20.275016 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:20.274977 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86f17a08-6094-412e-9eab-f46398659616" path="/var/lib/kubelet/pods/86f17a08-6094-412e-9eab-f46398659616/volumes" Jul 06 23:28:23.970202 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:28:23.970146 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:29:02.844001 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:02.843964 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2"] Jul 06 23:29:02.844591 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:02.844248 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" podUID="2a16584d-7b4d-4070-9d60-38510781dc57" containerName="maas-api" containerID="cri-o://37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280" gracePeriod=30 Jul 06 23:29:03.100263 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.100191 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:29:03.244633 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.244587 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a16584d-7b4d-4070-9d60-38510781dc57-openshift-service-ca\") pod \"2a16584d-7b4d-4070-9d60-38510781dc57\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " Jul 06 23:29:03.244633 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.244641 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a16584d-7b4d-4070-9d60-38510781dc57-maas-api-tls\") pod \"2a16584d-7b4d-4070-9d60-38510781dc57\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " Jul 06 23:29:03.244910 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.244709 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxw8l\" (UniqueName: \"kubernetes.io/projected/2a16584d-7b4d-4070-9d60-38510781dc57-kube-api-access-pxw8l\") pod \"2a16584d-7b4d-4070-9d60-38510781dc57\" (UID: \"2a16584d-7b4d-4070-9d60-38510781dc57\") " Jul 06 23:29:03.245017 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.244989 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a16584d-7b4d-4070-9d60-38510781dc57-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a16584d-7b4d-4070-9d60-38510781dc57" (UID: "2a16584d-7b4d-4070-9d60-38510781dc57"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:29:03.247030 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.246994 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a16584d-7b4d-4070-9d60-38510781dc57-kube-api-access-pxw8l" (OuterVolumeSpecName: "kube-api-access-pxw8l") pod "2a16584d-7b4d-4070-9d60-38510781dc57" (UID: "2a16584d-7b4d-4070-9d60-38510781dc57"). InnerVolumeSpecName "kube-api-access-pxw8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:29:03.247135 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.247032 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a16584d-7b4d-4070-9d60-38510781dc57-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a16584d-7b4d-4070-9d60-38510781dc57" (UID: "2a16584d-7b4d-4070-9d60-38510781dc57"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:29:03.335604 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.335565 2568 generic.go:356] "Generic (PLEG): container finished" podID="2a16584d-7b4d-4070-9d60-38510781dc57" containerID="37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280" exitCode=0 Jul 06 23:29:03.335778 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.335613 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" Jul 06 23:29:03.335778 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.335655 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" event={"ID":"2a16584d-7b4d-4070-9d60-38510781dc57","Type":"ContainerDied","Data":"37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280"} Jul 06 23:29:03.335778 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.335708 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2" event={"ID":"2a16584d-7b4d-4070-9d60-38510781dc57","Type":"ContainerDied","Data":"1c776de0d35762d1914a8cb77ed5fe2a07896f103522ee3fc302a41b9c19638f"} Jul 06 23:29:03.335778 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.335734 2568 scope.go:117] "RemoveContainer" containerID="37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280" Jul 06 23:29:03.345861 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.345838 2568 scope.go:117] "RemoveContainer" containerID="37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280" Jul 06 23:29:03.346063 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.346043 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxw8l\" (UniqueName: \"kubernetes.io/projected/2a16584d-7b4d-4070-9d60-38510781dc57-kube-api-access-pxw8l\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:29:03.346139 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.346067 2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a16584d-7b4d-4070-9d60-38510781dc57-openshift-service-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:29:03.346139 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.346078 2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a16584d-7b4d-4070-9d60-38510781dc57-maas-api-tls\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jul 06 23:29:03.346217 ip-10-0-142-117 kubenswrapper[2568]: E0706 23:29:03.346154 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280\": container with ID starting with 37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280 not found: ID does not exist" containerID="37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280" Jul 06 23:29:03.346217 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.346185 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280"} err="failed to get container status \"37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280\": rpc error: code = NotFound desc = could not find container \"37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280\": container with ID starting with 37886c6f2ff2dc0adaace9f2641b14a2d1f41f92f9c6e3a901d65ddd8def2280 not found: ID does not exist" Jul 06 23:29:03.357378 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.357277 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2"] Jul 06 23:29:03.363380 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:03.363348 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d3a5b8-5dc977496b-p5tx2"] Jul 06 23:29:04.274607 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:04.274573 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a16584d-7b4d-4070-9d60-38510781dc57" path="/var/lib/kubelet/pods/2a16584d-7b4d-4070-9d60-38510781dc57/volumes" Jul 06 23:29:05.771646 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:05.771610 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d5k2g"] Jul 06 23:29:14.594660 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:14.594622 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722980-9dd27_a8332e1f-95cc-44a0-b784-5ed162244998/cleanup/0.log" Jul 06 23:29:14.711514 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:14.711479 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722995-5ncdp_e283238c-9baa-4ac3-88e2-8651aa823f92/cleanup/0.log" Jul 06 23:29:15.091679 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:15.091645 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-69w4k_837aaa7a-b53b-464b-bda8-3b78c20932ce/manager/0.log" Jul 06 23:29:15.216377 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:15.216349 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8c6df956-bxckf_7550ae46-4faf-4754-82c6-4e5041e7f70d/copy-manifests/0.log" Jul 06 23:29:15.222898 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:15.222868 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8c6df956-bxckf_7550ae46-4faf-4754-82c6-4e5041e7f70d/manager/0.log" Jul 06 23:29:16.441417 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.441390 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb_a850271e-416c-4de0-9c9f-4c24bb781a09/util/0.log" Jul 06 23:29:16.447833 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.447811 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb_a850271e-416c-4de0-9c9f-4c24bb781a09/pull/0.log" Jul 06 23:29:16.454138 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.454116 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb_a850271e-416c-4de0-9c9f-4c24bb781a09/extract/0.log" Jul 06 23:29:16.571384 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.571353 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r_b044c8cb-62d3-447d-897e-d476ad93acf1/extract/0.log" Jul 06 23:29:16.577670 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.577641 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r_b044c8cb-62d3-447d-897e-d476ad93acf1/util/0.log" Jul 06 23:29:16.583818 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.583791 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r_b044c8cb-62d3-447d-897e-d476ad93acf1/pull/0.log" Jul 06 23:29:16.715904 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.715883 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j_ff10ffc3-e07c-45b7-99ff-c79bc7388891/util/0.log" Jul 06 23:29:16.722011 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.721983 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j_ff10ffc3-e07c-45b7-99ff-c79bc7388891/pull/0.log" Jul 06 23:29:16.727999 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.727981 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j_ff10ffc3-e07c-45b7-99ff-c79bc7388891/extract/0.log" Jul 06 23:29:16.843314 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.843287 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc_8ee1257b-108b-4cb7-a3bd-8111e52c933f/util/0.log" Jul 06 23:29:16.849840 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.849818 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc_8ee1257b-108b-4cb7-a3bd-8111e52c933f/pull/0.log" Jul 06 23:29:16.856182 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:16.856163 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc_8ee1257b-108b-4cb7-a3bd-8111e52c933f/extract/0.log" Jul 06 23:29:17.759536 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:17.759484 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d5k2g_8293d3c8-9128-4d7a-8fed-bbe14e277561/limitador/0.log" Jul 06 23:29:18.396952 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:18.396922 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cjchz_4fbcebf7-bb95-42b5-97e9-177dc0519be4/discovery/0.log" Jul 06 23:29:26.822577 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:26.822539 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pvr6q_e84ebda6-5eef-48c7-8565-ebe6bfad767c/global-pull-secret-syncer/0.log" Jul 06 23:29:26.896965 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:26.896928 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f8rvz_83a4a470-d3eb-4396-9fb5-f50ea5555f4e/konnectivity-agent/0.log" Jul 06 23:29:26.997121 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:26.997083 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-117.ec2.internal_18ffdb5b21a4104d25d53564786ff1f5/haproxy/0.log" Jul 06 23:29:31.212937 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.212908 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb_a850271e-416c-4de0-9c9f-4c24bb781a09/extract/0.log" Jul 06 23:29:31.239296 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.239271 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb_a850271e-416c-4de0-9c9f-4c24bb781a09/util/0.log" Jul 06 23:29:31.257241 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.257204 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqdgb_a850271e-416c-4de0-9c9f-4c24bb781a09/pull/0.log" Jul 06 23:29:31.304519 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.304468 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r_b044c8cb-62d3-447d-897e-d476ad93acf1/extract/0.log" Jul 06 23:29:31.325355 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.325323 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r_b044c8cb-62d3-447d-897e-d476ad93acf1/util/0.log" Jul 06 23:29:31.347976 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.347946 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdq7r_b044c8cb-62d3-447d-897e-d476ad93acf1/pull/0.log" Jul 06 23:29:31.378688 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.378654 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j_ff10ffc3-e07c-45b7-99ff-c79bc7388891/extract/0.log" Jul 06 23:29:31.402015 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.401984 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j_ff10ffc3-e07c-45b7-99ff-c79bc7388891/util/0.log" Jul 06 23:29:31.435068 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.435022 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734hc9j_ff10ffc3-e07c-45b7-99ff-c79bc7388891/pull/0.log" Jul 06 23:29:31.464207 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.464132 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc_8ee1257b-108b-4cb7-a3bd-8111e52c933f/extract/0.log" Jul 06 23:29:31.488996 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.488963 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc_8ee1257b-108b-4cb7-a3bd-8111e52c933f/util/0.log" Jul 06 23:29:31.515007 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:31.514983 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hzmcc_8ee1257b-108b-4cb7-a3bd-8111e52c933f/pull/0.log" Jul 06 23:29:32.263225 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:32.263196 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d5k2g_8293d3c8-9128-4d7a-8fed-bbe14e277561/limitador/0.log" Jul 06 23:29:33.856262 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:33.856173 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3fd9e5e-93e8-4809-9b84-23b462a49189/alertmanager/0.log" Jul 06 23:29:33.877451 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:33.877422 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3fd9e5e-93e8-4809-9b84-23b462a49189/config-reloader/0.log" Jul 06 23:29:33.897862 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:33.897835 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3fd9e5e-93e8-4809-9b84-23b462a49189/kube-rbac-proxy-web/0.log" Jul 06 23:29:33.919069 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:33.919046 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3fd9e5e-93e8-4809-9b84-23b462a49189/kube-rbac-proxy/0.log" Jul 06 23:29:33.939939 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:33.939910 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3fd9e5e-93e8-4809-9b84-23b462a49189/kube-rbac-proxy-metric/0.log" Jul 06 23:29:33.959279 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:33.959245 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3fd9e5e-93e8-4809-9b84-23b462a49189/prom-label-proxy/0.log" Jul 06 23:29:33.979462 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:33.979429 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3fd9e5e-93e8-4809-9b84-23b462a49189/init-config-reloader/0.log" Jul 06 23:29:34.052182 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.052155 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jksv4_14c9228a-5809-496d-9aff-c164f12768b9/kube-state-metrics/0.log" Jul 06 23:29:34.070514 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.070466 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jksv4_14c9228a-5809-496d-9aff-c164f12768b9/kube-rbac-proxy-main/0.log" Jul 06 23:29:34.089877 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.089848 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jksv4_14c9228a-5809-496d-9aff-c164f12768b9/kube-rbac-proxy-self/0.log" Jul 06 23:29:34.293908 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.293881 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cw85x_7df81927-8885-4c48-ae26-77626331b130/node-exporter/0.log" Jul 06 23:29:34.319429 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.319389 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cw85x_7df81927-8885-4c48-ae26-77626331b130/kube-rbac-proxy/0.log" Jul 06 23:29:34.339377 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.339345 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cw85x_7df81927-8885-4c48-ae26-77626331b130/init-textfile/0.log" Jul 06 23:29:34.445717 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.445690 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-sddjb_cfc6963d-b744-436b-94be-db2e04f1eab2/kube-rbac-proxy-main/0.log" Jul 06 23:29:34.467291 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.467212 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-sddjb_cfc6963d-b744-436b-94be-db2e04f1eab2/kube-rbac-proxy-self/0.log" Jul 06 23:29:34.494078 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.494047 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-sddjb_cfc6963d-b744-436b-94be-db2e04f1eab2/openshift-state-metrics/0.log" Jul 06 23:29:34.800936 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.800852 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c5c75f44c-zgr2h_b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e/telemeter-client/0.log" Jul 06 23:29:34.815939 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.815910 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c5c75f44c-zgr2h_b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e/reload/0.log" Jul 06 23:29:34.835757 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.835728 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c5c75f44c-zgr2h_b9b063b2-0cc8-4a9f-9e4e-f83ec208a72e/kube-rbac-proxy/0.log" Jul 06 23:29:34.868413 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.868392 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9b8c446-2p9f4_761119c0-e6c1-42df-af03-66d4f6d8727c/thanos-query/0.log" Jul 06 23:29:34.888046 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.888020 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9b8c446-2p9f4_761119c0-e6c1-42df-af03-66d4f6d8727c/kube-rbac-proxy-web/0.log" Jul 06 23:29:34.912686 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.912660 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9b8c446-2p9f4_761119c0-e6c1-42df-af03-66d4f6d8727c/kube-rbac-proxy/0.log" Jul 06 23:29:34.935543 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.935518 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9b8c446-2p9f4_761119c0-e6c1-42df-af03-66d4f6d8727c/prom-label-proxy/0.log" Jul 06 23:29:34.955804 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.955782 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9b8c446-2p9f4_761119c0-e6c1-42df-af03-66d4f6d8727c/kube-rbac-proxy-rules/0.log" Jul 06 23:29:34.976692 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:34.976664 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9b8c446-2p9f4_761119c0-e6c1-42df-af03-66d4f6d8727c/kube-rbac-proxy-metrics/0.log" Jul 06 23:29:36.143073 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.143045 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-5bdtg_a91034b3-3ca7-4bc2-abe8-39001338252d/networking-console-plugin/0.log" Jul 06 23:29:36.808968 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.808931 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc"] Jul 06 23:29:36.809437 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.809410 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86f17a08-6094-412e-9eab-f46398659616" containerName="maas-api" Jul 06 23:29:36.809437 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.809435 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="86f17a08-6094-412e-9eab-f46398659616" containerName="maas-api" Jul 06 23:29:36.809717 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.809451 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a16584d-7b4d-4070-9d60-38510781dc57" containerName="maas-api" Jul 06 23:29:36.809717 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.809461 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a16584d-7b4d-4070-9d60-38510781dc57" containerName="maas-api" Jul 06 23:29:36.809717 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.809620 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="86f17a08-6094-412e-9eab-f46398659616" containerName="maas-api" Jul 06 23:29:36.809717 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.809632 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a16584d-7b4d-4070-9d60-38510781dc57" containerName="maas-api" Jul 06 23:29:36.813036 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.813018 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.815277 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.815258 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r9kzh\"/\"openshift-service-ca.crt\"" Jul 06 23:29:36.815402 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.815258 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r9kzh\"/\"default-dockercfg-v45ts\"" Jul 06 23:29:36.816038 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.816014 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r9kzh\"/\"kube-root-ca.crt\"" Jul 06 23:29:36.822223 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.822194 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc"] Jul 06 23:29:36.858365 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.858330 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-proc\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.858586 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.858388 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-podres\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.858586 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.858486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-lib-modules\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.858586 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.858568 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-sys\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.858706 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.858597 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9jr8\" (UniqueName: \"kubernetes.io/projected/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-kube-api-access-q9jr8\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.959433 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.959399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-proc\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.959606 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.959461 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-podres\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.959606 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.959522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-lib-modules\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.959606 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.959547 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-sys\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.959606 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.959568 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jr8\" (UniqueName: \"kubernetes.io/projected/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-kube-api-access-q9jr8\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.959606 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.959577 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-proc\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.959835 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.959639 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-sys\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.959835 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.959649 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-podres\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.959835 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.959694 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-lib-modules\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:36.967194 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:36.967162 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jr8\" (UniqueName: \"kubernetes.io/projected/2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6-kube-api-access-q9jr8\") pod \"perf-node-gather-daemonset-skwjc\" (UID: \"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:37.124127 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:37.124034 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:37.260911 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:37.260882 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc"] Jul 06 23:29:37.262985 ip-10-0-142-117 kubenswrapper[2568]: W0706 23:29:37.262958 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2cd3d3b1_b6bd_4f58_9595_b6b953bc1dd6.slice/crio-ce3b950cef3980baa0a203a6456ad3f8ca18581b904a96b8bef291a06f1f258a WatchSource:0}: Error finding container ce3b950cef3980baa0a203a6456ad3f8ca18581b904a96b8bef291a06f1f258a: Status 404 returned error can't find the container with id ce3b950cef3980baa0a203a6456ad3f8ca18581b904a96b8bef291a06f1f258a Jul 06 23:29:37.308016 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:37.307986 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8b7d79695-j8jgt_e4100594-8807-4c5b-b8f9-3d9d9bc086b1/console/0.log" Jul 06 23:29:37.357356 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:37.357326 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-dln4s_5dcb6448-6d8c-49dc-8029-5eb8db3a4c8b/download-server/0.log" Jul 06 23:29:37.515998 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:37.515962 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" event={"ID":"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6","Type":"ContainerStarted","Data":"f367eb9893cd373b535d49b4dfa108ed840bfab9807c6b9e103d7c77067379ce"} Jul 06 23:29:37.516175 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:37.516043 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" event={"ID":"2cd3d3b1-b6bd-4f58-9595-b6b953bc1dd6","Type":"ContainerStarted","Data":"ce3b950cef3980baa0a203a6456ad3f8ca18581b904a96b8bef291a06f1f258a"} Jul 06 23:29:37.516175 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:37.516070 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:37.530675 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:37.530619 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" podStartSLOduration=1.530604233 podStartE2EDuration="1.530604233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:29:37.529742298 +0000 UTC m=+2605.840910476" watchObservedRunningTime="2026-07-06 23:29:37.530604233 +0000 UTC m=+2605.841772400" Jul 06 23:29:38.944795 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:38.944766 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lg9t4_dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e/dns/0.log" Jul 06 23:29:38.964341 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:38.964313 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lg9t4_dcc4cbf4-87eb-4c17-9ae6-0c91b47a785e/kube-rbac-proxy/0.log" Jul 06 23:29:39.080002 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:39.079967 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wkg87_cf97cfd3-1578-4f60-b609-fc54d91ddd38/dns-node-resolver/0.log" Jul 06 23:29:39.602744 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:39.602713 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fddb6f768-v98x2_f06e63ed-81de-4017-83c5-e056846a2141/registry/0.log" Jul 06 23:29:39.643313 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:39.643287 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jrhnq_e5d93ceb-53f0-4c9c-92e9-c7cd4f12fe03/node-ca/0.log" Jul 06 23:29:40.706283 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:40.706247 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cjchz_4fbcebf7-bb95-42b5-97e9-177dc0519be4/discovery/0.log" Jul 06 23:29:41.695652 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:41.695627 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qnjgj_fd118b33-d5f6-4328-8b38-ee08e8ba9f08/serve-healthcheck-canary/0.log" Jul 06 23:29:42.295399 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:42.295366 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zsfk7_6dba2eb5-ade5-4809-a6cd-32264f60254c/kube-rbac-proxy/0.log" Jul 06 23:29:42.315890 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:42.315862 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zsfk7_6dba2eb5-ade5-4809-a6cd-32264f60254c/exporter/0.log" Jul 06 23:29:42.335664 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:42.335642 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zsfk7_6dba2eb5-ade5-4809-a6cd-32264f60254c/extractor/0.log" Jul 06 23:29:43.531681 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:43.531655 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-skwjc" Jul 06 23:29:44.739729 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:44.739698 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722980-9dd27_a8332e1f-95cc-44a0-b784-5ed162244998/cleanup/0.log" Jul 06 23:29:44.762602 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:44.762574 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722995-5ncdp_e283238c-9baa-4ac3-88e2-8651aa823f92/cleanup/0.log" Jul 06 23:29:45.018987 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:45.018898 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-69w4k_837aaa7a-b53b-464b-bda8-3b78c20932ce/manager/0.log" Jul 06 23:29:45.044881 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:45.044852 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8c6df956-bxckf_7550ae46-4faf-4754-82c6-4e5041e7f70d/manager/0.log" Jul 06 23:29:45.064778 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:45.064755 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8c6df956-bxckf_7550ae46-4faf-4754-82c6-4e5041e7f70d/copy-manifests/0.log" Jul 06 23:29:46.856875 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:46.856847 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55f7b57db4-vccg7_0bbe4855-c1e0-4dea-9db2-ce8d91176651/manager/1.log" Jul 06 23:29:46.857348 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:46.857289 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55f7b57db4-vccg7_0bbe4855-c1e0-4dea-9db2-ce8d91176651/manager/0.log" Jul 06 23:29:47.285245 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:47.285213 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cjchz_4fbcebf7-bb95-42b5-97e9-177dc0519be4/discovery/0.log" Jul 06 23:29:48.784861 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:48.784828 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cjchz_4fbcebf7-bb95-42b5-97e9-177dc0519be4/discovery/0.log" Jul 06 23:29:53.285760 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:53.285673 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwh7m_7a889342-55cd-46aa-87f2-dd986aa3e6ff/kube-multus-additional-cni-plugins/0.log" Jul 06 23:29:53.308679 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:53.308651 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwh7m_7a889342-55cd-46aa-87f2-dd986aa3e6ff/egress-router-binary-copy/0.log" Jul 06 23:29:53.330041 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:53.330016 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwh7m_7a889342-55cd-46aa-87f2-dd986aa3e6ff/cni-plugins/0.log" Jul 06 23:29:53.348291 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:53.348267 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwh7m_7a889342-55cd-46aa-87f2-dd986aa3e6ff/bond-cni-plugin/0.log" Jul 06 23:29:53.367970 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:53.367953 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwh7m_7a889342-55cd-46aa-87f2-dd986aa3e6ff/routeoverride-cni/0.log" Jul 06 23:29:53.388582 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:53.388557 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwh7m_7a889342-55cd-46aa-87f2-dd986aa3e6ff/whereabouts-cni-bincopy/0.log" Jul 06 23:29:53.407780 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:53.407754 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwh7m_7a889342-55cd-46aa-87f2-dd986aa3e6ff/whereabouts-cni/0.log" Jul 06 23:29:53.714544 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:53.714516 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c55fj_850fbf17-6749-4f07-9a4e-9ec93c8345bd/kube-multus/0.log" Jul 06 23:29:53.817173 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:53.817142 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r55k5_44689168-2d9a-49c7-b7ae-6b8caa09b985/network-metrics-daemon/0.log" Jul 06 23:29:53.836445 ip-10-0-142-117 kubenswrapper[2568]: I0706 23:29:53.836423 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r55k5_44689168-2d9a-49c7-b7ae-6b8caa09b985/kube-rbac-proxy/0.log"