Jul 06 12:02:23.892536 ip-10-0-131-197 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 12:02:23.892546 ip-10-0-131-197 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 12:02:23.892554 ip-10-0-131-197 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 12:02:23.892781 ip-10-0-131-197 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 12:02:34.977167 ip-10-0-131-197 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 12:02:34.977180 ip-10-0-131-197 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 054e0eba800f4a8d9bc3e7a337494dbb -- Jul 06 12:04:34.751302 ip-10-0-131-197 systemd[1]: Starting Kubernetes Kubelet... Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.156813 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163701 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163715 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163719 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163723 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163726 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163728 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163731 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:35.229422 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163734 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163737 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163739 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163743 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163748 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163751 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163755 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163758 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163761 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163765 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163767 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163780 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163785 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163788 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163790 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163793 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163796 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163798 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163800 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:35.230318 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163803 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163805 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163808 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163811 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163814 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163817 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163819 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163824 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163827 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163830 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163833 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163835 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163838 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163840 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163843 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163846 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163849 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163851 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163854 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163856 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:35.230997 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163858 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163861 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163864 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163866 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163869 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163872 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163875 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163878 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163881 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163883 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163886 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163889 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163891 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163894 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163896 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163899 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163902 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163905 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163907 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163910 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:35.231615 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163913 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:35.231648 ip-10-0-131-197 systemd[1]: Started Kubernetes Kubelet. Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163916 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163919 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163921 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163924 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163926 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163929 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163931 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163934 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163936 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163939 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163942 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163944 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163948 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163952 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163955 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163958 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163961 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163964 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:35.232602 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163967 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163969 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163972 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163975 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163977 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163980 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163983 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163985 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163988 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163990 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163993 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163996 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.163998 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164001 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164706 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164712 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164715 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164718 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164722 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164725 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:35.233342 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164729 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164731 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164734 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164737 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164739 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164742 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164745 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164747 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164750 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164754 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164758 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164764 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164768 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164771 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164774 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164776 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164780 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164783 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164786 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:35.233973 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164788 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164791 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164794 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164797 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164799 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164802 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164804 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164807 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164810 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164814 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164817 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164819 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164822 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164825 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164827 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164830 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164833 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164836 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164838 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164841 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:35.234647 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164843 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164846 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164849 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164851 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164856 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164862 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164865 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164868 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164870 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164873 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164876 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164878 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164881 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164883 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164886 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164888 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164891 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164893 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164897 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164899 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:35.235301 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164903 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164907 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164910 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164912 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164915 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164917 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164920 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164922 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164925 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164928 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164930 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164933 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164935 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164938 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164941 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164944 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164949 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164953 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164957 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:35.235872 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164960 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164963 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164965 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164968 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164971 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164974 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164977 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164979 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164982 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164984 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164987 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164989 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164991 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164994 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.164998 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165372 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165378 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165380 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165383 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165386 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:35.236707 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165389 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165391 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165394 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165396 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165399 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165402 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165404 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165407 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165409 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165413 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165416 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165419 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165422 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165425 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165428 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165431 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165433 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165436 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165438 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165441 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:35.237321 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165443 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165446 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165449 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165451 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165454 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165456 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165460 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165463 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165465 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165468 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165470 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165473 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165475 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165478 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165481 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165483 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165486 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165488 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165491 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:35.237928 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165495 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165498 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165503 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165506 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165509 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165512 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165514 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165517 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165519 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165523 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165527 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165536 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165538 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165542 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165546 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165549 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165552 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165555 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165558 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:35.238583 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165563 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165566 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165569 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165571 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165575 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165578 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165580 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165583 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165586 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165588 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165591 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165594 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165596 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165599 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165601 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165605 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165608 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165611 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165613 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165617 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:35.239645 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165619 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165622 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165624 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165627 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165629 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165632 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165634 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165637 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165639 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165642 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165644 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165647 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165651 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165654 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165656 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.165658 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165728 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165735 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165741 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165746 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165750 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 12:04:35.240278 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165753 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165757 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165761 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165764 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165767 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165770 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165776 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165779 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165782 2576 flags.go:64] FLAG: --cgroup-root="" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165785 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165787 2576 flags.go:64] FLAG: --client-ca-file="" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165791 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165794 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165798 2576 flags.go:64] FLAG: --cluster-domain="" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165801 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165804 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165807 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165810 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165814 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165817 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165820 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165823 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165826 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165830 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 12:04:35.241156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165833 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165836 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165839 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165844 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165847 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165850 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165853 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165855 2576 flags.go:64] FLAG: --enable-server="true" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165858 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165862 2576 flags.go:64] FLAG: --event-burst="100" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165865 2576 flags.go:64] FLAG: --event-qps="50" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165868 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165872 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165874 2576 flags.go:64] FLAG: --eviction-hard="" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165880 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165883 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165886 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165889 2576 flags.go:64] FLAG: --eviction-soft="" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165891 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165894 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165898 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165901 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165904 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165907 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165910 2576 flags.go:64] FLAG: --feature-gates="" Jul 06 12:04:35.241943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165916 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165919 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165922 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165925 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165928 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165931 2576 flags.go:64] FLAG: --help="false" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165936 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165940 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165942 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165945 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165949 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165952 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165955 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165958 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165961 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165964 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165967 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165970 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165973 2576 flags.go:64] FLAG: --kube-reserved="" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165976 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165979 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165983 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165986 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165989 2576 flags.go:64] FLAG: --lock-file="" Jul 06 12:04:35.242974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165992 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165995 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.165998 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166003 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166006 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166009 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166012 2576 flags.go:64] FLAG: --logging-format="text" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166015 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166019 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166021 2576 flags.go:64] FLAG: --manifest-url="" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166024 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166028 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166032 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166050 2576 flags.go:64] FLAG: --max-pods="110" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166056 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166060 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166063 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166066 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166069 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166072 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166075 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166082 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166085 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166089 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 12:04:35.246323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166091 2576 flags.go:64] FLAG: --pod-cidr="" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166094 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166099 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166102 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166105 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166110 2576 flags.go:64] FLAG: --port="10250" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166113 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166116 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00bdb80069e08ca96" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166120 2576 flags.go:64] FLAG: --qos-reserved="" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166123 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166126 2576 flags.go:64] FLAG: --register-node="true" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166128 2576 flags.go:64] FLAG: --register-with-taints="" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166132 2576 flags.go:64] FLAG: --registry-burst="10" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166135 2576 flags.go:64] FLAG: --registry-qps="5" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166138 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166141 2576 flags.go:64] FLAG: --reserved-memory="" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166145 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166148 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166151 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166153 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166156 2576 flags.go:64] FLAG: --runonce="false" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166159 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166162 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166167 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166170 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 12:04:35.247353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166172 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166176 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166179 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166182 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166185 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166188 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166190 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166193 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166196 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166199 2576 flags.go:64] FLAG: --system-cgroups="" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166202 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166207 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166212 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166215 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166220 2576 flags.go:64] FLAG: --tls-min-version="" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166222 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166225 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166228 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166231 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166234 2576 flags.go:64] FLAG: --v="2" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166238 2576 flags.go:64] FLAG: --version="false" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166242 2576 flags.go:64] FLAG: --vmodule="" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166246 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.166249 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166358 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:35.336403 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166362 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166365 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166368 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166372 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166375 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166379 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166381 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166384 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166387 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166389 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166392 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166395 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166398 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166400 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166403 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166405 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166408 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166410 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166413 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166416 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:35.337274 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166419 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166422 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166425 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166427 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166430 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166432 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166435 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166438 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166440 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166443 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166446 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166449 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166451 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166454 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166456 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166459 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166461 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166465 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166469 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166472 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:35.337962 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166475 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166478 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166482 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166485 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166489 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166493 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166496 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166498 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166501 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166503 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166506 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166510 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166513 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166516 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166518 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166521 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166523 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166525 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166528 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:35.338731 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166531 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166533 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166536 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166539 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166541 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166544 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166546 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166549 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166551 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166554 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166557 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166560 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166562 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166565 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166567 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166570 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166573 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166575 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166578 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:35.339316 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166580 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166583 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166586 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166588 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166591 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166595 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166597 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166600 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166602 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166605 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166607 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166610 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166613 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166615 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166618 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166620 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166623 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166626 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166628 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:35.339925 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.166631 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.167441 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.174643 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.174665 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.174685 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.174692 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174747 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174752 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174755 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174758 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174761 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174764 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174767 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174770 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174772 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:35.340504 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174775 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174778 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174781 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174784 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174787 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174790 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174794 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174798 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174801 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174804 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174806 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174809 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174812 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174816 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174821 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174824 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174827 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174830 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174832 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174835 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:35.341370 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174838 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174840 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174843 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174845 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174848 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174850 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174853 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174856 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174858 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174861 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174863 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174866 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174869 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174872 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174874 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174877 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174879 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174882 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174884 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174887 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:35.342006 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174890 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174892 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174895 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174897 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174900 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174903 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174907 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174910 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174913 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174917 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174921 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174924 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174926 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174929 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174932 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174935 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174937 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174940 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174942 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174945 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:35.342643 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174947 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174950 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174953 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174955 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174958 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174960 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174964 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174968 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174971 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174974 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174976 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174979 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174981 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174984 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174986 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174989 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174991 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174994 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.174998 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:35.343272 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175001 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175004 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175008 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175011 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175014 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175017 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175020 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175023 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175025 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175028 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175030 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.175035 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175160 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175165 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175168 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:35.343879 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175171 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175174 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175176 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175179 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175183 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175186 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175188 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175191 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175193 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175196 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175198 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175202 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175205 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175208 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175211 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175215 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175218 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175222 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175225 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:35.344505 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175228 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175231 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175233 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175236 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175239 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175241 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175244 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175247 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175249 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175252 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175255 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175257 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175260 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175262 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175265 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175268 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175270 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175273 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175276 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:35.345132 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175279 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175283 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175286 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175288 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175291 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175294 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175296 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175299 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175302 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175307 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175309 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175314 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175317 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175320 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175322 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175325 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175328 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175331 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175333 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175336 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:35.345744 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175339 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175341 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175344 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175347 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175349 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175352 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175355 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175357 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175360 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175363 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175365 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175368 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175370 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175373 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175376 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175378 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175381 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175383 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175386 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175388 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:35.346431 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175391 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175395 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175397 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175402 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175405 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175408 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175411 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175413 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175416 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175419 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175421 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175424 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175426 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175429 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175432 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175434 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175437 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:35.347341 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:35.175440 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.175445 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.175540 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.177753 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.179318 2576 server.go:1019] "Starting client certificate rotation" Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.179427 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.179473 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.181792 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.182862 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.194085 2576 log.go:25] "Validated CRI v1 runtime API" Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.202545 2576 log.go:25] "Validated CRI v1 image API" Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.204396 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 12:04:35.347957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.206665 2576 fs.go:135] Filesystem UUIDs: map[4f9d5d58-9e23-4059-8d70-50403634a038:/dev/nvme0n1p4 6394d65d-23b7-4d4d-81e9-505c9cfc1fd3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 06 12:04:35.348373 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.206679 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 12:04:35.348575 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.211776 2576 manager.go:216] Machine: {Timestamp:2026-07-06 12:04:35.211295445 +0000 UTC m=+0.312451678 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099036 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bb26ccb609e5cb79ec949fab96a8d SystemUUID:ec2bb26c-cb60-9e5c-b79e-c949fab96a8d BootID:054e0eba-800f-4a8d-9bc3-e7a337494dbb Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:35:6c:06:2c:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:35:6c:06:2c:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:7c:31:fb:0c:09 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 12:04:35.348575 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.211895 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 12:04:35.348575 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.211983 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 12:04:35.348575 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.215163 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 12:04:35.348575 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.215183 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-197.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 12:04:35.348575 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.216007 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 12:04:35.348575 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.216017 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 12:04:35.348575 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.216024 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.216035 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.217892 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.221092 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.221476 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.221580 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.221611 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.221620 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.221634 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.221643 2576 kubelet.go:398] "Adding apiserver pod source" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.221651 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.221949 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.221968 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.224085 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.226284 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.226310 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227524 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227541 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227549 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227557 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227569 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227577 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227589 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227597 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227606 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227613 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227624 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227632 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227659 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.227666 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.231063 2576 server.go:1268] "Started kubelet" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.231432 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.234456 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.235326 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.235362 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.238242 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.241321 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.241715 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.241718 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 12:04:35.350349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.242789 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.242805 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.242894 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.248978 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.249068 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.249194 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.249366 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s48rh" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.249201 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.250268 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.250918 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.251079 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.251094 2576 factory.go:55] Registering systemd factory Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.251104 2576 factory.go:223] Registration of the systemd container factory successfully Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.251298 2576 factory.go:153] Registering CRI-O factory Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.251310 2576 factory.go:223] Registration of the crio container factory successfully Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.251332 2576 factory.go:103] Registering Raw factory Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.251343 2576 manager.go:1196] Started watching for new ooms in manager Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.251921 2576 manager.go:349] Starting recovery of all containers Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.258000 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s48rh" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.260894 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.260914 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.260924 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-197.ec2.internal.18bfb1cddf13a59b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-197.ec2.internal,UID:ip-10-0-131-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-197.ec2.internal,},FirstTimestamp:2026-07-06 12:04:35.231024539 +0000 UTC m=+0.332180773,LastTimestamp:2026-07-06 12:04:35.231024539 +0000 UTC m=+0.332180773,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-197.ec2.internal,}" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.265501 2576 manager.go:354] Recovery completed Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.270161 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.272669 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.272694 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.272713 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.273158 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.273168 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.273168 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.273238 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.273857 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:35.351456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.273885 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.273895 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.274241 2576 policy_none.go:49] "None policy: Start" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.274252 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.274262 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.275183 2576 policy_none.go:47] "Start" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.316564 2576 manager.go:337] "Starting Device Plugin manager" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.316617 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.316629 2576 server.go:87] "Starting device plugin registration server" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.316848 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.316857 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.316972 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.317072 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.317081 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.317554 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.317742 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-197.ec2.internal\" not found" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.417225 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.418408 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.418431 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.418441 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.418465 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.428665 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.428682 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-197.ec2.internal\": node \"ip-10-0-131-197.ec2.internal\" not found" Jul 06 12:04:35.451381 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.449880 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.499845 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.500980 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.501011 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.501031 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.501077 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.504080 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.550215 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.601464 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal"] Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.602282 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.607150 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.607180 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.607193 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.608559 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.608712 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.608740 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.609252 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.609283 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.609298 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.609349 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.609369 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.609379 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.610715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.610740 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.611492 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.611507 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.611518 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.638796 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-197.ec2.internal\" not found" node="ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.645371 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.643437 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-197.ec2.internal\" not found" node="ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.650961 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.652161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59f40d69b924b41315506b765aa0f993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"59f40d69b924b41315506b765aa0f993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.652182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59f40d69b924b41315506b765aa0f993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"59f40d69b924b41315506b765aa0f993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.652199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff989a6f978fee52ada7de3499ed5674-config\") pod \"kube-apiserver-proxy-ip-10-0-131-197.ec2.internal\" (UID: \"ff989a6f978fee52ada7de3499ed5674\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.751019 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.753381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59f40d69b924b41315506b765aa0f993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"59f40d69b924b41315506b765aa0f993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.753404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59f40d69b924b41315506b765aa0f993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"59f40d69b924b41315506b765aa0f993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.753421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff989a6f978fee52ada7de3499ed5674-config\") pod \"kube-apiserver-proxy-ip-10-0-131-197.ec2.internal\" (UID: \"ff989a6f978fee52ada7de3499ed5674\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.753472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff989a6f978fee52ada7de3499ed5674-config\") pod \"kube-apiserver-proxy-ip-10-0-131-197.ec2.internal\" (UID: \"ff989a6f978fee52ada7de3499ed5674\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.753489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59f40d69b924b41315506b765aa0f993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"59f40d69b924b41315506b765aa0f993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.753503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59f40d69b924b41315506b765aa0f993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"59f40d69b924b41315506b765aa0f993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" Jul 06 12:04:35.852578 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.851942 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found" Jul 06 12:04:36.091699 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.949989 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" Jul 06 12:04:36.091699 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:35.950435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" Jul 06 12:04:36.091699 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:35.952331 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found" Jul 06 12:04:36.091699 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.052591 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found" Jul 06 12:04:36.091699 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.066172 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.148259 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.181455 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.181480 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.181586 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.181631 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.183397 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.212736 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.222627 2576 apiserver.go:52] "Watching apiserver" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.237406 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.238515 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2j8wm","kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z","openshift-dns/node-resolver-wrjzt","openshift-multus/network-metrics-daemon-s42x4","openshift-network-diagnostics/network-check-target-khmk2","openshift-network-operator/iptables-alerter-j8ps7","openshift-ovn-kubernetes/ovnkube-node-25hfn","kube-system/konnectivity-agent-xz98j","openshift-cluster-node-tuning-operator/tuned-lvt87","openshift-image-registry/node-ca-52t5f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal","openshift-multus/multus-additional-cni-plugins-n8s5q","openshift-multus/multus-lcxqh"] Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.240011 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j8ps7" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.241394 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.242904 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.242929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.243956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wrjzt" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.244342 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.244450 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.244463 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tvnj7\"" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.244486 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.245373 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.245451 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.246776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:36.285804 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.246832 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.247933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.249655 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.250491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.254413 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.254670 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.254747 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ts549\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.254949 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.255234 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.255311 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.255398 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.255470 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nttvz\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.255604 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.255945 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.255953 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.255992 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4r5wv\"" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.256393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-ovn-node-metrics-cert\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.256470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-registration-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.256509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.256551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-system-cni-dir\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.256759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cf64023-0805-407b-b5f0-cbc7421e5880-cni-binary-copy\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.256792 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-cni-bin\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.287563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.256821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-run-k8s-cni-cncf-io\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.256849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-hostroot\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.256396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-52t5f" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.256961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70cbe769-cfca-4181-9f72-764a0319dc40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.256995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-socket-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.257068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.257227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-var-lib-openvswitch\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.257293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-env-overrides\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.257330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-os-release\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.257430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-run-openvswitch\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.257485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f42190ea-4133-4159-adc1-5992a2419e48-tmp-dir\") pod \"node-resolver-wrjzt\" (UID: \"f42190ea-4133-4159-adc1-5992a2419e48\") " pod="openshift-dns/node-resolver-wrjzt" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.257559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtkr2\" (UniqueName: \"kubernetes.io/projected/f42190ea-4133-4159-adc1-5992a2419e48-kube-api-access-mtkr2\") pod \"node-resolver-wrjzt\" (UID: \"f42190ea-4133-4159-adc1-5992a2419e48\") " pod="openshift-dns/node-resolver-wrjzt" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.257619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-cni-dir\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.257687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/430d933f-e79d-4b07-9a30-7ede3de09fd4-iptables-alerter-script\") pod \"iptables-alerter-j8ps7\" (UID: \"430d933f-e79d-4b07-9a30-7ede3de09fd4\") " pod="openshift-network-operator/iptables-alerter-j8ps7" Jul 06 12:04:36.288395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.257803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-cnibin\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-run-systemd\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258570 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-ovnkube-config\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-sys-fs\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-kubelet\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-run-multus-certs\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-ovnkube-script-lib\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23b776be-2e40-4be4-88a9-f8425351069f-konnectivity-ca\") pod \"konnectivity-agent-xz98j\" (UID: \"23b776be-2e40-4be4-88a9-f8425351069f\") " pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kff9c\" (UniqueName: \"kubernetes.io/projected/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-kube-api-access-kff9c\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-etc-openvswitch\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f42190ea-4133-4159-adc1-5992a2419e48-hosts-file\") pod \"node-resolver-wrjzt\" (UID: \"f42190ea-4133-4159-adc1-5992a2419e48\") " pod="openshift-dns/node-resolver-wrjzt" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7x6p\" (UniqueName: \"kubernetes.io/projected/2cf64023-0805-407b-b5f0-cbc7421e5880-kube-api-access-m7x6p\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-device-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.290184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-systemd-units\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-run-ovn\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.258995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzh2t\" (UniqueName: \"kubernetes.io/projected/6260540c-39d5-488b-bf5d-10a9355bd58d-kube-api-access-qzh2t\") pod \"node-ca-52t5f\" (UID: \"6260540c-39d5-488b-bf5d-10a9355bd58d\") " pod="openshift-image-registry/node-ca-52t5f" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/430d933f-e79d-4b07-9a30-7ede3de09fd4-host-slash\") pod \"iptables-alerter-j8ps7\" (UID: \"430d933f-e79d-4b07-9a30-7ede3de09fd4\") " pod="openshift-network-operator/iptables-alerter-j8ps7" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-system-cni-dir\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70cbe769-cfca-4181-9f72-764a0319dc40-cni-binary-copy\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-run-netns\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n87dc\" (UniqueName: \"kubernetes.io/projected/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-kube-api-access-n87dc\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6260540c-39d5-488b-bf5d-10a9355bd58d-serviceca\") pod \"node-ca-52t5f\" (UID: \"6260540c-39d5-488b-bf5d-10a9355bd58d\") " pod="openshift-image-registry/node-ca-52t5f" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-var-lib-cni-bin\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-conf-dir\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-cni-netd\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6260540c-39d5-488b-bf5d-10a9355bd58d-host\") pod \"node-ca-52t5f\" (UID: \"6260540c-39d5-488b-bf5d-10a9355bd58d\") " pod="openshift-image-registry/node-ca-52t5f" Jul 06 12:04:36.291002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-daemon-config\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-cnibin\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-etc-kubernetes\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzq7s\" (UniqueName: \"kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s\") pod \"network-check-target-khmk2\" (UID: \"378182f3-6f36-45f6-ac4e-a8537fe3af85\") " pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-slash\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-node-log\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-var-lib-cni-multus\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtpr6\" (UniqueName: \"kubernetes.io/projected/430d933f-e79d-4b07-9a30-7ede3de09fd4-kube-api-access-xtpr6\") pod \"iptables-alerter-j8ps7\" (UID: \"430d933f-e79d-4b07-9a30-7ede3de09fd4\") " pod="openshift-network-operator/iptables-alerter-j8ps7" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70cbe769-cfca-4181-9f72-764a0319dc40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-run-ovn-kubernetes\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w46tr\" (UniqueName: \"kubernetes.io/projected/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-kube-api-access-w46tr\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-os-release\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.291670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-socket-dir-parent\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-run-netns\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h26c8\" (UniqueName: \"kubernetes.io/projected/70cbe769-cfca-4181-9f72-764a0319dc40-kube-api-access-h26c8\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-log-socket\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23b776be-2e40-4be4-88a9-f8425351069f-agent-certs\") pod \"konnectivity-agent-xz98j\" (UID: \"23b776be-2e40-4be4-88a9-f8425351069f\") " pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.259920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-var-lib-kubelet\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.260000 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.260096 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 11:59:35 +0000 UTC" deadline="2028-01-21 14:08:18.99287216 +0000 UTC" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.260141 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13538h3m42.732735099s" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.260201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.260250 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.260257 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.264123 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c5x5n\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.264175 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.264521 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.264576 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dfqkr\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.264767 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lkppq\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.264838 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.264869 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.264956 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.265046 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.265277 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.265352 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nrzs4\"" Jul 06 12:04:36.292131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.265364 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dhttf\"" Jul 06 12:04:36.293004 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.270749 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 12:04:36.293004 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.270861 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 12:04:36.293004 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.270865 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 12:04:36.293004 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.270887 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 12:04:36.293004 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.270989 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 12:04:36.293004 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.292647 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.300004 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vmp9w" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.316321 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vmp9w" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.350761 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.360855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-var-lib-openvswitch\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.360876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-env-overrides\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.360897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-systemd\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.360972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgsm4\" (UniqueName: \"kubernetes.io/projected/41c95ced-bcf2-45fa-8bd9-83087356789d-kube-api-access-bgsm4\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.360974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-var-lib-openvswitch\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.360990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-kubelet-config\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-os-release\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-run-openvswitch\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f42190ea-4133-4159-adc1-5992a2419e48-tmp-dir\") pod \"node-resolver-wrjzt\" (UID: \"f42190ea-4133-4159-adc1-5992a2419e48\") " pod="openshift-dns/node-resolver-wrjzt" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361083 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-run-openvswitch\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtkr2\" (UniqueName: \"kubernetes.io/projected/f42190ea-4133-4159-adc1-5992a2419e48-kube-api-access-mtkr2\") pod \"node-resolver-wrjzt\" (UID: \"f42190ea-4133-4159-adc1-5992a2419e48\") " pod="openshift-dns/node-resolver-wrjzt" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-os-release\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.462902 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-cni-dir\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/430d933f-e79d-4b07-9a30-7ede3de09fd4-iptables-alerter-script\") pod \"iptables-alerter-j8ps7\" (UID: \"430d933f-e79d-4b07-9a30-7ede3de09fd4\") " pod="openshift-network-operator/iptables-alerter-j8ps7" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-tuned\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-cnibin\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-run-systemd\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-cnibin\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361351 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-cni-dir\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-ovnkube-config\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-sys-fs\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-run-systemd\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-kubelet\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361506 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-sys-fs\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-run-multus-certs\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361515 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-kubelet\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.464080 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-sysctl-d\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-run-multus-certs\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-host\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-ovnkube-script-lib\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23b776be-2e40-4be4-88a9-f8425351069f-konnectivity-ca\") pod \"konnectivity-agent-xz98j\" (UID: \"23b776be-2e40-4be4-88a9-f8425351069f\") " pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kff9c\" (UniqueName: \"kubernetes.io/projected/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-kube-api-access-kff9c\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-etc-openvswitch\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f42190ea-4133-4159-adc1-5992a2419e48-hosts-file\") pod \"node-resolver-wrjzt\" (UID: \"f42190ea-4133-4159-adc1-5992a2419e48\") " pod="openshift-dns/node-resolver-wrjzt" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7x6p\" (UniqueName: \"kubernetes.io/projected/2cf64023-0805-407b-b5f0-cbc7421e5880-kube-api-access-m7x6p\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-device-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-systemd-units\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-run-ovn\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzh2t\" (UniqueName: \"kubernetes.io/projected/6260540c-39d5-488b-bf5d-10a9355bd58d-kube-api-access-qzh2t\") pod \"node-ca-52t5f\" (UID: \"6260540c-39d5-488b-bf5d-10a9355bd58d\") " pod="openshift-image-registry/node-ca-52t5f" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/430d933f-e79d-4b07-9a30-7ede3de09fd4-host-slash\") pod \"iptables-alerter-j8ps7\" (UID: \"430d933f-e79d-4b07-9a30-7ede3de09fd4\") " pod="openshift-network-operator/iptables-alerter-j8ps7" Jul 06 12:04:36.465149 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-system-cni-dir\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70cbe769-cfca-4181-9f72-764a0319dc40-cni-binary-copy\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-run-netns\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n87dc\" (UniqueName: \"kubernetes.io/projected/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-kube-api-access-n87dc\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6260540c-39d5-488b-bf5d-10a9355bd58d-serviceca\") pod \"node-ca-52t5f\" (UID: \"6260540c-39d5-488b-bf5d-10a9355bd58d\") " pod="openshift-image-registry/node-ca-52t5f" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-var-lib-cni-bin\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-conf-dir\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.361985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-cni-netd\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6260540c-39d5-488b-bf5d-10a9355bd58d-host\") pod \"node-ca-52t5f\" (UID: \"6260540c-39d5-488b-bf5d-10a9355bd58d\") " pod="openshift-image-registry/node-ca-52t5f" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-daemon-config\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-kubernetes\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-cnibin\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.465916 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-etc-kubernetes\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzq7s\" (UniqueName: \"kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s\") pod \"network-check-target-khmk2\" (UID: \"378182f3-6f36-45f6-ac4e-a8537fe3af85\") " pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-slash\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-node-log\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-var-lib-cni-multus\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtpr6\" (UniqueName: \"kubernetes.io/projected/430d933f-e79d-4b07-9a30-7ede3de09fd4-kube-api-access-xtpr6\") pod \"iptables-alerter-j8ps7\" (UID: \"430d933f-e79d-4b07-9a30-7ede3de09fd4\") " pod="openshift-network-operator/iptables-alerter-j8ps7" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-modprobe-d\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70cbe769-cfca-4181-9f72-764a0319dc40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-run-ovn-kubernetes\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w46tr\" (UniqueName: \"kubernetes.io/projected/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-kube-api-access-w46tr\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-os-release\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-socket-dir-parent\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.466574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-run-netns\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41c95ced-bcf2-45fa-8bd9-83087356789d-tmp\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h26c8\" (UniqueName: \"kubernetes.io/projected/70cbe769-cfca-4181-9f72-764a0319dc40-kube-api-access-h26c8\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-log-socket\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f42190ea-4133-4159-adc1-5992a2419e48-tmp-dir\") pod \"node-resolver-wrjzt\" (UID: \"f42190ea-4133-4159-adc1-5992a2419e48\") " pod="openshift-dns/node-resolver-wrjzt" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23b776be-2e40-4be4-88a9-f8425351069f-agent-certs\") pod \"konnectivity-agent-xz98j\" (UID: \"23b776be-2e40-4be4-88a9-f8425351069f\") " pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-var-lib-kubelet\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-dbus\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-ovn-node-metrics-cert\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-sysconfig\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-run\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-var-lib-kubelet\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362583 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-cnibin\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.467208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-registration-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-etc-kubernetes\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-system-cni-dir\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cf64023-0805-407b-b5f0-cbc7421e5880-cni-binary-copy\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-sysctl-conf\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-sys\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-cni-bin\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-run-k8s-cni-cncf-io\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-hostroot\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-lib-modules\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70cbe769-cfca-4181-9f72-764a0319dc40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-slash\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/430d933f-e79d-4b07-9a30-7ede3de09fd4-iptables-alerter-script\") pod \"iptables-alerter-j8ps7\" (UID: \"430d933f-e79d-4b07-9a30-7ede3de09fd4\") " pod="openshift-network-operator/iptables-alerter-j8ps7" Jul 06 12:04:36.467965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-socket-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-node-log\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-var-lib-cni-multus\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.362985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-etc-openvswitch\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f42190ea-4133-4159-adc1-5992a2419e48-hosts-file\") pod \"node-resolver-wrjzt\" (UID: \"f42190ea-4133-4159-adc1-5992a2419e48\") " pod="openshift-dns/node-resolver-wrjzt" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363054 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-os-release\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363082 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-run-ovn-kubernetes\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.363105 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-socket-dir-parent\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.363176 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs podName:0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c nodeName:}" failed. No retries permitted until 2026-07-06 12:04:36.863158501 +0000 UTC m=+1.964314745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs") pod "network-metrics-daemon-s42x4" (UID: "0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-device-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-systemd-units\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363246 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-run-ovn\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.468582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363277 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-log-socket\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/430d933f-e79d-4b07-9a30-7ede3de09fd4-host-slash\") pod \"iptables-alerter-j8ps7\" (UID: \"430d933f-e79d-4b07-9a30-7ede3de09fd4\") " pod="openshift-network-operator/iptables-alerter-j8ps7" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-system-cni-dir\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363364 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-registration-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363392 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363425 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-system-cni-dir\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363692 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363934 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70cbe769-cfca-4181-9f72-764a0319dc40-cni-binary-copy\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.363974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-env-overrides\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364032 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-run-netns\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23b776be-2e40-4be4-88a9-f8425351069f-konnectivity-ca\") pod \"konnectivity-agent-xz98j\" (UID: \"23b776be-2e40-4be4-88a9-f8425351069f\") " pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6260540c-39d5-488b-bf5d-10a9355bd58d-host\") pod \"node-ca-52t5f\" (UID: \"6260540c-39d5-488b-bf5d-10a9355bd58d\") " pod="openshift-image-registry/node-ca-52t5f" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364150 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70cbe769-cfca-4181-9f72-764a0319dc40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-ovnkube-config\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-var-lib-cni-bin\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.469226 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364246 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-cni-netd\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-conf-dir\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364311 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cf64023-0805-407b-b5f0-cbc7421e5880-cni-binary-copy\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-var-lib-kubelet\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-run-k8s-cni-cncf-io\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-hostroot\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364383 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-host-cni-bin\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-socket-dir\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cf64023-0805-407b-b5f0-cbc7421e5880-host-run-netns\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-ovnkube-script-lib\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70cbe769-cfca-4181-9f72-764a0319dc40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.364893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70cbe769-cfca-4181-9f72-764a0319dc40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.365211 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cf64023-0805-407b-b5f0-cbc7421e5880-multus-daemon-config\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.365318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6260540c-39d5-488b-bf5d-10a9355bd58d-serviceca\") pod \"node-ca-52t5f\" (UID: \"6260540c-39d5-488b-bf5d-10a9355bd58d\") " pod="openshift-image-registry/node-ca-52t5f" Jul 06 12:04:36.469800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.366996 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-ovn-node-metrics-cert\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.367116 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23b776be-2e40-4be4-88a9-f8425351069f-agent-certs\") pod \"konnectivity-agent-xz98j\" (UID: \"23b776be-2e40-4be4-88a9-f8425351069f\") " pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.376276 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.415521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7x6p\" (UniqueName: \"kubernetes.io/projected/2cf64023-0805-407b-b5f0-cbc7421e5880-kube-api-access-m7x6p\") pod \"multus-lcxqh\" (UID: \"2cf64023-0805-407b-b5f0-cbc7421e5880\") " pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.416098 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtkr2\" (UniqueName: \"kubernetes.io/projected/f42190ea-4133-4159-adc1-5992a2419e48-kube-api-access-mtkr2\") pod \"node-resolver-wrjzt\" (UID: \"f42190ea-4133-4159-adc1-5992a2419e48\") " pod="openshift-dns/node-resolver-wrjzt" Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.419553 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.419577 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.419593 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzq7s for pod openshift-network-diagnostics/network-check-target-khmk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.419557 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzh2t\" (UniqueName: \"kubernetes.io/projected/6260540c-39d5-488b-bf5d-10a9355bd58d-kube-api-access-qzh2t\") pod \"node-ca-52t5f\" (UID: \"6260540c-39d5-488b-bf5d-10a9355bd58d\") " pod="openshift-image-registry/node-ca-52t5f" Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.419660 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s podName:378182f3-6f36-45f6-ac4e-a8537fe3af85 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:36.919640371 +0000 UTC m=+2.020796614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kzq7s" (UniqueName: "kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s") pod "network-check-target-khmk2" (UID: "378182f3-6f36-45f6-ac4e-a8537fe3af85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.419722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtpr6\" (UniqueName: \"kubernetes.io/projected/430d933f-e79d-4b07-9a30-7ede3de09fd4-kube-api-access-xtpr6\") pod \"iptables-alerter-j8ps7\" (UID: \"430d933f-e79d-4b07-9a30-7ede3de09fd4\") " pod="openshift-network-operator/iptables-alerter-j8ps7" Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.419830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w46tr\" (UniqueName: \"kubernetes.io/projected/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-kube-api-access-w46tr\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.419914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kff9c\" (UniqueName: \"kubernetes.io/projected/4b0eedcc-75c0-479a-803d-5cfcea2c7f91-kube-api-access-kff9c\") pod \"aws-ebs-csi-driver-node-hmc7z\" (UID: \"4b0eedcc-75c0-479a-803d-5cfcea2c7f91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.422039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n87dc\" (UniqueName: \"kubernetes.io/projected/11ebbc1d-77cf-4781-b63f-8ffb1ba69b47-kube-api-access-n87dc\") pod \"ovnkube-node-25hfn\" (UID: \"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.423904 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h26c8\" (UniqueName: \"kubernetes.io/projected/70cbe769-cfca-4181-9f72-764a0319dc40-kube-api-access-h26c8\") pod \"multus-additional-cni-plugins-n8s5q\" (UID: \"70cbe769-cfca-4181-9f72-764a0319dc40\") " pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.470536 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.432719 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-52t5f" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.463449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-tuned\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.463485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-sysctl-d\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.463501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-host\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.463615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-host\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.463712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-sysctl-d\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.463856 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-kubernetes\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.463945 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-kubernetes\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.463989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-modprobe-d\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41c95ced-bcf2-45fa-8bd9-83087356789d-tmp\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.464113 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-dbus\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.464172 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret podName:e142fd3b-253b-4bd7-ad85-8899b6fd1a6e nodeName:}" failed. No retries permitted until 2026-07-06 12:04:36.964153292 +0000 UTC m=+2.065309513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret") pod "global-pull-secret-syncer-2j8wm" (UID: "e142fd3b-253b-4bd7-ad85-8899b6fd1a6e") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:36.471242 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-sysconfig\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-run\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-var-lib-kubelet\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-sysctl-conf\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-sys\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464366 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-dbus\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-sysconfig\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-lib-modules\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-var-lib-kubelet\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-systemd\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-run\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464528 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-sys\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgsm4\" (UniqueName: \"kubernetes.io/projected/41c95ced-bcf2-45fa-8bd9-83087356789d-kube-api-access-bgsm4\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-kubelet-config\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-lib-modules\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.471743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464686 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-systemd\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.472367 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-sysctl-conf\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.472367 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464838 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-modprobe-d\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.472367 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.464876 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-kubelet-config\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:36.472367 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.465902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41c95ced-bcf2-45fa-8bd9-83087356789d-etc-tuned\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.472367 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.466242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41c95ced-bcf2-45fa-8bd9-83087356789d-tmp\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.565601 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.482260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgsm4\" (UniqueName: \"kubernetes.io/projected/41c95ced-bcf2-45fa-8bd9-83087356789d-kube-api-access-bgsm4\") pod \"tuned-lvt87\" (UID: \"41c95ced-bcf2-45fa-8bd9-83087356789d\") " pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.565601 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.529550 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.590447 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n8s5q" Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.593178 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j8ps7" Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:36.602536 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff989a6f978fee52ada7de3499ed5674.slice/crio-8dc93e05de046508da2f50d59c795d592ab5b51b29b3af4f47f3c3c115294c11 WatchSource:0}: Error finding container 8dc93e05de046508da2f50d59c795d592ab5b51b29b3af4f47f3c3c115294c11: Status 404 returned error can't find the container with id 8dc93e05de046508da2f50d59c795d592ab5b51b29b3af4f47f3c3c115294c11 Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:36.603143 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f40d69b924b41315506b765aa0f993.slice/crio-4905acdbef9e11723c221fb39817ac6becf1fffff0f392c8f16243898e6c37e0 WatchSource:0}: Error finding container 4905acdbef9e11723c221fb39817ac6becf1fffff0f392c8f16243898e6c37e0: Status 404 returned error can't find the container with id 4905acdbef9e11723c221fb39817ac6becf1fffff0f392c8f16243898e6c37e0 Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:36.606956 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70cbe769_cfca_4181_9f72_764a0319dc40.slice/crio-e5a55b40aca1968cf80bee92670fd9ee5c9c6b75336b16550c295f496fafd665 WatchSource:0}: Error finding container e5a55b40aca1968cf80bee92670fd9ee5c9c6b75336b16550c295f496fafd665: Status 404 returned error can't find the container with id e5a55b40aca1968cf80bee92670fd9ee5c9c6b75336b16550c295f496fafd665 Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.609144 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:36.609575 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod430d933f_e79d_4b07_9a30_7ede3de09fd4.slice/crio-f7596b4ff2b0982c16c3907b77250865af5b0a385b0d94cf024f9272534c4781 WatchSource:0}: Error finding container f7596b4ff2b0982c16c3907b77250865af5b0a385b0d94cf024f9272534c4781: Status 404 returned error can't find the container with id f7596b4ff2b0982c16c3907b77250865af5b0a385b0d94cf024f9272534c4781 Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.633730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:36.642737 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0eedcc_75c0_479a_803d_5cfcea2c7f91.slice/crio-59fc2ff28233bd4e4a2b18ede8363a9139cbe042fa8bbc22df416d53ea045e2e WatchSource:0}: Error finding container 59fc2ff28233bd4e4a2b18ede8363a9139cbe042fa8bbc22df416d53ea045e2e: Status 404 returned error can't find the container with id 59fc2ff28233bd4e4a2b18ede8363a9139cbe042fa8bbc22df416d53ea045e2e Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.651955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wrjzt" Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:36.658495 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42190ea_4133_4159_adc1_5992a2419e48.slice/crio-959cd15938060ea534663b0be144d93c9f1aafc68555ccb78581c1d40074094c WatchSource:0}: Error finding container 959cd15938060ea534663b0be144d93c9f1aafc68555ccb78581c1d40074094c: Status 404 returned error can't find the container with id 959cd15938060ea534663b0be144d93c9f1aafc68555ccb78581c1d40074094c Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.693880 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lcxqh" Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.700711 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:36.700919 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf64023_0805_407b_b5f0_cbc7421e5880.slice/crio-a29fcf1266ad30fe1052a84ace5c082f8e4067fff9f381b766d1c1def7f4ba94 WatchSource:0}: Error finding container a29fcf1266ad30fe1052a84ace5c082f8e4067fff9f381b766d1c1def7f4ba94: Status 404 returned error can't find the container with id a29fcf1266ad30fe1052a84ace5c082f8e4067fff9f381b766d1c1def7f4ba94 Jul 06 12:04:36.723808 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:36.709083 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ebbc1d_77cf_4781_b63f_8ffb1ba69b47.slice/crio-4333e8806883859be4ec99319b7b96cc64b5e15d94463ea52801c14526b49cbb WatchSource:0}: Error finding container 4333e8806883859be4ec99319b7b96cc64b5e15d94463ea52801c14526b49cbb: Status 404 returned error can't find the container with id 4333e8806883859be4ec99319b7b96cc64b5e15d94463ea52801c14526b49cbb Jul 06 12:04:36.861655 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.739026 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lvt87" Jul 06 12:04:36.861655 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:36.746620 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c95ced_bcf2_45fa_8bd9_83087356789d.slice/crio-012d19b89c4ca7b3266bd6f5f05ad37755f2a2034816f997f3ebdad146635c4c WatchSource:0}: Error finding container 012d19b89c4ca7b3266bd6f5f05ad37755f2a2034816f997f3ebdad146635c4c: Status 404 returned error can't find the container with id 012d19b89c4ca7b3266bd6f5f05ad37755f2a2034816f997f3ebdad146635c4c Jul 06 12:04:36.861655 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.787325 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 12:04:36.867856 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.867510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:36.867856 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.867623 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:36.867856 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.867694 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs podName:0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c nodeName:}" failed. No retries permitted until 2026-07-06 12:04:37.867672364 +0000 UTC m=+2.968828585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs") pod "network-metrics-daemon-s42x4" (UID: "0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:37.004072 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.968443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:37.004072 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:36.968478 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzq7s\" (UniqueName: \"kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s\") pod \"network-check-target-khmk2\" (UID: \"378182f3-6f36-45f6-ac4e-a8537fe3af85\") " pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:37.004072 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.968557 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:37.004072 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.968572 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:37.004072 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.968589 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:37.004072 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.968600 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzq7s for pod openshift-network-diagnostics/network-check-target-khmk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:37.004072 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.968605 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret podName:e142fd3b-253b-4bd7-ad85-8899b6fd1a6e nodeName:}" failed. No retries permitted until 2026-07-06 12:04:37.968591034 +0000 UTC m=+3.069747259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret") pod "global-pull-secret-syncer-2j8wm" (UID: "e142fd3b-253b-4bd7-ad85-8899b6fd1a6e") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:37.004072 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:36.968637 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s podName:378182f3-6f36-45f6-ac4e-a8537fe3af85 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:37.968623612 +0000 UTC m=+3.069779837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzq7s" (UniqueName: "kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s") pod "network-check-target-khmk2" (UID: "378182f3-6f36-45f6-ac4e-a8537fe3af85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:37.116233 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.115751 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 12:04:37.117003 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:04:37.116573 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6260540c_39d5_488b_bf5d_10a9355bd58d.slice/crio-e68334c2b3043f1d52a990972ed3e877539da556cf4ac272dab8ea564439b784 WatchSource:0}: Error finding container e68334c2b3043f1d52a990972ed3e877539da556cf4ac272dab8ea564439b784: Status 404 returned error can't find the container with id e68334c2b3043f1d52a990972ed3e877539da556cf4ac272dab8ea564439b784 Jul 06 12:04:37.371492 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.318815 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 11:59:36 +0000 UTC" deadline="2028-04-22 23:43:10.790613492 +0000 UTC" Jul 06 12:04:37.371492 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.318872 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15755h38m33.471745382s" Jul 06 12:04:37.504676 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.503864 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:37.504676 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:37.503980 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:37.504676 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.504069 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:37.504676 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:37.504179 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:37.504676 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.504247 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:37.504676 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:37.504316 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:37.534695 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.534583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xz98j" event={"ID":"23b776be-2e40-4be4-88a9-f8425351069f","Type":"ContainerStarted","Data":"bd694237d43fd2ae5b85eb02e33ce80dca58b8d9fd91dd1b70e092f5abdd6ac1"} Jul 06 12:04:37.551369 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.551340 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" event={"ID":"4b0eedcc-75c0-479a-803d-5cfcea2c7f91","Type":"ContainerStarted","Data":"59fc2ff28233bd4e4a2b18ede8363a9139cbe042fa8bbc22df416d53ea045e2e"} Jul 06 12:04:37.557491 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.557384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j8ps7" event={"ID":"430d933f-e79d-4b07-9a30-7ede3de09fd4","Type":"ContainerStarted","Data":"f7596b4ff2b0982c16c3907b77250865af5b0a385b0d94cf024f9272534c4781"} Jul 06 12:04:37.567284 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.567208 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-52t5f" event={"ID":"6260540c-39d5-488b-bf5d-10a9355bd58d","Type":"ContainerStarted","Data":"e68334c2b3043f1d52a990972ed3e877539da556cf4ac272dab8ea564439b784"} Jul 06 12:04:37.584662 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.584631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wrjzt" event={"ID":"f42190ea-4133-4159-adc1-5992a2419e48","Type":"ContainerStarted","Data":"959cd15938060ea534663b0be144d93c9f1aafc68555ccb78581c1d40074094c"} Jul 06 12:04:37.590825 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.590798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8s5q" event={"ID":"70cbe769-cfca-4181-9f72-764a0319dc40","Type":"ContainerStarted","Data":"e5a55b40aca1968cf80bee92670fd9ee5c9c6b75336b16550c295f496fafd665"} Jul 06 12:04:37.596595 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.596290 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" event={"ID":"59f40d69b924b41315506b765aa0f993","Type":"ContainerStarted","Data":"4905acdbef9e11723c221fb39817ac6becf1fffff0f392c8f16243898e6c37e0"} Jul 06 12:04:37.602844 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.602785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" event={"ID":"ff989a6f978fee52ada7de3499ed5674","Type":"ContainerStarted","Data":"8dc93e05de046508da2f50d59c795d592ab5b51b29b3af4f47f3c3c115294c11"} Jul 06 12:04:37.614335 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.614312 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lvt87" event={"ID":"41c95ced-bcf2-45fa-8bd9-83087356789d","Type":"ContainerStarted","Data":"012d19b89c4ca7b3266bd6f5f05ad37755f2a2034816f997f3ebdad146635c4c"} Jul 06 12:04:37.616400 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.616373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" event={"ID":"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47","Type":"ContainerStarted","Data":"4333e8806883859be4ec99319b7b96cc64b5e15d94463ea52801c14526b49cbb"} Jul 06 12:04:37.623083 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.623057 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lcxqh" event={"ID":"2cf64023-0805-407b-b5f0-cbc7421e5880","Type":"ContainerStarted","Data":"a29fcf1266ad30fe1052a84ace5c082f8e4067fff9f381b766d1c1def7f4ba94"} Jul 06 12:04:37.878139 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.878025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:37.878319 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:37.878264 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:37.878394 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:37.878326 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs podName:0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c nodeName:}" failed. No retries permitted until 2026-07-06 12:04:39.87830568 +0000 UTC m=+4.979461907 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs") pod "network-metrics-daemon-s42x4" (UID: "0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:37.948133 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.947896 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 12:04:37.979748 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.978954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:37.979748 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:37.979000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzq7s\" (UniqueName: \"kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s\") pod \"network-check-target-khmk2\" (UID: \"378182f3-6f36-45f6-ac4e-a8537fe3af85\") " pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:37.979748 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:37.979198 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:37.979748 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:37.979219 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:37.979748 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:37.979233 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzq7s for pod openshift-network-diagnostics/network-check-target-khmk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:37.979748 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:37.979288 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s podName:378182f3-6f36-45f6-ac4e-a8537fe3af85 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:39.979269004 +0000 UTC m=+5.080425229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzq7s" (UniqueName: "kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s") pod "network-check-target-khmk2" (UID: "378182f3-6f36-45f6-ac4e-a8537fe3af85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:37.979748 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:37.979660 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:37.979748 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:37.979713 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret podName:e142fd3b-253b-4bd7-ad85-8899b6fd1a6e nodeName:}" failed. No retries permitted until 2026-07-06 12:04:39.979697567 +0000 UTC m=+5.080853793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret") pod "global-pull-secret-syncer-2j8wm" (UID: "e142fd3b-253b-4bd7-ad85-8899b6fd1a6e") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:38.319203 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:38.319109 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 11:59:36 +0000 UTC" deadline="2028-03-13 22:07:19.510362774 +0000 UTC" Jul 06 12:04:38.319203 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:38.319151 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14794h2m41.191216794s" Jul 06 12:04:39.503842 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:39.503230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:39.503842 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:39.503354 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:39.503842 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:39.503442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:39.503842 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:39.503570 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:39.503842 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:39.503637 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:39.503842 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:39.503726 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:39.900276 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:39.899665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:39.900276 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:39.899815 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:39.900276 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:39.899882 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs podName:0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c nodeName:}" failed. No retries permitted until 2026-07-06 12:04:43.899861036 +0000 UTC m=+9.001017267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs") pod "network-metrics-daemon-s42x4" (UID: "0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:40.000835 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:40.000797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:40.001013 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:40.000851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzq7s\" (UniqueName: \"kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s\") pod \"network-check-target-khmk2\" (UID: \"378182f3-6f36-45f6-ac4e-a8537fe3af85\") " pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:40.001106 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:40.001056 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:40.001106 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:40.001099 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:40.001226 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:40.001113 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzq7s for pod openshift-network-diagnostics/network-check-target-khmk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:40.001226 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:40.001176 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s podName:378182f3-6f36-45f6-ac4e-a8537fe3af85 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:44.00115588 +0000 UTC m=+9.102312105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzq7s" (UniqueName: "kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s") pod "network-check-target-khmk2" (UID: "378182f3-6f36-45f6-ac4e-a8537fe3af85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:40.001555 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:40.001462 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:40.001555 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:40.001527 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret podName:e142fd3b-253b-4bd7-ad85-8899b6fd1a6e nodeName:}" failed. No retries permitted until 2026-07-06 12:04:44.001510654 +0000 UTC m=+9.102666892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret") pod "global-pull-secret-syncer-2j8wm" (UID: "e142fd3b-253b-4bd7-ad85-8899b6fd1a6e") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:41.502772 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:41.502126 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:41.502772 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:41.502250 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:41.502772 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:41.502614 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:41.502772 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:41.502726 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:41.503605 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:41.503469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:41.503605 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:41.503571 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:43.502558 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:43.502160 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:43.502558 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:43.502283 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:43.502558 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:43.502290 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:43.502558 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:43.502160 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:43.502558 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:43.502408 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:43.502558 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:43.502510 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:43.933766 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:43.933681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:43.933912 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:43.933833 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:43.933979 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:43.933911 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs podName:0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c nodeName:}" failed. No retries permitted until 2026-07-06 12:04:51.933890465 +0000 UTC m=+17.035046685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs") pod "network-metrics-daemon-s42x4" (UID: "0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:44.034033 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:44.033999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:44.034207 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:44.034051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzq7s\" (UniqueName: \"kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s\") pod \"network-check-target-khmk2\" (UID: \"378182f3-6f36-45f6-ac4e-a8537fe3af85\") " pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:44.034207 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:44.034172 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:44.034311 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:44.034233 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:44.034311 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:44.034238 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret podName:e142fd3b-253b-4bd7-ad85-8899b6fd1a6e nodeName:}" failed. No retries permitted until 2026-07-06 12:04:52.034222193 +0000 UTC m=+17.135378430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret") pod "global-pull-secret-syncer-2j8wm" (UID: "e142fd3b-253b-4bd7-ad85-8899b6fd1a6e") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:44.034311 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:44.034247 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:44.034311 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:44.034260 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzq7s for pod openshift-network-diagnostics/network-check-target-khmk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:44.034311 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:44.034295 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s podName:378182f3-6f36-45f6-ac4e-a8537fe3af85 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:52.034283995 +0000 UTC m=+17.135440215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzq7s" (UniqueName: "kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s") pod "network-check-target-khmk2" (UID: "378182f3-6f36-45f6-ac4e-a8537fe3af85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:45.502633 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:45.502601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:45.503105 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:45.502712 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:45.503197 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:45.503123 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:45.503257 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:45.503229 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:45.503314 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:45.503289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:45.503381 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:45.503362 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:47.502016 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:47.501980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:47.502016 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:47.501980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:47.502608 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:47.502142 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:47.502608 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:47.502218 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:47.502608 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:47.502300 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:47.502608 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:47.502375 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:49.501968 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:49.501932 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:49.501968 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:49.501956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:49.502490 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:49.502067 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:49.502490 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:49.502167 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:49.502490 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:49.502220 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:49.502490 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:49.502299 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:51.501634 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:51.501598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:51.502119 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:51.501599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:51.502119 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:51.501742 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:51.502119 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:51.501840 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:51.502119 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:51.501604 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:51.502119 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:51.501955 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:51.990937 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:51.990851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:51.991107 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:51.990986 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:51.991107 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:51.991061 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs podName:0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c nodeName:}" failed. No retries permitted until 2026-07-06 12:05:07.99103085 +0000 UTC m=+33.092187069 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs") pod "network-metrics-daemon-s42x4" (UID: "0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:52.092097 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:52.092060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:52.092097 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:52.092097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzq7s\" (UniqueName: \"kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s\") pod \"network-check-target-khmk2\" (UID: \"378182f3-6f36-45f6-ac4e-a8537fe3af85\") " pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:52.092299 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:52.092213 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:52.092299 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:52.092231 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:52.092299 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:52.092244 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:52.092299 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:52.092253 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzq7s for pod openshift-network-diagnostics/network-check-target-khmk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:52.092299 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:52.092278 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret podName:e142fd3b-253b-4bd7-ad85-8899b6fd1a6e nodeName:}" failed. No retries permitted until 2026-07-06 12:05:08.092259413 +0000 UTC m=+33.193415634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret") pod "global-pull-secret-syncer-2j8wm" (UID: "e142fd3b-253b-4bd7-ad85-8899b6fd1a6e") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:52.092299 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:52.092293 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s podName:378182f3-6f36-45f6-ac4e-a8537fe3af85 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:08.092287286 +0000 UTC m=+33.193443506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzq7s" (UniqueName: "kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s") pod "network-check-target-khmk2" (UID: "378182f3-6f36-45f6-ac4e-a8537fe3af85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:53.501936 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:53.501904 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:53.502402 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:53.501942 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:53.502402 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:53.501914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:53.502402 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:53.502027 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:53.502402 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:53.502205 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:53.502402 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:53.502297 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:55.502690 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:55.502464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:55.503159 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:55.502549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:55.503159 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:55.502762 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:55.503159 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:55.502862 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:55.503159 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:55.502588 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:55.503159 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:55.502946 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:57.501762 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.501586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:57.502349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.501582 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:57.502349 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:57.501862 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:57.502349 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:57.501909 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:57.502349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.501593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:57.502349 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:57.502009 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:57.677403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.677358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" event={"ID":"ff989a6f978fee52ada7de3499ed5674","Type":"ContainerStarted","Data":"48b18b506d0e37b965aa9022b7c8473b345aaa355d683a6e3ee2d35e32edb82f"} Jul 06 12:04:57.678818 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.678793 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lvt87" event={"ID":"41c95ced-bcf2-45fa-8bd9-83087356789d","Type":"ContainerStarted","Data":"5f011d746f3cdbf2f2cd2891210dc77eabef1e3d51f18df12e30e97a8b148fbd"} Jul 06 12:04:57.681817 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.681794 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" event={"ID":"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47","Type":"ContainerStarted","Data":"38fcb01a2020b2e22b577e950c8c1b200cdbad157a21eb1f2c46eab80af8d938"} Jul 06 12:04:57.681939 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.681859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" event={"ID":"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47","Type":"ContainerStarted","Data":"7259319b710b374e7c227a3a0ad9fd729ea4a359d39401fd9d58bbbf06ee7606"} Jul 06 12:04:57.681939 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.681900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" event={"ID":"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47","Type":"ContainerStarted","Data":"43bbb1b327cca02488c3825256397dbb7d3886cc03a79b177e6562f3f221f680"} Jul 06 12:04:57.681939 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.681933 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" event={"ID":"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47","Type":"ContainerStarted","Data":"b6ef56c83f01916951233b3c0851caff6a4850313227b578ded3f85ba5ad604e"} Jul 06 12:04:57.682104 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.681972 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" event={"ID":"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47","Type":"ContainerStarted","Data":"ed42329575224652a99cf5e782704e95a4f198a0bb86d35fd6e8b893ee94d9eb"} Jul 06 12:04:57.682104 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.682008 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" event={"ID":"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47","Type":"ContainerStarted","Data":"93e51b2752905bd2e27240ef94abd9b175e618fc6571de40c6b726c196b37888"} Jul 06 12:04:57.683386 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.683239 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lcxqh" event={"ID":"2cf64023-0805-407b-b5f0-cbc7421e5880","Type":"ContainerStarted","Data":"93ef487841d85ed91f2fa478257e23227a6461d935d1bc21d192f731dc933f6a"} Jul 06 12:04:57.722637 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.722598 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lcxqh" podStartSLOduration=2.6504967280000002 podStartE2EDuration="22.72258429s" totalImagesPullingTime="20.072087562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:57.7221607 +0000 UTC m=+22.823316963" watchObservedRunningTime="2026-07-06 12:04:57.72258429 +0000 UTC m=+22.823740532" Jul 06 12:04:57.722746 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.722727 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" podStartSLOduration=21.722723262 podStartE2EDuration="21.722723262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:57.700925733 +0000 UTC m=+22.802081974" watchObservedRunningTime="2026-07-06 12:04:57.722723262 +0000 UTC m=+22.823879517" Jul 06 12:04:57.746465 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:57.746412 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lvt87" podStartSLOduration=1.7667880249999999 podStartE2EDuration="21.746390348s" totalImagesPullingTime="19.979602323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:57.745910205 +0000 UTC m=+22.847066450" watchObservedRunningTime="2026-07-06 12:04:57.746390348 +0000 UTC m=+22.847546591" Jul 06 12:04:58.686543 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.686505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xz98j" event={"ID":"23b776be-2e40-4be4-88a9-f8425351069f","Type":"ContainerStarted","Data":"6729b2a069a3bf03da50f49fa494cc8f1f0b0ad203809bde70590e17b071e3e1"} Jul 06 12:04:58.688013 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.687861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" event={"ID":"4b0eedcc-75c0-479a-803d-5cfcea2c7f91","Type":"ContainerStarted","Data":"1b2db55518d4f6a7e9f6fe5269f19a73229494438364729ae3f3d544e166e1e5"} Jul 06 12:04:58.689079 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.689058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j8ps7" event={"ID":"430d933f-e79d-4b07-9a30-7ede3de09fd4","Type":"ContainerStarted","Data":"91812bb865988fb60df087151a58150ff19527acf758ae0fb66963c0c5b5e529"} Jul 06 12:04:58.690343 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.690315 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-52t5f" event={"ID":"6260540c-39d5-488b-bf5d-10a9355bd58d","Type":"ContainerStarted","Data":"26daba7fb742214590ca5c80278e5d4994e0ebcdfe17e4e4a95a24faf9f17657"} Jul 06 12:04:58.691586 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.691564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wrjzt" event={"ID":"f42190ea-4133-4159-adc1-5992a2419e48","Type":"ContainerStarted","Data":"54ab08e0e80949b532c69f194ba58e4495021005c813d24b70222c5c9d80806c"} Jul 06 12:04:58.692909 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.692889 2576 generic.go:356] "Generic (PLEG): container finished" podID="70cbe769-cfca-4181-9f72-764a0319dc40" containerID="16559326d09eefe38b18e25ae53e810037033f96f021c445b9a3e250748da0c8" exitCode=0 Jul 06 12:04:58.692988 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.692965 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8s5q" event={"ID":"70cbe769-cfca-4181-9f72-764a0319dc40","Type":"ContainerDied","Data":"16559326d09eefe38b18e25ae53e810037033f96f021c445b9a3e250748da0c8"} Jul 06 12:04:58.694202 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.694184 2576 generic.go:356] "Generic (PLEG): container finished" podID="59f40d69b924b41315506b765aa0f993" containerID="bade70dfa6f58531edebf04d3f1899c2060572db5930ee6832e1e1492244f586" exitCode=0 Jul 06 12:04:58.694290 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.694269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" event={"ID":"59f40d69b924b41315506b765aa0f993","Type":"ContainerDied","Data":"bade70dfa6f58531edebf04d3f1899c2060572db5930ee6832e1e1492244f586"} Jul 06 12:04:58.741225 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.741188 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xz98j" podStartSLOduration=3.730744433 podStartE2EDuration="23.741176412s" totalImagesPullingTime="20.010431979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:58.716687707 +0000 UTC m=+23.817843949" watchObservedRunningTime="2026-07-06 12:04:58.741176412 +0000 UTC m=+23.842332654" Jul 06 12:04:58.800405 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.800371 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wrjzt" podStartSLOduration=3.688613325 podStartE2EDuration="23.800358929s" totalImagesPullingTime="20.111745604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:58.799519635 +0000 UTC m=+23.900675876" watchObservedRunningTime="2026-07-06 12:04:58.800358929 +0000 UTC m=+23.901515171" Jul 06 12:04:58.830654 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.830617 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j8ps7" podStartSLOduration=3.66266932 podStartE2EDuration="23.830606204s" totalImagesPullingTime="20.167936884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:58.830405266 +0000 UTC m=+23.931561528" watchObservedRunningTime="2026-07-06 12:04:58.830606204 +0000 UTC m=+23.931762447" Jul 06 12:04:58.899167 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:58.899135 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 12:04:59.329495 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:59.329393 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T12:04:58.899152414Z","UUID":"ef5f398d-ce7f-497c-b9a7-36bb4784038d","Handler":null,"Name":"","Endpoint":""} Jul 06 12:04:59.331007 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:59.330987 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 12:04:59.331144 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:59.331032 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 12:04:59.501604 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:59.501578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:04:59.501736 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:59.501671 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:04:59.501736 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:59.501578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:04:59.501736 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:59.501711 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:04:59.501856 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:59.501780 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:04:59.501902 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:04:59.501856 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:04:59.699770 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:59.699695 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" event={"ID":"4b0eedcc-75c0-479a-803d-5cfcea2c7f91","Type":"ContainerStarted","Data":"dc7bd7e57833dc0e2e239af3c7cc8eaf2b4704d0f7329e78a86d4f61b5b274ef"} Jul 06 12:04:59.701749 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:59.701694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" event={"ID":"59f40d69b924b41315506b765aa0f993","Type":"ContainerStarted","Data":"248e87f917ca8bb056b39775b5ce6178d2b03868528d5226ee951cf3ad015943"} Jul 06 12:04:59.728878 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:04:59.728824 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-52t5f" podStartSLOduration=5.096745669 podStartE2EDuration="24.728805311s" totalImagesPullingTime="19.632059642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:58.860958672 +0000 UTC m=+23.962114933" watchObservedRunningTime="2026-07-06 12:04:59.728805311 +0000 UTC m=+24.829961554" Jul 06 12:05:00.707625 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:00.707583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" event={"ID":"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47","Type":"ContainerStarted","Data":"f5b9848bff5a3ea5bcda8bf7cc45fcae3d5d64002ada4cacc054f645cb19d444"} Jul 06 12:05:00.709861 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:00.709832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" event={"ID":"4b0eedcc-75c0-479a-803d-5cfcea2c7f91","Type":"ContainerStarted","Data":"ae93e89d1252a9f85a85f7d960acf3526b06f39a9ec8a92b1f97ddce28ffb746"} Jul 06 12:05:00.734395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:00.734354 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" podStartSLOduration=24.734339159 podStartE2EDuration="24.734339159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:59.729731513 +0000 UTC m=+24.830887759" watchObservedRunningTime="2026-07-06 12:05:00.734339159 +0000 UTC m=+25.835495400" Jul 06 12:05:00.852112 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:00.852085 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:05:00.855401 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:00.855373 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:05:00.874514 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:00.874475 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmc7z" podStartSLOduration=3.715374678 podStartE2EDuration="25.874461266s" totalImagesPullingTime="22.159086588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:00.734391457 +0000 UTC m=+25.835547720" watchObservedRunningTime="2026-07-06 12:05:00.874461266 +0000 UTC m=+25.975617566" Jul 06 12:05:01.501543 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:01.501513 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:05:01.501707 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:01.501514 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:05:01.501707 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:01.501628 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:05:01.501823 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:01.501701 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:05:01.501823 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:01.501756 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:05:01.501932 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:01.501823 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:05:01.712493 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:01.712459 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:05:01.712997 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:01.712978 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xz98j" Jul 06 12:05:03.502017 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.501867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:05:03.502526 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.501874 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:05:03.502526 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:03.502119 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:05:03.502526 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.501901 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:05:03.502526 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:03.502196 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:05:03.502526 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:03.502255 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:05:03.717388 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.717362 2576 generic.go:356] "Generic (PLEG): container finished" podID="70cbe769-cfca-4181-9f72-764a0319dc40" containerID="d75f20df37d46f7585efab56a475f940d330b044967750f4abff0726857e425a" exitCode=0 Jul 06 12:05:03.717508 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.717459 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8s5q" event={"ID":"70cbe769-cfca-4181-9f72-764a0319dc40","Type":"ContainerDied","Data":"d75f20df37d46f7585efab56a475f940d330b044967750f4abff0726857e425a"} Jul 06 12:05:03.723178 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.723151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" event={"ID":"11ebbc1d-77cf-4781-b63f-8ffb1ba69b47","Type":"ContainerStarted","Data":"36b9dcfbeb5bbb21bed3ab193a96a0c730e0aab9b64c0beb35e46a49e18a1228"} Jul 06 12:05:03.723404 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.723382 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:05:03.723538 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.723523 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:05:03.723595 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.723580 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:05:03.737935 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.737889 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:05:03.738170 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.738155 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:05:03.783717 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:03.783681 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" podStartSLOduration=8.666186248 podStartE2EDuration="28.783669825s" totalImagesPullingTime="20.117483577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:03.783564658 +0000 UTC m=+28.884720900" watchObservedRunningTime="2026-07-06 12:05:03.783669825 +0000 UTC m=+28.884826066" Jul 06 12:05:05.338054 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:05.337803 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2j8wm"] Jul 06 12:05:05.338484 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:05.338101 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:05:05.338484 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:05.338186 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:05:05.340618 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:05.340593 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-khmk2"] Jul 06 12:05:05.340722 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:05.340680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:05:05.340769 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:05.340752 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:05:05.355382 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:05.355360 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s42x4"] Jul 06 12:05:05.355481 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:05.355468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:05:05.355601 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:05.355581 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:05:05.729450 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:05.729374 2576 generic.go:356] "Generic (PLEG): container finished" podID="70cbe769-cfca-4181-9f72-764a0319dc40" containerID="3d07f50014ae1328ad4995c2585aeb23dc60086714363caf9c13ef3020e4d9f8" exitCode=0 Jul 06 12:05:05.729605 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:05.729465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8s5q" event={"ID":"70cbe769-cfca-4181-9f72-764a0319dc40","Type":"ContainerDied","Data":"3d07f50014ae1328ad4995c2585aeb23dc60086714363caf9c13ef3020e4d9f8"} Jul 06 12:05:07.501881 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:07.501851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:05:07.502349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:07.501851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:05:07.502349 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:07.501966 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:05:07.502349 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:07.502073 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:05:07.502349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:07.502137 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:05:07.502349 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:07.502217 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:05:07.736140 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:07.736112 2576 generic.go:356] "Generic (PLEG): container finished" podID="70cbe769-cfca-4181-9f72-764a0319dc40" containerID="0966eece8c65807ecb2884732a1f4fb3eb655769067c613320526f7bb91d3298" exitCode=0 Jul 06 12:05:07.736272 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:07.736154 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8s5q" event={"ID":"70cbe769-cfca-4181-9f72-764a0319dc40","Type":"ContainerDied","Data":"0966eece8c65807ecb2884732a1f4fb3eb655769067c613320526f7bb91d3298"} Jul 06 12:05:08.010382 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:08.010315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:05:08.010513 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:08.010418 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:05:08.010513 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:08.010465 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs podName:0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c nodeName:}" failed. No retries permitted until 2026-07-06 12:05:40.010452194 +0000 UTC m=+65.111608414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs") pod "network-metrics-daemon-s42x4" (UID: "0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:05:08.110871 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:08.110847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:05:08.110871 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:08.110878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzq7s\" (UniqueName: \"kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s\") pod \"network-check-target-khmk2\" (UID: \"378182f3-6f36-45f6-ac4e-a8537fe3af85\") " pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:05:08.111029 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:08.110988 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:05:08.111029 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:08.111001 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:05:08.111121 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:08.111067 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret podName:e142fd3b-253b-4bd7-ad85-8899b6fd1a6e nodeName:}" failed. No retries permitted until 2026-07-06 12:05:40.111032772 +0000 UTC m=+65.212189001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret") pod "global-pull-secret-syncer-2j8wm" (UID: "e142fd3b-253b-4bd7-ad85-8899b6fd1a6e") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:05:08.111121 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:08.111070 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:05:08.111121 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:08.111086 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzq7s for pod openshift-network-diagnostics/network-check-target-khmk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:05:08.111212 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:08.111125 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s podName:378182f3-6f36-45f6-ac4e-a8537fe3af85 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:40.111114419 +0000 UTC m=+65.212270639 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzq7s" (UniqueName: "kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s") pod "network-check-target-khmk2" (UID: "378182f3-6f36-45f6-ac4e-a8537fe3af85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:05:09.501889 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.501818 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:05:09.502241 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.501831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:05:09.502241 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:09.501933 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khmk2" podUID="378182f3-6f36-45f6-ac4e-a8537fe3af85" Jul 06 12:05:09.502241 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.501831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:05:09.502241 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:09.501994 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s42x4" podUID="0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c" Jul 06 12:05:09.502241 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:09.502084 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2j8wm" podUID="e142fd3b-253b-4bd7-ad85-8899b6fd1a6e" Jul 06 12:05:09.599422 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.599396 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeReady" Jul 06 12:05:09.599577 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.599541 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 12:05:09.662772 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.662742 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6pwsb"] Jul 06 12:05:09.664668 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.664653 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.669586 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.669561 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6qcfg\"" Jul 06 12:05:09.670712 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.670693 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 12:05:09.670712 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.670696 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 12:05:09.672081 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.672059 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jwpzh"] Jul 06 12:05:09.674003 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.673986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwpzh" Jul 06 12:05:09.676777 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.676760 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 12:05:09.676852 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.676806 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 12:05:09.676899 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.676845 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 12:05:09.679453 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.679435 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t7z7n\"" Jul 06 12:05:09.690184 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.690165 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwpzh"] Jul 06 12:05:09.691015 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.690994 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6pwsb"] Jul 06 12:05:09.721634 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.721604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.721738 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.721641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9qwk\" (UniqueName: \"kubernetes.io/projected/6df8d581-a737-47d1-bdfb-d66b252e8962-kube-api-access-d9qwk\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.721801 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.721758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6df8d581-a737-47d1-bdfb-d66b252e8962-tmp-dir\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.721801 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.721795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6df8d581-a737-47d1-bdfb-d66b252e8962-config-volume\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.823202 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.823094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6df8d581-a737-47d1-bdfb-d66b252e8962-config-volume\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.823311 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.823209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d855740-d3f8-4a00-9af9-a41335fbac36-cert\") pod \"ingress-canary-jwpzh\" (UID: \"3d855740-d3f8-4a00-9af9-a41335fbac36\") " pod="openshift-ingress-canary/ingress-canary-jwpzh" Jul 06 12:05:09.823311 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.823257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.823311 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.823285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9qwk\" (UniqueName: \"kubernetes.io/projected/6df8d581-a737-47d1-bdfb-d66b252e8962-kube-api-access-d9qwk\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.823470 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.823365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6df8d581-a737-47d1-bdfb-d66b252e8962-tmp-dir\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.823470 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.823389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s5hk\" (UniqueName: \"kubernetes.io/projected/3d855740-d3f8-4a00-9af9-a41335fbac36-kube-api-access-2s5hk\") pod \"ingress-canary-jwpzh\" (UID: \"3d855740-d3f8-4a00-9af9-a41335fbac36\") " pod="openshift-ingress-canary/ingress-canary-jwpzh" Jul 06 12:05:09.823470 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:09.823398 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:05:09.823470 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:09.823465 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls podName:6df8d581-a737-47d1-bdfb-d66b252e8962 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:10.323445203 +0000 UTC m=+35.424601425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls") pod "dns-default-6pwsb" (UID: "6df8d581-a737-47d1-bdfb-d66b252e8962") : secret "dns-default-metrics-tls" not found Jul 06 12:05:09.823753 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.823725 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6df8d581-a737-47d1-bdfb-d66b252e8962-tmp-dir\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.823859 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.823840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6df8d581-a737-47d1-bdfb-d66b252e8962-config-volume\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.835710 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.835573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9qwk\" (UniqueName: \"kubernetes.io/projected/6df8d581-a737-47d1-bdfb-d66b252e8962-kube-api-access-d9qwk\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:09.924573 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.924550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s5hk\" (UniqueName: \"kubernetes.io/projected/3d855740-d3f8-4a00-9af9-a41335fbac36-kube-api-access-2s5hk\") pod \"ingress-canary-jwpzh\" (UID: \"3d855740-d3f8-4a00-9af9-a41335fbac36\") " pod="openshift-ingress-canary/ingress-canary-jwpzh" Jul 06 12:05:09.924686 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.924580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d855740-d3f8-4a00-9af9-a41335fbac36-cert\") pod \"ingress-canary-jwpzh\" (UID: \"3d855740-d3f8-4a00-9af9-a41335fbac36\") " pod="openshift-ingress-canary/ingress-canary-jwpzh" Jul 06 12:05:09.926798 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.926782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d855740-d3f8-4a00-9af9-a41335fbac36-cert\") pod \"ingress-canary-jwpzh\" (UID: \"3d855740-d3f8-4a00-9af9-a41335fbac36\") " pod="openshift-ingress-canary/ingress-canary-jwpzh" Jul 06 12:05:09.935169 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.935145 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s5hk\" (UniqueName: \"kubernetes.io/projected/3d855740-d3f8-4a00-9af9-a41335fbac36-kube-api-access-2s5hk\") pod \"ingress-canary-jwpzh\" (UID: \"3d855740-d3f8-4a00-9af9-a41335fbac36\") " pod="openshift-ingress-canary/ingress-canary-jwpzh" Jul 06 12:05:09.982119 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:09.982092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwpzh" Jul 06 12:05:10.135142 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:10.135068 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwpzh"] Jul 06 12:05:10.138817 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:05:10.138790 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d855740_d3f8_4a00_9af9_a41335fbac36.slice/crio-7885e90c2668a05fc404722618f97b4cf223b19eb1d39feb4c0a001e1cf5ecd2 WatchSource:0}: Error finding container 7885e90c2668a05fc404722618f97b4cf223b19eb1d39feb4c0a001e1cf5ecd2: Status 404 returned error can't find the container with id 7885e90c2668a05fc404722618f97b4cf223b19eb1d39feb4c0a001e1cf5ecd2 Jul 06 12:05:10.327602 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:10.327572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:10.327774 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:10.327729 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:05:10.327822 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:10.327791 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls podName:6df8d581-a737-47d1-bdfb-d66b252e8962 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:11.327775284 +0000 UTC m=+36.428931503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls") pod "dns-default-6pwsb" (UID: "6df8d581-a737-47d1-bdfb-d66b252e8962") : secret "dns-default-metrics-tls" not found Jul 06 12:05:10.745321 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:10.745281 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwpzh" event={"ID":"3d855740-d3f8-4a00-9af9-a41335fbac36","Type":"ContainerStarted","Data":"7885e90c2668a05fc404722618f97b4cf223b19eb1d39feb4c0a001e1cf5ecd2"} Jul 06 12:05:11.335808 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:11.335768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:11.336006 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:11.335965 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:05:11.336094 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:11.336029 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls podName:6df8d581-a737-47d1-bdfb-d66b252e8962 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:13.336009818 +0000 UTC m=+38.437166043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls") pod "dns-default-6pwsb" (UID: "6df8d581-a737-47d1-bdfb-d66b252e8962") : secret "dns-default-metrics-tls" not found Jul 06 12:05:11.501914 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:11.501881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:05:11.502111 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:11.501881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:05:11.502111 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:11.502030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:05:11.504644 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:11.504590 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn8kl\"" Jul 06 12:05:11.505390 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:11.505374 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 12:05:11.505791 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:11.505765 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 12:05:11.505921 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:11.505771 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 12:05:11.506050 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:11.505942 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 12:05:11.506050 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:11.505989 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lb44c\"" Jul 06 12:05:12.752771 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:12.752666 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwpzh" event={"ID":"3d855740-d3f8-4a00-9af9-a41335fbac36","Type":"ContainerStarted","Data":"bd940453fda0ae73e36fae9f938aeabf7fd9ff4d34046f74ec15bb2e300f6216"} Jul 06 12:05:12.775776 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:12.775719 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jwpzh" podStartSLOduration=1.508957025 podStartE2EDuration="3.775698123s" totalImagesPullingTime="2.266741098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:12.775383697 +0000 UTC m=+37.876539954" watchObservedRunningTime="2026-07-06 12:05:12.775698123 +0000 UTC m=+37.876854381" Jul 06 12:05:13.352437 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:13.352404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:13.352596 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:13.352538 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:05:13.352653 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:13.352608 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls podName:6df8d581-a737-47d1-bdfb-d66b252e8962 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:17.352588024 +0000 UTC m=+42.453744268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls") pod "dns-default-6pwsb" (UID: "6df8d581-a737-47d1-bdfb-d66b252e8962") : secret "dns-default-metrics-tls" not found Jul 06 12:05:14.759389 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:14.759359 2576 generic.go:356] "Generic (PLEG): container finished" podID="70cbe769-cfca-4181-9f72-764a0319dc40" containerID="334e3464bcae98ac5913fe8847bde327a3342adbc78f66865503e2973e997a2f" exitCode=0 Jul 06 12:05:14.759692 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:14.759400 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8s5q" event={"ID":"70cbe769-cfca-4181-9f72-764a0319dc40","Type":"ContainerDied","Data":"334e3464bcae98ac5913fe8847bde327a3342adbc78f66865503e2973e997a2f"} Jul 06 12:05:15.764935 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:15.764900 2576 generic.go:356] "Generic (PLEG): container finished" podID="70cbe769-cfca-4181-9f72-764a0319dc40" containerID="987736fcee88959b772c715705992754e2ac7563b137b64911e83e2624f50f5d" exitCode=0 Jul 06 12:05:15.765352 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:15.764944 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8s5q" event={"ID":"70cbe769-cfca-4181-9f72-764a0319dc40","Type":"ContainerDied","Data":"987736fcee88959b772c715705992754e2ac7563b137b64911e83e2624f50f5d"} Jul 06 12:05:16.770353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:16.770323 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8s5q" event={"ID":"70cbe769-cfca-4181-9f72-764a0319dc40","Type":"ContainerStarted","Data":"4be05872a3aadeef68a97309924cbad7216f7eef37ae9b67d89cb556ed62b910"} Jul 06 12:05:16.800984 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:16.800930 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n8s5q" podStartSLOduration=8.034008365 podStartE2EDuration="41.800911679s" totalImagesPullingTime="33.766903314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:16.800771233 +0000 UTC m=+41.901927474" watchObservedRunningTime="2026-07-06 12:05:16.800911679 +0000 UTC m=+41.902067922" Jul 06 12:05:17.382639 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:17.382598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:17.382802 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:17.382759 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:05:17.382948 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:17.382825 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls podName:6df8d581-a737-47d1-bdfb-d66b252e8962 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:25.38280863 +0000 UTC m=+50.483964850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls") pod "dns-default-6pwsb" (UID: "6df8d581-a737-47d1-bdfb-d66b252e8962") : secret "dns-default-metrics-tls" not found Jul 06 12:05:25.435232 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:25.435198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:25.435656 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:25.435336 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:05:25.435656 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:25.435408 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls podName:6df8d581-a737-47d1-bdfb-d66b252e8962 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:41.435391968 +0000 UTC m=+66.536548187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls") pod "dns-default-6pwsb" (UID: "6df8d581-a737-47d1-bdfb-d66b252e8962") : secret "dns-default-metrics-tls" not found Jul 06 12:05:34.503462 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.503429 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65"] Jul 06 12:05:34.506118 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.506098 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xk7q2"] Jul 06 12:05:34.506244 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.506217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" Jul 06 12:05:34.507633 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.507615 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.509281 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.509265 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4t8jr\"" Jul 06 12:05:34.509547 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.509531 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 12:05:34.510574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.510556 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 12:05:34.510862 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.510848 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 12:05:34.511688 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.511670 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 12:05:34.511780 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.511711 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 12:05:34.511969 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.511955 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 12:05:34.519405 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.519385 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 12:05:34.519517 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.519390 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 12:05:34.521613 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.520312 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h75jf\"" Jul 06 12:05:34.524496 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.524459 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k"] Jul 06 12:05:34.526821 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.526796 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65"] Jul 06 12:05:34.526821 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.526834 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xk7q2"] Jul 06 12:05:34.526985 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.526897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" Jul 06 12:05:34.530150 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.530136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 12:05:34.530445 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.530426 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 12:05:34.530488 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.530443 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 12:05:34.530723 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.530701 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 12:05:34.533610 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.533592 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tfndf\"" Jul 06 12:05:34.535308 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.535288 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 12:05:34.536108 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.536092 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k"] Jul 06 12:05:34.608988 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.608958 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl"] Jul 06 12:05:34.610551 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.610537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl" Jul 06 12:05:34.614087 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:34.614062 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-storage-operator\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 06 12:05:34.614361 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:34.614342 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"volume-data-source-validator-dockercfg-mrh55\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-storage-operator\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mrh55\"" type="*v1.Secret" Jul 06 12:05:34.614643 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:34.614605 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-storage-operator\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 06 12:05:34.614643 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:34.614624 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"volume-data-source-validator-5d456fdbcd-rp4sl\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-cluster-storage-operator\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="2a67dd30-bfd4-4b2c-ba58-e2b736d4d5ae" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl" Jul 06 12:05:34.638715 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.638686 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl"] Jul 06 12:05:34.696182 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c946d397-f878-4b84-9b5e-35060626abcd-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ph89k\" (UID: \"c946d397-f878-4b84-9b5e-35060626abcd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" Jul 06 12:05:34.696284 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1e7d93-35c0-4131-8aa8-353de71428f5-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.696284 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e1e7d93-35c0-4131-8aa8-353de71428f5-serving-cert\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.696284 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c946d397-f878-4b84-9b5e-35060626abcd-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ph89k\" (UID: \"c946d397-f878-4b84-9b5e-35060626abcd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" Jul 06 12:05:34.696284 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-662t5\" (UniqueName: \"kubernetes.io/projected/6995694f-3933-4b4f-8c82-4d466648162c-kube-api-access-662t5\") pod \"service-ca-operator-5d46d9ffd4-fvt65\" (UID: \"6995694f-3933-4b4f-8c82-4d466648162c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" Jul 06 12:05:34.696431 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4e1e7d93-35c0-4131-8aa8-353de71428f5-snapshots\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.696431 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6995694f-3933-4b4f-8c82-4d466648162c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-fvt65\" (UID: \"6995694f-3933-4b4f-8c82-4d466648162c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" Jul 06 12:05:34.696431 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftfnx\" (UniqueName: \"kubernetes.io/projected/c946d397-f878-4b84-9b5e-35060626abcd-kube-api-access-ftfnx\") pod \"kube-storage-version-migrator-operator-846bf668f7-ph89k\" (UID: \"c946d397-f878-4b84-9b5e-35060626abcd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" Jul 06 12:05:34.696532 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e1e7d93-35c0-4131-8aa8-353de71428f5-tmp\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.696532 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6995694f-3933-4b4f-8c82-4d466648162c-config\") pod \"service-ca-operator-5d46d9ffd4-fvt65\" (UID: \"6995694f-3933-4b4f-8c82-4d466648162c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" Jul 06 12:05:34.696609 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696536 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1e7d93-35c0-4131-8aa8-353de71428f5-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.696609 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.696556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg29b\" (UniqueName: \"kubernetes.io/projected/4e1e7d93-35c0-4131-8aa8-353de71428f5-kube-api-access-vg29b\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.797069 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6995694f-3933-4b4f-8c82-4d466648162c-config\") pod \"service-ca-operator-5d46d9ffd4-fvt65\" (UID: \"6995694f-3933-4b4f-8c82-4d466648162c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" Jul 06 12:05:34.797069 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1e7d93-35c0-4131-8aa8-353de71428f5-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.797069 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg29b\" (UniqueName: \"kubernetes.io/projected/4e1e7d93-35c0-4131-8aa8-353de71428f5-kube-api-access-vg29b\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.797254 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c946d397-f878-4b84-9b5e-35060626abcd-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ph89k\" (UID: \"c946d397-f878-4b84-9b5e-35060626abcd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" Jul 06 12:05:34.797254 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1e7d93-35c0-4131-8aa8-353de71428f5-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.797254 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e1e7d93-35c0-4131-8aa8-353de71428f5-serving-cert\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.797254 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c946d397-f878-4b84-9b5e-35060626abcd-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ph89k\" (UID: \"c946d397-f878-4b84-9b5e-35060626abcd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" Jul 06 12:05:34.797254 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-662t5\" (UniqueName: \"kubernetes.io/projected/6995694f-3933-4b4f-8c82-4d466648162c-kube-api-access-662t5\") pod \"service-ca-operator-5d46d9ffd4-fvt65\" (UID: \"6995694f-3933-4b4f-8c82-4d466648162c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" Jul 06 12:05:34.797504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797262 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4e1e7d93-35c0-4131-8aa8-353de71428f5-snapshots\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.797504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6995694f-3933-4b4f-8c82-4d466648162c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-fvt65\" (UID: \"6995694f-3933-4b4f-8c82-4d466648162c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" Jul 06 12:05:34.797504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftfnx\" (UniqueName: \"kubernetes.io/projected/c946d397-f878-4b84-9b5e-35060626abcd-kube-api-access-ftfnx\") pod \"kube-storage-version-migrator-operator-846bf668f7-ph89k\" (UID: \"c946d397-f878-4b84-9b5e-35060626abcd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" Jul 06 12:05:34.797504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e1e7d93-35c0-4131-8aa8-353de71428f5-tmp\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.797504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26dvf\" (UniqueName: \"kubernetes.io/projected/2a67dd30-bfd4-4b2c-ba58-e2b736d4d5ae-kube-api-access-26dvf\") pod \"volume-data-source-validator-5d456fdbcd-rp4sl\" (UID: \"2a67dd30-bfd4-4b2c-ba58-e2b736d4d5ae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl" Jul 06 12:05:34.798185 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c946d397-f878-4b84-9b5e-35060626abcd-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ph89k\" (UID: \"c946d397-f878-4b84-9b5e-35060626abcd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" Jul 06 12:05:34.798185 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e1e7d93-35c0-4131-8aa8-353de71428f5-tmp\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.798185 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.797972 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1e7d93-35c0-4131-8aa8-353de71428f5-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.798185 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.798015 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1e7d93-35c0-4131-8aa8-353de71428f5-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.798185 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.798019 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6995694f-3933-4b4f-8c82-4d466648162c-config\") pod \"service-ca-operator-5d46d9ffd4-fvt65\" (UID: \"6995694f-3933-4b4f-8c82-4d466648162c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" Jul 06 12:05:34.798442 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.798245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4e1e7d93-35c0-4131-8aa8-353de71428f5-snapshots\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.800481 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.800458 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c946d397-f878-4b84-9b5e-35060626abcd-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ph89k\" (UID: \"c946d397-f878-4b84-9b5e-35060626abcd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" Jul 06 12:05:34.800481 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.800472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6995694f-3933-4b4f-8c82-4d466648162c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-fvt65\" (UID: \"6995694f-3933-4b4f-8c82-4d466648162c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" Jul 06 12:05:34.800670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.800650 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e1e7d93-35c0-4131-8aa8-353de71428f5-serving-cert\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.814001 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.813983 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-662t5\" (UniqueName: \"kubernetes.io/projected/6995694f-3933-4b4f-8c82-4d466648162c-kube-api-access-662t5\") pod \"service-ca-operator-5d46d9ffd4-fvt65\" (UID: \"6995694f-3933-4b4f-8c82-4d466648162c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" Jul 06 12:05:34.814386 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.814365 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg29b\" (UniqueName: \"kubernetes.io/projected/4e1e7d93-35c0-4131-8aa8-353de71428f5-kube-api-access-vg29b\") pod \"insights-operator-5c847dcfc4-xk7q2\" (UID: \"4e1e7d93-35c0-4131-8aa8-353de71428f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.815458 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.815443 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" Jul 06 12:05:34.815871 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.815851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftfnx\" (UniqueName: \"kubernetes.io/projected/c946d397-f878-4b84-9b5e-35060626abcd-kube-api-access-ftfnx\") pod \"kube-storage-version-migrator-operator-846bf668f7-ph89k\" (UID: \"c946d397-f878-4b84-9b5e-35060626abcd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" Jul 06 12:05:34.821138 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.821120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" Jul 06 12:05:34.835310 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.835292 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" Jul 06 12:05:34.898174 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.898009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26dvf\" (UniqueName: \"kubernetes.io/projected/2a67dd30-bfd4-4b2c-ba58-e2b736d4d5ae-kube-api-access-26dvf\") pod \"volume-data-source-validator-5d456fdbcd-rp4sl\" (UID: \"2a67dd30-bfd4-4b2c-ba58-e2b736d4d5ae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl" Jul 06 12:05:34.955384 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.955350 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65"] Jul 06 12:05:34.958600 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:05:34.958575 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6995694f_3933_4b4f_8c82_4d466648162c.slice/crio-e07e868889547cce0691b2d535657ee28aba6f336caff0f5e885a1325f917495 WatchSource:0}: Error finding container e07e868889547cce0691b2d535657ee28aba6f336caff0f5e885a1325f917495: Status 404 returned error can't find the container with id e07e868889547cce0691b2d535657ee28aba6f336caff0f5e885a1325f917495 Jul 06 12:05:34.973485 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.973470 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xk7q2"] Jul 06 12:05:34.975476 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:05:34.975455 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1e7d93_35c0_4131_8aa8_353de71428f5.slice/crio-c140d0711d01500f8f69eba2ee89a91c3e67d916b40c5256cff37eb2f3cf784e WatchSource:0}: Error finding container c140d0711d01500f8f69eba2ee89a91c3e67d916b40c5256cff37eb2f3cf784e: Status 404 returned error can't find the container with id c140d0711d01500f8f69eba2ee89a91c3e67d916b40c5256cff37eb2f3cf784e Jul 06 12:05:34.990156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:34.990133 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k"] Jul 06 12:05:34.992520 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:05:34.992503 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc946d397_f878_4b84_9b5e_35060626abcd.slice/crio-b1eed1e021ec578115e011292108e42a2939f9d96ae0eca3c50469a2bbdbb327 WatchSource:0}: Error finding container b1eed1e021ec578115e011292108e42a2939f9d96ae0eca3c50469a2bbdbb327: Status 404 returned error can't find the container with id b1eed1e021ec578115e011292108e42a2939f9d96ae0eca3c50469a2bbdbb327 Jul 06 12:05:35.743319 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:35.743289 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25hfn" Jul 06 12:05:35.771894 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:35.771868 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 12:05:35.830817 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:35.830739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" event={"ID":"c946d397-f878-4b84-9b5e-35060626abcd","Type":"ContainerStarted","Data":"b1eed1e021ec578115e011292108e42a2939f9d96ae0eca3c50469a2bbdbb327"} Jul 06 12:05:35.832418 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:35.832383 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" event={"ID":"6995694f-3933-4b4f-8c82-4d466648162c","Type":"ContainerStarted","Data":"e07e868889547cce0691b2d535657ee28aba6f336caff0f5e885a1325f917495"} Jul 06 12:05:35.834266 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:35.834240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" event={"ID":"4e1e7d93-35c0-4131-8aa8-353de71428f5","Type":"ContainerStarted","Data":"c140d0711d01500f8f69eba2ee89a91c3e67d916b40c5256cff37eb2f3cf784e"} Jul 06 12:05:35.905528 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:35.905309 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 12:05:35.910587 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:35.910538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26dvf\" (UniqueName: \"kubernetes.io/projected/2a67dd30-bfd4-4b2c-ba58-e2b736d4d5ae-kube-api-access-26dvf\") pod \"volume-data-source-validator-5d456fdbcd-rp4sl\" (UID: \"2a67dd30-bfd4-4b2c-ba58-e2b736d4d5ae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl" Jul 06 12:05:36.138540 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:36.138333 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mrh55\"" Jul 06 12:05:36.139370 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:36.139346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl" Jul 06 12:05:36.329643 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:36.329453 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl"] Jul 06 12:05:36.332933 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:05:36.332898 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a67dd30_bfd4_4b2c_ba58_e2b736d4d5ae.slice/crio-41dfce869baf5952ca7d0cc5bbd24ce31201b087cfa5d025a02c8efc097dfbdd WatchSource:0}: Error finding container 41dfce869baf5952ca7d0cc5bbd24ce31201b087cfa5d025a02c8efc097dfbdd: Status 404 returned error can't find the container with id 41dfce869baf5952ca7d0cc5bbd24ce31201b087cfa5d025a02c8efc097dfbdd Jul 06 12:05:36.838209 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:36.838178 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl" event={"ID":"2a67dd30-bfd4-4b2c-ba58-e2b736d4d5ae","Type":"ContainerStarted","Data":"41dfce869baf5952ca7d0cc5bbd24ce31201b087cfa5d025a02c8efc097dfbdd"} Jul 06 12:05:38.844717 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:38.844676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" event={"ID":"c946d397-f878-4b84-9b5e-35060626abcd","Type":"ContainerStarted","Data":"8e2f4a93e02ed5ef9ebba548eaba78cf032bb115197989c5cc844c57174b56ef"} Jul 06 12:05:38.846365 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:38.846335 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" event={"ID":"6995694f-3933-4b4f-8c82-4d466648162c","Type":"ContainerStarted","Data":"2aca64bdbb2135a202da9442907e3d80d44bf8272ee040e3fa3fdedce132c926"} Jul 06 12:05:38.847926 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:38.847899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" event={"ID":"4e1e7d93-35c0-4131-8aa8-353de71428f5","Type":"ContainerStarted","Data":"20acbb528c0dd1cac5b753481a9d460beef7e0f88e1f7c490f63229b55e9eba9"} Jul 06 12:05:38.849565 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:38.849540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl" event={"ID":"2a67dd30-bfd4-4b2c-ba58-e2b736d4d5ae","Type":"ContainerStarted","Data":"90508bad8595fd0b75c35e5032692cd6d106637a148717676da2d79afe4fb936"} Jul 06 12:05:38.866731 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:38.866681 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" podStartSLOduration=1.462280255 podStartE2EDuration="4.866669337s" totalImagesPullingTime="3.404389082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:38.86498509 +0000 UTC m=+63.966141353" watchObservedRunningTime="2026-07-06 12:05:38.866669337 +0000 UTC m=+63.967825589" Jul 06 12:05:38.887511 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:38.887467 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rp4sl" podStartSLOduration=2.572113689 podStartE2EDuration="4.887441848s" totalImagesPullingTime="2.315328159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:38.886531692 +0000 UTC m=+63.987687935" watchObservedRunningTime="2026-07-06 12:05:38.887441848 +0000 UTC m=+63.988598088" Jul 06 12:05:38.944001 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:38.943923 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" podStartSLOduration=1.511431915 podStartE2EDuration="4.94391108s" totalImagesPullingTime="3.432479165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:38.943685777 +0000 UTC m=+64.044842020" watchObservedRunningTime="2026-07-06 12:05:38.94391108 +0000 UTC m=+64.045067345" Jul 06 12:05:38.944001 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:38.943993 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" podStartSLOduration=1.519755175 podStartE2EDuration="4.943990094s" totalImagesPullingTime="3.424234919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:38.913948919 +0000 UTC m=+64.015105160" watchObservedRunningTime="2026-07-06 12:05:38.943990094 +0000 UTC m=+64.045146336" Jul 06 12:05:40.037558 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.037519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:05:40.040466 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.040442 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 12:05:40.047876 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:40.047860 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 12:05:40.047926 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:40.047918 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs podName:0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c nodeName:}" failed. No retries permitted until 2026-07-06 12:06:44.0478988 +0000 UTC m=+129.149055020 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs") pod "network-metrics-daemon-s42x4" (UID: "0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c") : secret "metrics-daemon-secret" not found Jul 06 12:05:40.138537 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.138500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:05:40.138537 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.138534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzq7s\" (UniqueName: \"kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s\") pod \"network-check-target-khmk2\" (UID: \"378182f3-6f36-45f6-ac4e-a8537fe3af85\") " pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:05:40.145146 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.145122 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 12:05:40.145253 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.145164 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 12:05:40.150864 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.150840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e142fd3b-253b-4bd7-ad85-8899b6fd1a6e-original-pull-secret\") pod \"global-pull-secret-syncer-2j8wm\" (UID: \"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e\") " pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:05:40.151457 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.151441 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 12:05:40.161669 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.161647 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzq7s\" (UniqueName: \"kubernetes.io/projected/378182f3-6f36-45f6-ac4e-a8537fe3af85-kube-api-access-kzq7s\") pod \"network-check-target-khmk2\" (UID: \"378182f3-6f36-45f6-ac4e-a8537fe3af85\") " pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:05:40.294247 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.294180 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j"] Jul 06 12:05:40.296605 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.296590 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j" Jul 06 12:05:40.300494 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.300470 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 12:05:40.300592 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.300474 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 12:05:40.314971 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.314950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2j8wm" Jul 06 12:05:40.317549 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.317530 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j"] Jul 06 12:05:40.321488 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.321468 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8mphh\"" Jul 06 12:05:40.328499 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.328482 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn8kl\"" Jul 06 12:05:40.334527 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.334491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:05:40.339705 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.339684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sswxt\" (UniqueName: \"kubernetes.io/projected/20edec91-b8f4-4ca7-b254-1e34c55dd9cd-kube-api-access-sswxt\") pod \"migrator-d57d58cc9-k675j\" (UID: \"20edec91-b8f4-4ca7-b254-1e34c55dd9cd\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j" Jul 06 12:05:40.440843 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.440809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sswxt\" (UniqueName: \"kubernetes.io/projected/20edec91-b8f4-4ca7-b254-1e34c55dd9cd-kube-api-access-sswxt\") pod \"migrator-d57d58cc9-k675j\" (UID: \"20edec91-b8f4-4ca7-b254-1e34c55dd9cd\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j" Jul 06 12:05:40.465632 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.465601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sswxt\" (UniqueName: \"kubernetes.io/projected/20edec91-b8f4-4ca7-b254-1e34c55dd9cd-kube-api-access-sswxt\") pod \"migrator-d57d58cc9-k675j\" (UID: \"20edec91-b8f4-4ca7-b254-1e34c55dd9cd\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j" Jul 06 12:05:40.478241 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.478213 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2j8wm"] Jul 06 12:05:40.483343 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:05:40.483322 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode142fd3b_253b_4bd7_ad85_8899b6fd1a6e.slice/crio-52889fa2e339a40016423f855d240314b44fab7edfa9d2661bb89ce94a23a3f5 WatchSource:0}: Error finding container 52889fa2e339a40016423f855d240314b44fab7edfa9d2661bb89ce94a23a3f5: Status 404 returned error can't find the container with id 52889fa2e339a40016423f855d240314b44fab7edfa9d2661bb89ce94a23a3f5 Jul 06 12:05:40.485403 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.485382 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-khmk2"] Jul 06 12:05:40.491194 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:05:40.491167 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod378182f3_6f36_45f6_ac4e_a8537fe3af85.slice/crio-05ddb1c19c290c147177d5a93c866e1c52ef997aff3dfda59d89b4802aade035 WatchSource:0}: Error finding container 05ddb1c19c290c147177d5a93c866e1c52ef997aff3dfda59d89b4802aade035: Status 404 returned error can't find the container with id 05ddb1c19c290c147177d5a93c866e1c52ef997aff3dfda59d89b4802aade035 Jul 06 12:05:40.605964 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.605896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j" Jul 06 12:05:40.743104 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.743073 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j"] Jul 06 12:05:40.746659 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:05:40.746636 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20edec91_b8f4_4ca7_b254_1e34c55dd9cd.slice/crio-e969531621cbca68490afe2fbb58d8df0b276af84bbc46e5e02aa042dbade022 WatchSource:0}: Error finding container e969531621cbca68490afe2fbb58d8df0b276af84bbc46e5e02aa042dbade022: Status 404 returned error can't find the container with id e969531621cbca68490afe2fbb58d8df0b276af84bbc46e5e02aa042dbade022 Jul 06 12:05:40.856264 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.856182 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2j8wm" event={"ID":"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e","Type":"ContainerStarted","Data":"52889fa2e339a40016423f855d240314b44fab7edfa9d2661bb89ce94a23a3f5"} Jul 06 12:05:40.857520 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.857490 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j" event={"ID":"20edec91-b8f4-4ca7-b254-1e34c55dd9cd","Type":"ContainerStarted","Data":"e969531621cbca68490afe2fbb58d8df0b276af84bbc46e5e02aa042dbade022"} Jul 06 12:05:40.858772 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.858751 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-khmk2" event={"ID":"378182f3-6f36-45f6-ac4e-a8537fe3af85","Type":"ContainerStarted","Data":"05ddb1c19c290c147177d5a93c866e1c52ef997aff3dfda59d89b4802aade035"} Jul 06 12:05:40.858924 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.858904 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4zpf7"] Jul 06 12:05:40.862148 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.862130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:40.866486 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.866468 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 12:05:40.866734 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.866718 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 12:05:40.869376 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.869357 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q47gn\"" Jul 06 12:05:40.885179 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.885159 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4zpf7"] Jul 06 12:05:40.944330 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.944299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqms5\" (UniqueName: \"kubernetes.io/projected/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-api-access-qqms5\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:40.944482 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.944346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e7c6152-e958-4d73-a0b8-22765417cf9d-data-volume\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:40.944482 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.944377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:40.944482 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.944406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:40.944643 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:40.944522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e7c6152-e958-4d73-a0b8-22765417cf9d-crio-socket\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:41.045707 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.045668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e7c6152-e958-4d73-a0b8-22765417cf9d-crio-socket\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:41.046160 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.045716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqms5\" (UniqueName: \"kubernetes.io/projected/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-api-access-qqms5\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:41.046160 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.045747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e7c6152-e958-4d73-a0b8-22765417cf9d-data-volume\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:41.046160 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.045770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:41.046160 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.045798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:41.046160 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.045795 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e7c6152-e958-4d73-a0b8-22765417cf9d-crio-socket\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:41.046160 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:41.045900 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 12:05:41.046160 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:41.045908 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 12:05:41.046160 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:41.045956 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls podName:3e7c6152-e958-4d73-a0b8-22765417cf9d nodeName:}" failed. No retries permitted until 2026-07-06 12:05:41.545937457 +0000 UTC m=+66.647093692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4zpf7" (UID: "3e7c6152-e958-4d73-a0b8-22765417cf9d") : secret "insights-runtime-extractor-tls" not found Jul 06 12:05:41.046160 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:41.045974 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm podName:3e7c6152-e958-4d73-a0b8-22765417cf9d nodeName:}" failed. No retries permitted until 2026-07-06 12:05:41.54596459 +0000 UTC m=+66.647120813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4zpf7" (UID: "3e7c6152-e958-4d73-a0b8-22765417cf9d") : configmap "kube-rbac-proxy" not found Jul 06 12:05:41.046160 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.046082 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e7c6152-e958-4d73-a0b8-22765417cf9d-data-volume\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:41.059458 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.059439 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqms5\" (UniqueName: \"kubernetes.io/projected/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-api-access-qqms5\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:41.328388 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.328323 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-lgkg7"] Jul 06 12:05:41.330680 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.330658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lgkg7" Jul 06 12:05:41.336910 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.336887 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8bdll\"" Jul 06 12:05:41.348143 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.348070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg57b\" (UniqueName: \"kubernetes.io/projected/f800eae1-c023-4d9c-ac3e-f605e6acb3ec-kube-api-access-vg57b\") pod \"network-check-source-989f8b8dc-lgkg7\" (UID: \"f800eae1-c023-4d9c-ac3e-f605e6acb3ec\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lgkg7" Jul 06 12:05:41.350753 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.350730 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-lgkg7"] Jul 06 12:05:41.449611 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.449530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:05:41.449783 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.449633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg57b\" (UniqueName: \"kubernetes.io/projected/f800eae1-c023-4d9c-ac3e-f605e6acb3ec-kube-api-access-vg57b\") pod \"network-check-source-989f8b8dc-lgkg7\" (UID: \"f800eae1-c023-4d9c-ac3e-f605e6acb3ec\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lgkg7" Jul 06 12:05:41.449783 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:41.449683 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:05:41.449783 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:41.449746 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls podName:6df8d581-a737-47d1-bdfb-d66b252e8962 nodeName:}" failed. No retries permitted until 2026-07-06 12:06:13.449726963 +0000 UTC m=+98.550883201 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls") pod "dns-default-6pwsb" (UID: "6df8d581-a737-47d1-bdfb-d66b252e8962") : secret "dns-default-metrics-tls" not found Jul 06 12:05:41.462938 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.462900 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg57b\" (UniqueName: \"kubernetes.io/projected/f800eae1-c023-4d9c-ac3e-f605e6acb3ec-kube-api-access-vg57b\") pod \"network-check-source-989f8b8dc-lgkg7\" (UID: \"f800eae1-c023-4d9c-ac3e-f605e6acb3ec\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lgkg7" Jul 06 12:05:41.550439 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.550380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:41.550683 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.550494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:41.550683 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:41.550524 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 12:05:41.550683 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:41.550571 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 12:05:41.550683 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:41.550603 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls podName:3e7c6152-e958-4d73-a0b8-22765417cf9d nodeName:}" failed. No retries permitted until 2026-07-06 12:05:42.55058058 +0000 UTC m=+67.651736803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4zpf7" (UID: "3e7c6152-e958-4d73-a0b8-22765417cf9d") : secret "insights-runtime-extractor-tls" not found Jul 06 12:05:41.550683 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:41.550622 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm podName:3e7c6152-e958-4d73-a0b8-22765417cf9d nodeName:}" failed. No retries permitted until 2026-07-06 12:05:42.550612151 +0000 UTC m=+67.651768379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4zpf7" (UID: "3e7c6152-e958-4d73-a0b8-22765417cf9d") : configmap "kube-rbac-proxy" not found Jul 06 12:05:41.642619 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.642548 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lgkg7" Jul 06 12:05:41.807450 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.807377 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-lgkg7"] Jul 06 12:05:41.813159 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:05:41.813126 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf800eae1_c023_4d9c_ac3e_f605e6acb3ec.slice/crio-3bdde0b29a20a175b8f60b65997384060b5801ea4fb363b6b25860e1ef391063 WatchSource:0}: Error finding container 3bdde0b29a20a175b8f60b65997384060b5801ea4fb363b6b25860e1ef391063: Status 404 returned error can't find the container with id 3bdde0b29a20a175b8f60b65997384060b5801ea4fb363b6b25860e1ef391063 Jul 06 12:05:41.865138 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:41.865099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lgkg7" event={"ID":"f800eae1-c023-4d9c-ac3e-f605e6acb3ec","Type":"ContainerStarted","Data":"3bdde0b29a20a175b8f60b65997384060b5801ea4fb363b6b25860e1ef391063"} Jul 06 12:05:42.560859 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:42.560801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:42.560859 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:42.560831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:42.561310 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:42.560910 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 12:05:42.561310 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:42.560963 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 12:05:42.561310 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:42.560983 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm podName:3e7c6152-e958-4d73-a0b8-22765417cf9d nodeName:}" failed. No retries permitted until 2026-07-06 12:05:44.56096123 +0000 UTC m=+69.662117453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4zpf7" (UID: "3e7c6152-e958-4d73-a0b8-22765417cf9d") : configmap "kube-rbac-proxy" not found Jul 06 12:05:42.561310 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:42.561015 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls podName:3e7c6152-e958-4d73-a0b8-22765417cf9d nodeName:}" failed. No retries permitted until 2026-07-06 12:05:44.560998089 +0000 UTC m=+69.662154312 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4zpf7" (UID: "3e7c6152-e958-4d73-a0b8-22765417cf9d") : secret "insights-runtime-extractor-tls" not found Jul 06 12:05:42.873737 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:42.873697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j" event={"ID":"20edec91-b8f4-4ca7-b254-1e34c55dd9cd","Type":"ContainerStarted","Data":"c4ef95cd129f285e9aab1317c7cbce516bd71c01300431e0e14feb56e7fd3724"} Jul 06 12:05:42.873918 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:42.873760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j" event={"ID":"20edec91-b8f4-4ca7-b254-1e34c55dd9cd","Type":"ContainerStarted","Data":"260613c5b1da889fc3d86437393fbf9663b76b49bc2ed62f4a26dfeac39d18b0"} Jul 06 12:05:42.910613 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:42.909986 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k675j" podStartSLOduration=1.286837642 podStartE2EDuration="2.90996475s" totalImagesPullingTime="1.623127108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:42.908358929 +0000 UTC m=+68.009515172" watchObservedRunningTime="2026-07-06 12:05:42.90996475 +0000 UTC m=+68.011120995" Jul 06 12:05:43.831556 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:43.831520 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wrjzt_f42190ea-4133-4159-adc1-5992a2419e48/dns-node-resolver/0.log" Jul 06 12:05:44.432379 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:44.432352 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-52t5f_6260540c-39d5-488b-bf5d-10a9355bd58d/node-ca/0.log" Jul 06 12:05:44.580793 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:44.580751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:44.580963 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:44.580807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:44.580963 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:44.580889 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 12:05:44.580963 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:44.580919 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 12:05:44.581177 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:44.580970 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm podName:3e7c6152-e958-4d73-a0b8-22765417cf9d nodeName:}" failed. No retries permitted until 2026-07-06 12:05:48.580947849 +0000 UTC m=+73.682104085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4zpf7" (UID: "3e7c6152-e958-4d73-a0b8-22765417cf9d") : configmap "kube-rbac-proxy" not found Jul 06 12:05:44.581177 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:44.581008 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls podName:3e7c6152-e958-4d73-a0b8-22765417cf9d nodeName:}" failed. No retries permitted until 2026-07-06 12:05:48.58098815 +0000 UTC m=+73.682144374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4zpf7" (UID: "3e7c6152-e958-4d73-a0b8-22765417cf9d") : secret "insights-runtime-extractor-tls" not found Jul 06 12:05:45.442977 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:45.442938 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jwpzh_3d855740-d3f8-4a00-9af9-a41335fbac36/serve-healthcheck-canary/0.log" Jul 06 12:05:45.831662 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:45.831623 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-k675j_20edec91-b8f4-4ca7-b254-1e34c55dd9cd/migrator/0.log" Jul 06 12:05:46.030863 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:46.030842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-k675j_20edec91-b8f4-4ca7-b254-1e34c55dd9cd/graceful-termination/0.log" Jul 06 12:05:46.239606 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:46.239573 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-ph89k_c946d397-f878-4b84-9b5e-35060626abcd/kube-storage-version-migrator-operator/0.log" Jul 06 12:05:46.892830 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:46.892795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-khmk2" event={"ID":"378182f3-6f36-45f6-ac4e-a8537fe3af85","Type":"ContainerStarted","Data":"4321cd44671e1c9f22cc5c84acd7e150523a8139e6b5ed961dc58cb27e2ecdc6"} Jul 06 12:05:46.893251 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:46.892874 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:05:46.894245 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:46.894220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lgkg7" event={"ID":"f800eae1-c023-4d9c-ac3e-f605e6acb3ec","Type":"ContainerStarted","Data":"0d990124dd601c14e579d042632d15b581ed5e11a13c19f4680a5e1287965631"} Jul 06 12:05:46.895900 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:46.895680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2j8wm" event={"ID":"e142fd3b-253b-4bd7-ad85-8899b6fd1a6e","Type":"ContainerStarted","Data":"c829b1fd133b087bb75141edc7e3cbaf25bb5a36e8e38135cbcc8479af6f277c"} Jul 06 12:05:46.919634 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:46.919593 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-khmk2" podStartSLOduration=66.507803337 podStartE2EDuration="1m11.919581349s" totalImagesPullingTime="5.411778012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:46.917789473 +0000 UTC m=+72.018945732" watchObservedRunningTime="2026-07-06 12:05:46.919581349 +0000 UTC m=+72.020737591" Jul 06 12:05:46.951618 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:46.951584 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lgkg7" podStartSLOduration=1.853132414 podStartE2EDuration="5.951572636s" totalImagesPullingTime="4.098440222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:46.950513455 +0000 UTC m=+72.051669714" watchObservedRunningTime="2026-07-06 12:05:46.951572636 +0000 UTC m=+72.052728888" Jul 06 12:05:48.615682 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:48.615649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:48.615682 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:48.615685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:48.616252 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:48.615782 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 12:05:48.616252 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:48.615873 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm podName:3e7c6152-e958-4d73-a0b8-22765417cf9d nodeName:}" failed. No retries permitted until 2026-07-06 12:05:56.615853671 +0000 UTC m=+81.717009896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4zpf7" (UID: "3e7c6152-e958-4d73-a0b8-22765417cf9d") : configmap "kube-rbac-proxy" not found Jul 06 12:05:48.616252 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:48.615792 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 12:05:48.616252 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:05:48.615931 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls podName:3e7c6152-e958-4d73-a0b8-22765417cf9d nodeName:}" failed. No retries permitted until 2026-07-06 12:05:56.615917396 +0000 UTC m=+81.717073616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4zpf7" (UID: "3e7c6152-e958-4d73-a0b8-22765417cf9d") : secret "insights-runtime-extractor-tls" not found Jul 06 12:05:56.674858 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:56.674824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:56.675453 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:56.674864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:56.675453 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:56.675318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e7c6152-e958-4d73-a0b8-22765417cf9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:56.677270 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:56.677243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e7c6152-e958-4d73-a0b8-22765417cf9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4zpf7\" (UID: \"3e7c6152-e958-4d73-a0b8-22765417cf9d\") " pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:56.771672 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:56.771649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4zpf7" Jul 06 12:05:56.897973 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:56.897901 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2j8wm" podStartSLOduration=75.478421542 podStartE2EDuration="1m20.897865182s" totalImagesPullingTime="5.41944364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:46.975015798 +0000 UTC m=+72.076172044" watchObservedRunningTime="2026-07-06 12:05:56.897865182 +0000 UTC m=+81.999021425" Jul 06 12:05:56.898371 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:56.898162 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4zpf7"] Jul 06 12:05:56.900682 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:05:56.900655 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7c6152_e958_4d73_a0b8_22765417cf9d.slice/crio-3ece7192366418518fbbf67d0c1d2460c8d4dca9f3600521b2238fe2ddf332fd WatchSource:0}: Error finding container 3ece7192366418518fbbf67d0c1d2460c8d4dca9f3600521b2238fe2ddf332fd: Status 404 returned error can't find the container with id 3ece7192366418518fbbf67d0c1d2460c8d4dca9f3600521b2238fe2ddf332fd Jul 06 12:05:56.928108 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:05:56.928034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4zpf7" event={"ID":"3e7c6152-e958-4d73-a0b8-22765417cf9d","Type":"ContainerStarted","Data":"3ece7192366418518fbbf67d0c1d2460c8d4dca9f3600521b2238fe2ddf332fd"} Jul 06 12:06:00.943602 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:00.943564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4zpf7" event={"ID":"3e7c6152-e958-4d73-a0b8-22765417cf9d","Type":"ContainerStarted","Data":"a3ce821b4f556698cfcbd8fa6ec5ea675ca9ca5a34dd8ca23b3483fa4d1725d2"} Jul 06 12:06:01.949225 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:01.949193 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4zpf7" event={"ID":"3e7c6152-e958-4d73-a0b8-22765417cf9d","Type":"ContainerStarted","Data":"923d528b1587c77e0dd7b9166331526921219314f3134d7b2c955757b0c0714b"} Jul 06 12:06:04.966129 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:04.966092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4zpf7" event={"ID":"3e7c6152-e958-4d73-a0b8-22765417cf9d","Type":"ContainerStarted","Data":"7d175eea704e403c138701932a1dc495352069dd2ce4627c1cee6c424921454f"} Jul 06 12:06:04.986614 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:04.986570 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4zpf7" podStartSLOduration=18.087746566 podStartE2EDuration="24.98655689s" totalImagesPullingTime="6.898810324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:05:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:04.985498376 +0000 UTC m=+90.086654617" watchObservedRunningTime="2026-07-06 12:06:04.98655689 +0000 UTC m=+90.087713132" Jul 06 12:06:10.939079 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.939034 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw"] Jul 06 12:06:10.943925 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.943902 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc"] Jul 06 12:06:10.944072 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.944029 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:10.947213 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.947195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc" Jul 06 12:06:10.948612 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.948596 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 12:06:10.949646 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.949630 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 12:06:10.949986 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.949971 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 12:06:10.950818 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.950415 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-v7b64\"" Jul 06 12:06:10.950818 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.950810 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 12:06:10.950998 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.950896 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 12:06:10.964669 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.964643 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc"] Jul 06 12:06:10.966018 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:10.965997 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw"] Jul 06 12:06:11.085370 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.085344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f1e7841-a3c8-4185-92af-bb0776965dda-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b7894c956-9dxrc\" (UID: \"0f1e7841-a3c8-4185-92af-bb0776965dda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc" Jul 06 12:06:11.085370 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.085373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8695b189-c45d-4c5a-9811-4f6968becfca-klusterlet-config\") pod \"klusterlet-addon-workmgr-867cbcdddf-pbmnw\" (UID: \"8695b189-c45d-4c5a-9811-4f6968becfca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:11.085571 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.085395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmg7l\" (UniqueName: \"kubernetes.io/projected/8695b189-c45d-4c5a-9811-4f6968becfca-kube-api-access-cmg7l\") pod \"klusterlet-addon-workmgr-867cbcdddf-pbmnw\" (UID: \"8695b189-c45d-4c5a-9811-4f6968becfca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:11.085571 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.085486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8695b189-c45d-4c5a-9811-4f6968becfca-tmp\") pod \"klusterlet-addon-workmgr-867cbcdddf-pbmnw\" (UID: \"8695b189-c45d-4c5a-9811-4f6968becfca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:11.085571 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.085511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcm9l\" (UniqueName: \"kubernetes.io/projected/0f1e7841-a3c8-4185-92af-bb0776965dda-kube-api-access-jcm9l\") pod \"managed-serviceaccount-addon-agent-b7894c956-9dxrc\" (UID: \"0f1e7841-a3c8-4185-92af-bb0776965dda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc" Jul 06 12:06:11.125243 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.125216 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-658c7f4dd8-fltx8"] Jul 06 12:06:11.127994 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.127980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.131194 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.131174 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 12:06:11.131312 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.131229 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 12:06:11.131428 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.131412 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vfj6t\"" Jul 06 12:06:11.131875 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.131860 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 12:06:11.185954 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.185930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcm9l\" (UniqueName: \"kubernetes.io/projected/0f1e7841-a3c8-4185-92af-bb0776965dda-kube-api-access-jcm9l\") pod \"managed-serviceaccount-addon-agent-b7894c956-9dxrc\" (UID: \"0f1e7841-a3c8-4185-92af-bb0776965dda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc" Jul 06 12:06:11.186084 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.185986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1823a516-57b5-458f-9d17-9fe71ef04052-registry-certificates\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.186084 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1823a516-57b5-458f-9d17-9fe71ef04052-bound-sa-token\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.186084 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f1e7841-a3c8-4185-92af-bb0776965dda-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b7894c956-9dxrc\" (UID: \"0f1e7841-a3c8-4185-92af-bb0776965dda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc" Jul 06 12:06:11.186201 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1823a516-57b5-458f-9d17-9fe71ef04052-image-registry-private-configuration\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.186201 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1823a516-57b5-458f-9d17-9fe71ef04052-ca-trust-extracted\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.186263 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8695b189-c45d-4c5a-9811-4f6968becfca-klusterlet-config\") pod \"klusterlet-addon-workmgr-867cbcdddf-pbmnw\" (UID: \"8695b189-c45d-4c5a-9811-4f6968becfca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:11.186263 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186250 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg8dj\" (UniqueName: \"kubernetes.io/projected/1823a516-57b5-458f-9d17-9fe71ef04052-kube-api-access-sg8dj\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.186324 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmg7l\" (UniqueName: \"kubernetes.io/projected/8695b189-c45d-4c5a-9811-4f6968becfca-kube-api-access-cmg7l\") pod \"klusterlet-addon-workmgr-867cbcdddf-pbmnw\" (UID: \"8695b189-c45d-4c5a-9811-4f6968becfca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:11.186324 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1823a516-57b5-458f-9d17-9fe71ef04052-registry-tls\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.186399 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186328 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1823a516-57b5-458f-9d17-9fe71ef04052-trusted-ca\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.186463 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8695b189-c45d-4c5a-9811-4f6968becfca-tmp\") pod \"klusterlet-addon-workmgr-867cbcdddf-pbmnw\" (UID: \"8695b189-c45d-4c5a-9811-4f6968becfca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:11.186525 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1823a516-57b5-458f-9d17-9fe71ef04052-installation-pull-secrets\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.186773 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.186755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8695b189-c45d-4c5a-9811-4f6968becfca-tmp\") pod \"klusterlet-addon-workmgr-867cbcdddf-pbmnw\" (UID: \"8695b189-c45d-4c5a-9811-4f6968becfca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:11.188526 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.188508 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8695b189-c45d-4c5a-9811-4f6968becfca-klusterlet-config\") pod \"klusterlet-addon-workmgr-867cbcdddf-pbmnw\" (UID: \"8695b189-c45d-4c5a-9811-4f6968becfca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:11.188731 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.188711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f1e7841-a3c8-4185-92af-bb0776965dda-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b7894c956-9dxrc\" (UID: \"0f1e7841-a3c8-4185-92af-bb0776965dda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc" Jul 06 12:06:11.196236 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.195992 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 12:06:11.218000 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.210079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcm9l\" (UniqueName: \"kubernetes.io/projected/0f1e7841-a3c8-4185-92af-bb0776965dda-kube-api-access-jcm9l\") pod \"managed-serviceaccount-addon-agent-b7894c956-9dxrc\" (UID: \"0f1e7841-a3c8-4185-92af-bb0776965dda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc" Jul 06 12:06:11.218000 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.215607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmg7l\" (UniqueName: \"kubernetes.io/projected/8695b189-c45d-4c5a-9811-4f6968becfca-kube-api-access-cmg7l\") pod \"klusterlet-addon-workmgr-867cbcdddf-pbmnw\" (UID: \"8695b189-c45d-4c5a-9811-4f6968becfca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:11.254658 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.254638 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:11.264200 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.264181 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-658c7f4dd8-fltx8"] Jul 06 12:06:11.278689 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.278665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc" Jul 06 12:06:11.287763 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.287741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1823a516-57b5-458f-9d17-9fe71ef04052-installation-pull-secrets\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.287847 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.287794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1823a516-57b5-458f-9d17-9fe71ef04052-registry-certificates\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.287847 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.287826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1823a516-57b5-458f-9d17-9fe71ef04052-bound-sa-token\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.287927 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.287849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1823a516-57b5-458f-9d17-9fe71ef04052-image-registry-private-configuration\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.287927 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.287869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1823a516-57b5-458f-9d17-9fe71ef04052-ca-trust-extracted\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.288202 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.288179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg8dj\" (UniqueName: \"kubernetes.io/projected/1823a516-57b5-458f-9d17-9fe71ef04052-kube-api-access-sg8dj\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.288287 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.288263 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1823a516-57b5-458f-9d17-9fe71ef04052-ca-trust-extracted\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.288346 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.288288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1823a516-57b5-458f-9d17-9fe71ef04052-registry-tls\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.288346 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.288326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1823a516-57b5-458f-9d17-9fe71ef04052-trusted-ca\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.288893 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.288837 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1823a516-57b5-458f-9d17-9fe71ef04052-registry-certificates\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.289247 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.289229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1823a516-57b5-458f-9d17-9fe71ef04052-trusted-ca\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.290571 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.290553 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1823a516-57b5-458f-9d17-9fe71ef04052-image-registry-private-configuration\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.290804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.290784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1823a516-57b5-458f-9d17-9fe71ef04052-installation-pull-secrets\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.291007 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.290982 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1823a516-57b5-458f-9d17-9fe71ef04052-registry-tls\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.306217 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.306194 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg8dj\" (UniqueName: \"kubernetes.io/projected/1823a516-57b5-458f-9d17-9fe71ef04052-kube-api-access-sg8dj\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.310985 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.310947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1823a516-57b5-458f-9d17-9fe71ef04052-bound-sa-token\") pod \"image-registry-658c7f4dd8-fltx8\" (UID: \"1823a516-57b5-458f-9d17-9fe71ef04052\") " pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.401008 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.400976 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw"] Jul 06 12:06:11.405078 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:06:11.405032 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8695b189_c45d_4c5a_9811_4f6968becfca.slice/crio-12cda735418da20b7ebe018cf6839897e03054f0587d661a95d724cd5f7193d0 WatchSource:0}: Error finding container 12cda735418da20b7ebe018cf6839897e03054f0587d661a95d724cd5f7193d0: Status 404 returned error can't find the container with id 12cda735418da20b7ebe018cf6839897e03054f0587d661a95d724cd5f7193d0 Jul 06 12:06:11.426713 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.426689 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc"] Jul 06 12:06:11.429458 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:06:11.429433 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f1e7841_a3c8_4185_92af_bb0776965dda.slice/crio-305b3e182406e4f0560360295407d242fbfe991ef8c453d077a2417a9309449e WatchSource:0}: Error finding container 305b3e182406e4f0560360295407d242fbfe991ef8c453d077a2417a9309449e: Status 404 returned error can't find the container with id 305b3e182406e4f0560360295407d242fbfe991ef8c453d077a2417a9309449e Jul 06 12:06:11.436651 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.436627 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.574786 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.574759 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-658c7f4dd8-fltx8"] Jul 06 12:06:11.577596 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:06:11.577572 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1823a516_57b5_458f_9d17_9fe71ef04052.slice/crio-81328061f3f72e3b9509143fec889bbebea99cea9b5266ba8d9bf72f7f90e416 WatchSource:0}: Error finding container 81328061f3f72e3b9509143fec889bbebea99cea9b5266ba8d9bf72f7f90e416: Status 404 returned error can't find the container with id 81328061f3f72e3b9509143fec889bbebea99cea9b5266ba8d9bf72f7f90e416 Jul 06 12:06:11.992126 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.992087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" event={"ID":"1823a516-57b5-458f-9d17-9fe71ef04052","Type":"ContainerStarted","Data":"96d4140cfa7af2cff24a72facff3b60a8fba9d0ad5f4f2171137f5c59b92565b"} Jul 06 12:06:11.992662 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.992154 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" event={"ID":"1823a516-57b5-458f-9d17-9fe71ef04052","Type":"ContainerStarted","Data":"81328061f3f72e3b9509143fec889bbebea99cea9b5266ba8d9bf72f7f90e416"} Jul 06 12:06:11.992918 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.992856 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:11.994734 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.994680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc" event={"ID":"0f1e7841-a3c8-4185-92af-bb0776965dda","Type":"ContainerStarted","Data":"305b3e182406e4f0560360295407d242fbfe991ef8c453d077a2417a9309449e"} Jul 06 12:06:11.995883 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:11.995833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" event={"ID":"8695b189-c45d-4c5a-9811-4f6968becfca","Type":"ContainerStarted","Data":"12cda735418da20b7ebe018cf6839897e03054f0587d661a95d724cd5f7193d0"} Jul 06 12:06:13.509361 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:13.509316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:06:13.512331 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:13.512298 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df8d581-a737-47d1-bdfb-d66b252e8962-metrics-tls\") pod \"dns-default-6pwsb\" (UID: \"6df8d581-a737-47d1-bdfb-d66b252e8962\") " pod="openshift-dns/dns-default-6pwsb" Jul 06 12:06:13.577893 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:13.577861 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6qcfg\"" Jul 06 12:06:13.585392 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:13.585368 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6pwsb" Jul 06 12:06:16.013497 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:16.013453 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc" event={"ID":"0f1e7841-a3c8-4185-92af-bb0776965dda","Type":"ContainerStarted","Data":"2824315823f36170445de1f1598db1238bfb0880accef105a8e0c2c6d3c1a988"} Jul 06 12:06:16.015124 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:16.015075 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" event={"ID":"8695b189-c45d-4c5a-9811-4f6968becfca","Type":"ContainerStarted","Data":"3b9d0f4a70b933c5f4f03fad1a975dd5df375e93c24159c250133ddfffb0c8df"} Jul 06 12:06:16.015596 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:16.015558 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:16.016688 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:16.016627 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" podUID="8695b189-c45d-4c5a-9811-4f6968becfca" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.15:8000/readyz\": dial tcp 10.134.0.15:8000: connect: connection refused" Jul 06 12:06:16.016793 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:16.016755 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" podStartSLOduration=5.016741151 podStartE2EDuration="5.016741151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:12.021083354 +0000 UTC m=+97.122239612" watchObservedRunningTime="2026-07-06 12:06:16.016741151 +0000 UTC m=+101.117897383" Jul 06 12:06:16.016898 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:16.016887 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6pwsb"] Jul 06 12:06:16.022529 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:06:16.022501 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df8d581_a737_47d1_bdfb_d66b252e8962.slice/crio-9757c195d1d113838e355b1494fe154ecc2245a21cca20855cdcadfcb65ac9ef WatchSource:0}: Error finding container 9757c195d1d113838e355b1494fe154ecc2245a21cca20855cdcadfcb65ac9ef: Status 404 returned error can't find the container with id 9757c195d1d113838e355b1494fe154ecc2245a21cca20855cdcadfcb65ac9ef Jul 06 12:06:16.050887 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:16.050847 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b7894c956-9dxrc" podStartSLOduration=1.620343021 podStartE2EDuration="6.050832527s" totalImagesPullingTime="4.430489506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:16.050354166 +0000 UTC m=+101.151510409" watchObservedRunningTime="2026-07-06 12:06:16.050832527 +0000 UTC m=+101.151988768" Jul 06 12:06:17.019447 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:17.019405 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pwsb" event={"ID":"6df8d581-a737-47d1-bdfb-d66b252e8962","Type":"ContainerStarted","Data":"9757c195d1d113838e355b1494fe154ecc2245a21cca20855cdcadfcb65ac9ef"} Jul 06 12:06:17.020601 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:17.020580 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" Jul 06 12:06:17.103164 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:17.103117 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-867cbcdddf-pbmnw" podStartSLOduration=2.634032709 podStartE2EDuration="7.103101933s" totalImagesPullingTime="4.469069224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:16.136327054 +0000 UTC m=+101.237483314" watchObservedRunningTime="2026-07-06 12:06:17.103101933 +0000 UTC m=+102.204258200" Jul 06 12:06:17.902133 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:17.902103 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-khmk2" Jul 06 12:06:19.027253 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.027217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pwsb" event={"ID":"6df8d581-a737-47d1-bdfb-d66b252e8962","Type":"ContainerStarted","Data":"6ed310a91752ad10a930995b172694d0b66f4f806d26cb08f5f43c71096f28a2"} Jul 06 12:06:19.027642 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.027272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pwsb" event={"ID":"6df8d581-a737-47d1-bdfb-d66b252e8962","Type":"ContainerStarted","Data":"5512f33cd5e380ed25060bd74ff13f85ec52d3d3e223923eb2b2d4e796c293cb"} Jul 06 12:06:19.027642 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.027475 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6pwsb" Jul 06 12:06:19.080860 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.080811 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6pwsb" podStartSLOduration=68.195514123 podStartE2EDuration="1m10.080797244s" totalImagesPullingTime="1.885283121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:19.080760165 +0000 UTC m=+104.181916425" watchObservedRunningTime="2026-07-06 12:06:19.080797244 +0000 UTC m=+104.181953479" Jul 06 12:06:19.654800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.654770 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l2jrf"] Jul 06 12:06:19.656779 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.656764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.679847 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.679824 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 12:06:19.679939 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.679852 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 12:06:19.680567 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.680553 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 12:06:19.680771 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.680751 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 12:06:19.680848 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.680798 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 12:06:19.680903 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.680843 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 12:06:19.681052 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.681022 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bgdrk\"" Jul 06 12:06:19.762606 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.762577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-accelerators-collector-config\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.762712 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.762615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.762712 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.762642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-textfile\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.762712 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.762698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddb54b24-1ea0-4334-89c3-26100e5a1086-root\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.762863 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.762717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmz4c\" (UniqueName: \"kubernetes.io/projected/ddb54b24-1ea0-4334-89c3-26100e5a1086-kube-api-access-cmz4c\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.762863 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.762740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-tls\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.762863 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.762807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddb54b24-1ea0-4334-89c3-26100e5a1086-sys\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.762996 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.762867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddb54b24-1ea0-4334-89c3-26100e5a1086-metrics-client-ca\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.762996 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.762914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-wtmp\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863211 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddb54b24-1ea0-4334-89c3-26100e5a1086-metrics-client-ca\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863317 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-wtmp\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863317 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-accelerators-collector-config\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863317 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863317 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-textfile\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863496 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddb54b24-1ea0-4334-89c3-26100e5a1086-root\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863496 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmz4c\" (UniqueName: \"kubernetes.io/projected/ddb54b24-1ea0-4334-89c3-26100e5a1086-kube-api-access-cmz4c\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863496 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddb54b24-1ea0-4334-89c3-26100e5a1086-root\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863496 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-wtmp\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863496 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-tls\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863496 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddb54b24-1ea0-4334-89c3-26100e5a1086-sys\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863793 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:06:19.863514 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 12:06:19.863793 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863552 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddb54b24-1ea0-4334-89c3-26100e5a1086-sys\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.863793 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:06:19.863579 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-tls podName:ddb54b24-1ea0-4334-89c3-26100e5a1086 nodeName:}" failed. No retries permitted until 2026-07-06 12:06:20.363559463 +0000 UTC m=+105.464715696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-tls") pod "node-exporter-l2jrf" (UID: "ddb54b24-1ea0-4334-89c3-26100e5a1086") : secret "node-exporter-tls" not found Jul 06 12:06:19.863793 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-textfile\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.864003 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddb54b24-1ea0-4334-89c3-26100e5a1086-metrics-client-ca\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.864003 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.863943 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-accelerators-collector-config\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.865648 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.865628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:19.879208 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:19.879186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmz4c\" (UniqueName: \"kubernetes.io/projected/ddb54b24-1ea0-4334-89c3-26100e5a1086-kube-api-access-cmz4c\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:20.368571 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:20.368543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-tls\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:20.370814 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:20.370784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddb54b24-1ea0-4334-89c3-26100e5a1086-node-exporter-tls\") pod \"node-exporter-l2jrf\" (UID: \"ddb54b24-1ea0-4334-89c3-26100e5a1086\") " pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:20.565340 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:20.565316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l2jrf" Jul 06 12:06:20.574874 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:06:20.574843 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb54b24_1ea0_4334_89c3_26100e5a1086.slice/crio-7cf3c18f53eff22d5eb8725c6ff9f3484ed595e5d1fe75fe30bb1ee04b6e4e5a WatchSource:0}: Error finding container 7cf3c18f53eff22d5eb8725c6ff9f3484ed595e5d1fe75fe30bb1ee04b6e4e5a: Status 404 returned error can't find the container with id 7cf3c18f53eff22d5eb8725c6ff9f3484ed595e5d1fe75fe30bb1ee04b6e4e5a Jul 06 12:06:21.038529 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:21.038490 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2jrf" event={"ID":"ddb54b24-1ea0-4334-89c3-26100e5a1086","Type":"ContainerStarted","Data":"7cf3c18f53eff22d5eb8725c6ff9f3484ed595e5d1fe75fe30bb1ee04b6e4e5a"} Jul 06 12:06:22.043612 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:22.043582 2576 generic.go:356] "Generic (PLEG): container finished" podID="ddb54b24-1ea0-4334-89c3-26100e5a1086" containerID="d82b436aa368c23d6cca3ac912ac46cea181eaf3c9e369923cd231b3828ba514" exitCode=0 Jul 06 12:06:22.043886 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:22.043637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2jrf" event={"ID":"ddb54b24-1ea0-4334-89c3-26100e5a1086","Type":"ContainerDied","Data":"d82b436aa368c23d6cca3ac912ac46cea181eaf3c9e369923cd231b3828ba514"} Jul 06 12:06:23.049455 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:23.049417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2jrf" event={"ID":"ddb54b24-1ea0-4334-89c3-26100e5a1086","Type":"ContainerStarted","Data":"417108af7db5f9be9c4bf32c386f146db0a0fc034075e5a5cfb169b478c972b0"} Jul 06 12:06:23.049870 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:23.049469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2jrf" event={"ID":"ddb54b24-1ea0-4334-89c3-26100e5a1086","Type":"ContainerStarted","Data":"fa0755d76dee98b9d75f5f4f576f44661bf1934f904972bb1f696f1f513b8a8f"} Jul 06 12:06:23.083222 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:23.083175 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l2jrf" podStartSLOduration=2.700581105 podStartE2EDuration="4.083160467s" totalImagesPullingTime="1.3198142s" totalInitContainerRuntime="62.765162ms" isStatefulPod=true podCreationTimestamp="2026-07-06 12:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:23.08256242 +0000 UTC m=+108.183718680" watchObservedRunningTime="2026-07-06 12:06:23.083160467 +0000 UTC m=+108.184316752" Jul 06 12:06:25.942352 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.942325 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 12:06:25.946030 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.946009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:25.950724 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.950700 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 12:06:25.950724 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.950718 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 12:06:25.951023 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951002 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 12:06:25.951151 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951026 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 12:06:25.951151 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951114 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 12:06:25.951271 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951159 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 12:06:25.951271 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951121 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 12:06:25.951406 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951386 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 12:06:25.951690 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951672 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mqmd2\"" Jul 06 12:06:25.951809 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951680 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-18fkbqv9nti8c\"" Jul 06 12:06:25.951899 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951846 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 12:06:25.951899 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951726 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 12:06:25.951899 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951725 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 12:06:25.951899 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951685 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 12:06:25.952155 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.951969 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 12:06:25.952331 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.952313 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 12:06:25.954772 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.954749 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 12:06:25.968679 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:25.968655 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 12:06:26.113952 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.113920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/304b73a3-b34b-4aab-a87d-6fdca905ff26-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114124 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.113961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114124 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.113989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114124 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114124 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114124 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114288 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114288 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114288 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114288 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-config\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114419 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114419 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114419 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114419 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114419 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4rx8\" (UniqueName: \"kubernetes.io/projected/304b73a3-b34b-4aab-a87d-6fdca905ff26-kube-api-access-c4rx8\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114419 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114618 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114618 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114618 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-web-config\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.114618 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.114510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/304b73a3-b34b-4aab-a87d-6fdca905ff26-config-out\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215235 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4rx8\" (UniqueName: \"kubernetes.io/projected/304b73a3-b34b-4aab-a87d-6fdca905ff26-kube-api-access-c4rx8\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215367 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215367 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215367 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215367 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-web-config\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215367 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/304b73a3-b34b-4aab-a87d-6fdca905ff26-config-out\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215639 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/304b73a3-b34b-4aab-a87d-6fdca905ff26-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215639 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215639 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215639 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215639 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215639 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215639 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215639 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.215639 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.216083 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-config\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.216083 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.216083 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.216083 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.216083 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.215797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.216344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.216122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.216344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.216176 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.216344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.216183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.216344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.216299 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.216872 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.216844 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.218577 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.218469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-web-config\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.218669 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.218608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.218950 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.218743 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/304b73a3-b34b-4aab-a87d-6fdca905ff26-config-out\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.219191 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.219030 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.219191 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.219084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.219335 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.219221 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.219394 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.219370 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-config\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.219394 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.219373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/304b73a3-b34b-4aab-a87d-6fdca905ff26-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.219977 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.219953 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.220347 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.220327 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/304b73a3-b34b-4aab-a87d-6fdca905ff26-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.220957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.220936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.221577 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.221554 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.221670 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.221556 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.221774 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.221757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/304b73a3-b34b-4aab-a87d-6fdca905ff26-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.226901 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.226881 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4rx8\" (UniqueName: \"kubernetes.io/projected/304b73a3-b34b-4aab-a87d-6fdca905ff26-kube-api-access-c4rx8\") pod \"prometheus-k8s-0\" (UID: \"304b73a3-b34b-4aab-a87d-6fdca905ff26\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.255944 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.255923 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:26.389879 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:26.389851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 12:06:26.392455 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:06:26.392413 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod304b73a3_b34b_4aab_a87d_6fdca905ff26.slice/crio-3c990df4ffca30e9685cbd3f23576f553d524162d9789944e64c54e88dfefcbe WatchSource:0}: Error finding container 3c990df4ffca30e9685cbd3f23576f553d524162d9789944e64c54e88dfefcbe: Status 404 returned error can't find the container with id 3c990df4ffca30e9685cbd3f23576f553d524162d9789944e64c54e88dfefcbe Jul 06 12:06:27.063352 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:27.063308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304b73a3-b34b-4aab-a87d-6fdca905ff26","Type":"ContainerStarted","Data":"3c990df4ffca30e9685cbd3f23576f553d524162d9789944e64c54e88dfefcbe"} Jul 06 12:06:28.068580 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:28.068546 2576 generic.go:356] "Generic (PLEG): container finished" podID="304b73a3-b34b-4aab-a87d-6fdca905ff26" containerID="a0eb58e9fb590652c195192818c19ee339f3cbd49117d86057a7c9ba0e8442da" exitCode=0 Jul 06 12:06:28.068931 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:28.068620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304b73a3-b34b-4aab-a87d-6fdca905ff26","Type":"ContainerDied","Data":"a0eb58e9fb590652c195192818c19ee339f3cbd49117d86057a7c9ba0e8442da"} Jul 06 12:06:29.032654 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:29.032621 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6pwsb" Jul 06 12:06:32.086817 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:32.086779 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304b73a3-b34b-4aab-a87d-6fdca905ff26","Type":"ContainerStarted","Data":"1bc2ffbf70ca96e1b82e9a881e4cfbf12477b5b3561561a122bcd6b5b967e0b2"} Jul 06 12:06:32.087246 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:32.086865 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304b73a3-b34b-4aab-a87d-6fdca905ff26","Type":"ContainerStarted","Data":"422eb672d9e16169b7c56609ab5b06b95c575b3b5ffbfe51ea54d3c86bfad7c0"} Jul 06 12:06:34.008142 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:34.008113 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-658c7f4dd8-fltx8" Jul 06 12:06:34.097578 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:34.097543 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304b73a3-b34b-4aab-a87d-6fdca905ff26","Type":"ContainerStarted","Data":"476387bf0585152c9e78f65c79e20076c3af519a4dacd037910b47a9cd177358"} Jul 06 12:06:34.097733 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:34.097604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304b73a3-b34b-4aab-a87d-6fdca905ff26","Type":"ContainerStarted","Data":"4f8dfc9cf4c674e76ddc3f613204ffecbe48dcfd8a24acf8cda165a88a3f262b"} Jul 06 12:06:34.097733 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:34.097629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304b73a3-b34b-4aab-a87d-6fdca905ff26","Type":"ContainerStarted","Data":"e0b639e77f3f4fe0d54a293cd618bb1d5eabc635ea617c57d2b207be5c85d5d6"} Jul 06 12:06:34.097733 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:34.097652 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304b73a3-b34b-4aab-a87d-6fdca905ff26","Type":"ContainerStarted","Data":"3e6b7fa71c07baa0b475705c86c251853e1b2badfd67a0d76f5dc489ba4f182f"} Jul 06 12:06:34.247137 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:34.247086 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.320097047 podStartE2EDuration="9.247069841s" totalImagesPullingTime="5.909255695s" totalInitContainerRuntime="17.717099ms" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:34.244218295 +0000 UTC m=+119.345374537" watchObservedRunningTime="2026-07-06 12:06:34.247069841 +0000 UTC m=+119.348226083" Jul 06 12:06:36.256327 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:36.256294 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:06:44.049970 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:44.049939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:06:44.052148 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:44.052120 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c-metrics-certs\") pod \"network-metrics-daemon-s42x4\" (UID: \"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c\") " pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:06:44.233219 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:44.233185 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lb44c\"" Jul 06 12:06:44.240500 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:44.240482 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s42x4" Jul 06 12:06:44.373921 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:44.373891 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s42x4"] Jul 06 12:06:44.378501 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:06:44.378474 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc1573d_db7e_4e2b_b277_6d81c4b1bc9c.slice/crio-0682c37ccb7ff431e063b2f58a01485ac3bea8440369eb72be8f22b2f7772f5f WatchSource:0}: Error finding container 0682c37ccb7ff431e063b2f58a01485ac3bea8440369eb72be8f22b2f7772f5f: Status 404 returned error can't find the container with id 0682c37ccb7ff431e063b2f58a01485ac3bea8440369eb72be8f22b2f7772f5f Jul 06 12:06:45.140522 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:45.140487 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s42x4" event={"ID":"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c","Type":"ContainerStarted","Data":"0682c37ccb7ff431e063b2f58a01485ac3bea8440369eb72be8f22b2f7772f5f"} Jul 06 12:06:46.146138 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:46.146097 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s42x4" event={"ID":"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c","Type":"ContainerStarted","Data":"c0162656ff75b75eb5712798a0ca9a6bc90017ff0a53b6726cf37029f2978a4f"} Jul 06 12:06:46.146516 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:46.146165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s42x4" event={"ID":"0fc1573d-db7e-4e2b-b277-6d81c4b1bc9c","Type":"ContainerStarted","Data":"0d55825b0fc3a902ca53941397a2566182422568d2326e32dce86c95a8f0c555"} Jul 06 12:06:46.174625 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:46.174581 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s42x4" podStartSLOduration=130.393571208 podStartE2EDuration="2m11.174565925s" totalImagesPullingTime="780.994717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:46.174281439 +0000 UTC m=+131.275437698" watchObservedRunningTime="2026-07-06 12:06:46.174565925 +0000 UTC m=+131.275722167" Jul 06 12:06:50.160863 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:50.160833 2576 generic.go:356] "Generic (PLEG): container finished" podID="4e1e7d93-35c0-4131-8aa8-353de71428f5" containerID="20acbb528c0dd1cac5b753481a9d460beef7e0f88e1f7c490f63229b55e9eba9" exitCode=0 Jul 06 12:06:50.161249 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:50.160911 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" event={"ID":"4e1e7d93-35c0-4131-8aa8-353de71428f5","Type":"ContainerDied","Data":"20acbb528c0dd1cac5b753481a9d460beef7e0f88e1f7c490f63229b55e9eba9"} Jul 06 12:06:50.161306 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:50.161290 2576 scope.go:117] "RemoveContainer" containerID="20acbb528c0dd1cac5b753481a9d460beef7e0f88e1f7c490f63229b55e9eba9" Jul 06 12:06:51.169200 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:51.169162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xk7q2" event={"ID":"4e1e7d93-35c0-4131-8aa8-353de71428f5","Type":"ContainerStarted","Data":"b0da6925d175a61c104d4c221db6e79219af49337ebaed8cf5ffa080d6994bfe"} Jul 06 12:06:55.189114 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:55.189078 2576 generic.go:356] "Generic (PLEG): container finished" podID="c946d397-f878-4b84-9b5e-35060626abcd" containerID="8e2f4a93e02ed5ef9ebba548eaba78cf032bb115197989c5cc844c57174b56ef" exitCode=0 Jul 06 12:06:55.189569 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:55.189157 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" event={"ID":"c946d397-f878-4b84-9b5e-35060626abcd","Type":"ContainerDied","Data":"8e2f4a93e02ed5ef9ebba548eaba78cf032bb115197989c5cc844c57174b56ef"} Jul 06 12:06:55.189569 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:55.189499 2576 scope.go:117] "RemoveContainer" containerID="8e2f4a93e02ed5ef9ebba548eaba78cf032bb115197989c5cc844c57174b56ef" Jul 06 12:06:55.190600 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:55.190577 2576 generic.go:356] "Generic (PLEG): container finished" podID="6995694f-3933-4b4f-8c82-4d466648162c" containerID="2aca64bdbb2135a202da9442907e3d80d44bf8272ee040e3fa3fdedce132c926" exitCode=0 Jul 06 12:06:55.190708 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:55.190604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" event={"ID":"6995694f-3933-4b4f-8c82-4d466648162c","Type":"ContainerDied","Data":"2aca64bdbb2135a202da9442907e3d80d44bf8272ee040e3fa3fdedce132c926"} Jul 06 12:06:55.190877 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:55.190865 2576 scope.go:117] "RemoveContainer" containerID="2aca64bdbb2135a202da9442907e3d80d44bf8272ee040e3fa3fdedce132c926" Jul 06 12:06:56.195680 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:56.195649 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ph89k" event={"ID":"c946d397-f878-4b84-9b5e-35060626abcd","Type":"ContainerStarted","Data":"61ad7259fb719c7a6e660e35af7e72b8c892c29ef924f767af3c54bb89f2d122"} Jul 06 12:06:56.197404 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:06:56.197381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fvt65" event={"ID":"6995694f-3933-4b4f-8c82-4d466648162c","Type":"ContainerStarted","Data":"bfba49c2ffb81f726ee0b0196265012e2d9f5e1aa1448ff93e4f3a2fa442dd72"} Jul 06 12:07:26.256172 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:07:26.256108 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:07:26.275785 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:07:26.275756 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:07:26.318660 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:07:26.318636 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 12:09:35.279121 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:09:35.279091 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 12:10:04.642200 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.642167 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl"] Jul 06 12:10:04.645505 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.645489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.650316 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.650292 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pdvvq\"" Jul 06 12:10:04.650646 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.650608 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 12:10:04.650731 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.650664 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 12:10:04.650827 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.650815 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 12:10:04.651732 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.651380 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 12:10:04.660343 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.660322 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl"] Jul 06 12:10:04.707102 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.707069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7acd82e-3605-49ac-9783-fa9077a78d99-manifests\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.707201 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.707118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7acd82e-3605-49ac-9783-fa9077a78d99-tmp\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.707201 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.707146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gm8x\" (UniqueName: \"kubernetes.io/projected/b7acd82e-3605-49ac-9783-fa9077a78d99-kube-api-access-5gm8x\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.707201 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.707180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7acd82e-3605-49ac-9783-fa9077a78d99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.707343 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.707267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7acd82e-3605-49ac-9783-fa9077a78d99-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.807760 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.807734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7acd82e-3605-49ac-9783-fa9077a78d99-manifests\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.807868 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.807766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7acd82e-3605-49ac-9783-fa9077a78d99-tmp\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.807868 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.807783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gm8x\" (UniqueName: \"kubernetes.io/projected/b7acd82e-3605-49ac-9783-fa9077a78d99-kube-api-access-5gm8x\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.807868 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.807812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7acd82e-3605-49ac-9783-fa9077a78d99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.807868 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.807850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7acd82e-3605-49ac-9783-fa9077a78d99-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.808191 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.808172 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7acd82e-3605-49ac-9783-fa9077a78d99-manifests\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.810017 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.809991 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7acd82e-3605-49ac-9783-fa9077a78d99-tmp\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.810256 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.810235 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7acd82e-3605-49ac-9783-fa9077a78d99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.810328 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.810314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7acd82e-3605-49ac-9783-fa9077a78d99-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.857243 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.857220 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gm8x\" (UniqueName: \"kubernetes.io/projected/b7acd82e-3605-49ac-9783-fa9077a78d99-kube-api-access-5gm8x\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-zxnzl\" (UID: \"b7acd82e-3605-49ac-9783-fa9077a78d99\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:04.955214 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:04.955148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:05.115113 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:05.115074 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl"] Jul 06 12:10:05.120394 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:10:05.120371 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7acd82e_3605_49ac_9783_fa9077a78d99.slice/crio-6f8b3979b74fb41db41b676591d6611f74660a9bee0e4ed8c922123ec73b60d5 WatchSource:0}: Error finding container 6f8b3979b74fb41db41b676591d6611f74660a9bee0e4ed8c922123ec73b60d5: Status 404 returned error can't find the container with id 6f8b3979b74fb41db41b676591d6611f74660a9bee0e4ed8c922123ec73b60d5 Jul 06 12:10:05.122174 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:05.122156 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 12:10:05.876593 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:05.876558 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" event={"ID":"b7acd82e-3605-49ac-9783-fa9077a78d99","Type":"ContainerStarted","Data":"6f8b3979b74fb41db41b676591d6611f74660a9bee0e4ed8c922123ec73b60d5"} Jul 06 12:10:09.899955 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:09.899916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" event={"ID":"b7acd82e-3605-49ac-9783-fa9077a78d99","Type":"ContainerStarted","Data":"9608c41d54bc5b5684af914f5832ebbd7fccb6ad0bde0939fbfc0361a1e6fc33"} Jul 06 12:10:10.905606 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:10.905575 2576 generic.go:356] "Generic (PLEG): container finished" podID="b7acd82e-3605-49ac-9783-fa9077a78d99" containerID="9608c41d54bc5b5684af914f5832ebbd7fccb6ad0bde0939fbfc0361a1e6fc33" exitCode=0 Jul 06 12:10:10.906059 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:10.905621 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" event={"ID":"b7acd82e-3605-49ac-9783-fa9077a78d99","Type":"ContainerDied","Data":"9608c41d54bc5b5684af914f5832ebbd7fccb6ad0bde0939fbfc0361a1e6fc33"} Jul 06 12:10:11.911314 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:11.911276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" event={"ID":"b7acd82e-3605-49ac-9783-fa9077a78d99","Type":"ContainerStarted","Data":"567df2b414b676e3a95cf868735f102fa31858568356e0a53cce48597e3dcb77"} Jul 06 12:10:11.911778 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:11.911405 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:11.934730 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:11.934688 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" podStartSLOduration=2.545153955 podStartE2EDuration="7.934671133s" totalImagesPullingTime="4.356177974s" totalInitContainerRuntime="1.033339204s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:11.933576701 +0000 UTC m=+337.034732944" watchObservedRunningTime="2026-07-06 12:10:11.934671133 +0000 UTC m=+337.035827375" Jul 06 12:10:22.916730 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:22.916700 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-zxnzl" Jul 06 12:10:36.388845 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.388769 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz"] Jul 06 12:10:36.393323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.393307 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.397514 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.397496 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 12:10:36.397979 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.397967 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 12:10:36.398924 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.398905 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 12:10:36.398924 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.398913 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 12:10:36.399126 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.398913 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 12:10:36.399271 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.399256 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tv9s8\"" Jul 06 12:10:36.404166 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.404144 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz"] Jul 06 12:10:36.557666 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.557633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj45f\" (UniqueName: \"kubernetes.io/projected/70998b15-a1bf-46f8-a054-fb48977d338b-kube-api-access-jj45f\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.557822 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.557683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70998b15-a1bf-46f8-a054-fb48977d338b-manager-config\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.557822 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.557706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70998b15-a1bf-46f8-a054-fb48977d338b-metrics-cert\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.557822 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.557766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70998b15-a1bf-46f8-a054-fb48977d338b-cert\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.658229 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.658134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj45f\" (UniqueName: \"kubernetes.io/projected/70998b15-a1bf-46f8-a054-fb48977d338b-kube-api-access-jj45f\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.658229 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.658188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70998b15-a1bf-46f8-a054-fb48977d338b-manager-config\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.658229 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.658211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70998b15-a1bf-46f8-a054-fb48977d338b-metrics-cert\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.658461 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.658245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70998b15-a1bf-46f8-a054-fb48977d338b-cert\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.658889 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.658859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70998b15-a1bf-46f8-a054-fb48977d338b-manager-config\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.660738 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.660717 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70998b15-a1bf-46f8-a054-fb48977d338b-cert\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.660838 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.660748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70998b15-a1bf-46f8-a054-fb48977d338b-metrics-cert\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.675997 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.675969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj45f\" (UniqueName: \"kubernetes.io/projected/70998b15-a1bf-46f8-a054-fb48977d338b-kube-api-access-jj45f\") pod \"lws-controller-manager-7d8dd6c8b8-tf8hz\" (UID: \"70998b15-a1bf-46f8-a054-fb48977d338b\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.702991 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.702968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:36.951075 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:36.951035 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz"] Jul 06 12:10:36.953393 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:10:36.953366 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70998b15_a1bf_46f8_a054_fb48977d338b.slice/crio-e3a3a85fb664acd92b47e65898ed8bd3be6ad489fe2a6d026a7793188d95417a WatchSource:0}: Error finding container e3a3a85fb664acd92b47e65898ed8bd3be6ad489fe2a6d026a7793188d95417a: Status 404 returned error can't find the container with id e3a3a85fb664acd92b47e65898ed8bd3be6ad489fe2a6d026a7793188d95417a Jul 06 12:10:37.003504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:37.003473 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" event={"ID":"70998b15-a1bf-46f8-a054-fb48977d338b","Type":"ContainerStarted","Data":"e3a3a85fb664acd92b47e65898ed8bd3be6ad489fe2a6d026a7793188d95417a"} Jul 06 12:10:38.567311 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.567279 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t"] Jul 06 12:10:38.576148 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.576127 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.582873 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.582701 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 12:10:38.583228 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.583198 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 12:10:38.583318 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.583235 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 12:10:38.585689 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.585656 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 12:10:38.586690 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.586669 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 12:10:38.587194 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.587176 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8gwd5\"" Jul 06 12:10:38.596634 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.596613 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 12:10:38.616089 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.616066 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t"] Jul 06 12:10:38.670269 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.670242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fdb6e5e8-125e-4298-a6bb-edf9994466eb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.670398 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.670284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.670398 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.670312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.670512 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.670401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.670512 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.670439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw9z8\" (UniqueName: \"kubernetes.io/projected/fdb6e5e8-125e-4298-a6bb-edf9994466eb-kube-api-access-jw9z8\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.670512 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.670469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.670512 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.670503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb6e5e8-125e-4298-a6bb-edf9994466eb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.771144 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.771114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fdb6e5e8-125e-4298-a6bb-edf9994466eb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.771144 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.771156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.771344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.771172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.771344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.771246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.771344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.771291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw9z8\" (UniqueName: \"kubernetes.io/projected/fdb6e5e8-125e-4298-a6bb-edf9994466eb-kube-api-access-jw9z8\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.771344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.771319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.771563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.771356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb6e5e8-125e-4298-a6bb-edf9994466eb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.772007 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.771981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.773866 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.773838 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.774009 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.773984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fdb6e5e8-125e-4298-a6bb-edf9994466eb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.774324 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.774307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.774451 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.774427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb6e5e8-125e-4298-a6bb-edf9994466eb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.791209 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.791183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb6e5e8-125e-4298-a6bb-edf9994466eb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.798991 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.798963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw9z8\" (UniqueName: \"kubernetes.io/projected/fdb6e5e8-125e-4298-a6bb-edf9994466eb-kube-api-access-jw9z8\") pod \"istiod-openshift-gateway-94bb8fbfd-ckd2t\" (UID: \"fdb6e5e8-125e-4298-a6bb-edf9994466eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:38.887891 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:38.887824 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:39.364966 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:39.364936 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t"] Jul 06 12:10:39.365382 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:10:39.365347 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb6e5e8_125e_4298_a6bb_edf9994466eb.slice/crio-cada9dc59100d462421892963619c0a81e6d938cff9da26afe031b1c69da5ec0 WatchSource:0}: Error finding container cada9dc59100d462421892963619c0a81e6d938cff9da26afe031b1c69da5ec0: Status 404 returned error can't find the container with id cada9dc59100d462421892963619c0a81e6d938cff9da26afe031b1c69da5ec0 Jul 06 12:10:40.019899 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:40.019855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" event={"ID":"70998b15-a1bf-46f8-a054-fb48977d338b","Type":"ContainerStarted","Data":"c2c2b92e6166ccf3198222ea9bf5fdd002a736433b3305b8a489a1ff82934ed3"} Jul 06 12:10:40.020395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:40.020216 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:10:40.022254 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:40.022221 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" event={"ID":"fdb6e5e8-125e-4298-a6bb-edf9994466eb","Type":"ContainerStarted","Data":"cada9dc59100d462421892963619c0a81e6d938cff9da26afe031b1c69da5ec0"} Jul 06 12:10:40.085804 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:40.085755 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" podStartSLOduration=1.761210918 podStartE2EDuration="4.08573848s" totalImagesPullingTime="2.324527562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:40.084361414 +0000 UTC m=+365.185517657" watchObservedRunningTime="2026-07-06 12:10:40.08573848 +0000 UTC m=+365.186894722" Jul 06 12:10:41.386806 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:41.386745 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 12:10:41.387165 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:41.386842 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 12:10:42.037399 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:42.037361 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" event={"ID":"fdb6e5e8-125e-4298-a6bb-edf9994466eb","Type":"ContainerStarted","Data":"a73037ee429fa36acede6748b36589ad7b454c7af2e95d7594c71ec4e56159ad"} Jul 06 12:10:42.037593 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:42.037529 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:42.039098 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:42.039073 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-ckd2t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 12:10:42.039207 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:42.039119 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" podUID="fdb6e5e8-125e-4298-a6bb-edf9994466eb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 12:10:42.084559 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:42.084512 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" podStartSLOduration=2.065477076 podStartE2EDuration="4.084498897s" totalImagesPullingTime="2.019021821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:42.080189508 +0000 UTC m=+367.181345751" watchObservedRunningTime="2026-07-06 12:10:42.084498897 +0000 UTC m=+367.185655139" Jul 06 12:10:43.042115 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:43.042078 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-ckd2t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 12:10:43.042473 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:43.042137 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" podUID="fdb6e5e8-125e-4298-a6bb-edf9994466eb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 12:10:46.042576 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:46.042547 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ckd2t" Jul 06 12:10:51.034727 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:10:51.034695 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-tf8hz" Jul 06 12:13:08.957973 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:08.957939 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-58r7k"] Jul 06 12:13:08.961116 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:08.961099 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:08.964002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:08.963977 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 12:13:08.964144 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:08.964020 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 12:13:08.964424 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:08.964403 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fbzvp\"" Jul 06 12:13:08.964743 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:08.964730 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 12:13:08.973407 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:08.973384 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-58r7k"] Jul 06 12:13:09.034868 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:09.034839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7ddf\" (UniqueName: \"kubernetes.io/projected/6911c6cb-0f24-4c75-94ce-d18690dc75ad-kube-api-access-c7ddf\") pod \"limitador-limitador-64c94fd64f-58r7k\" (UID: \"6911c6cb-0f24-4c75-94ce-d18690dc75ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:09.035016 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:09.034877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6911c6cb-0f24-4c75-94ce-d18690dc75ad-config-file\") pod \"limitador-limitador-64c94fd64f-58r7k\" (UID: \"6911c6cb-0f24-4c75-94ce-d18690dc75ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:09.054034 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:09.054006 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-58r7k"] Jul 06 12:13:09.135221 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:09.135196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6911c6cb-0f24-4c75-94ce-d18690dc75ad-config-file\") pod \"limitador-limitador-64c94fd64f-58r7k\" (UID: \"6911c6cb-0f24-4c75-94ce-d18690dc75ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:09.135368 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:09.135295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7ddf\" (UniqueName: \"kubernetes.io/projected/6911c6cb-0f24-4c75-94ce-d18690dc75ad-kube-api-access-c7ddf\") pod \"limitador-limitador-64c94fd64f-58r7k\" (UID: \"6911c6cb-0f24-4c75-94ce-d18690dc75ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:09.135786 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:09.135767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6911c6cb-0f24-4c75-94ce-d18690dc75ad-config-file\") pod \"limitador-limitador-64c94fd64f-58r7k\" (UID: \"6911c6cb-0f24-4c75-94ce-d18690dc75ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:09.143587 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:09.143560 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7ddf\" (UniqueName: \"kubernetes.io/projected/6911c6cb-0f24-4c75-94ce-d18690dc75ad-kube-api-access-c7ddf\") pod \"limitador-limitador-64c94fd64f-58r7k\" (UID: \"6911c6cb-0f24-4c75-94ce-d18690dc75ad\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:09.270630 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:09.270598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:09.394975 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:09.394947 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-58r7k"] Jul 06 12:13:09.397364 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:13:09.397323 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6911c6cb_0f24_4c75_94ce_d18690dc75ad.slice/crio-d79502c43bb962b1028ec6f86488a77c65eed0e0dff3fa8df2765d49665d8c68 WatchSource:0}: Error finding container d79502c43bb962b1028ec6f86488a77c65eed0e0dff3fa8df2765d49665d8c68: Status 404 returned error can't find the container with id d79502c43bb962b1028ec6f86488a77c65eed0e0dff3fa8df2765d49665d8c68 Jul 06 12:13:09.617355 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:09.617278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" event={"ID":"6911c6cb-0f24-4c75-94ce-d18690dc75ad","Type":"ContainerStarted","Data":"d79502c43bb962b1028ec6f86488a77c65eed0e0dff3fa8df2765d49665d8c68"} Jul 06 12:13:12.632802 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:12.632764 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" event={"ID":"6911c6cb-0f24-4c75-94ce-d18690dc75ad","Type":"ContainerStarted","Data":"7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4"} Jul 06 12:13:12.633189 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:12.632893 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:12.653246 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:12.653202 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" podStartSLOduration=2.055191407 podStartE2EDuration="4.65318908s" totalImagesPullingTime="2.597997673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:13:12.651301916 +0000 UTC m=+517.752458171" watchObservedRunningTime="2026-07-06 12:13:12.65318908 +0000 UTC m=+517.754345330" Jul 06 12:13:23.637714 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:23.637685 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:23.922502 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:23.922427 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-58r7k"] Jul 06 12:13:23.922650 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:23.922585 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" podUID="6911c6cb-0f24-4c75-94ce-d18690dc75ad" containerName="limitador" containerID="cri-o://7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4" gracePeriod=30 Jul 06 12:13:24.462581 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.462559 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:24.556082 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.555999 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7ddf\" (UniqueName: \"kubernetes.io/projected/6911c6cb-0f24-4c75-94ce-d18690dc75ad-kube-api-access-c7ddf\") pod \"6911c6cb-0f24-4c75-94ce-d18690dc75ad\" (UID: \"6911c6cb-0f24-4c75-94ce-d18690dc75ad\") " Jul 06 12:13:24.556196 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.556101 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6911c6cb-0f24-4c75-94ce-d18690dc75ad-config-file\") pod \"6911c6cb-0f24-4c75-94ce-d18690dc75ad\" (UID: \"6911c6cb-0f24-4c75-94ce-d18690dc75ad\") " Jul 06 12:13:24.556455 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.556437 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6911c6cb-0f24-4c75-94ce-d18690dc75ad-config-file" (OuterVolumeSpecName: "config-file") pod "6911c6cb-0f24-4c75-94ce-d18690dc75ad" (UID: "6911c6cb-0f24-4c75-94ce-d18690dc75ad"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:13:24.562577 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.562541 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6911c6cb-0f24-4c75-94ce-d18690dc75ad-kube-api-access-c7ddf" (OuterVolumeSpecName: "kube-api-access-c7ddf") pod "6911c6cb-0f24-4c75-94ce-d18690dc75ad" (UID: "6911c6cb-0f24-4c75-94ce-d18690dc75ad"). InnerVolumeSpecName "kube-api-access-c7ddf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:13:24.656861 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.656829 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7ddf\" (UniqueName: \"kubernetes.io/projected/6911c6cb-0f24-4c75-94ce-d18690dc75ad-kube-api-access-c7ddf\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:13:24.656861 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.656863 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6911c6cb-0f24-4c75-94ce-d18690dc75ad-config-file\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:13:24.680346 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.680316 2576 generic.go:356] "Generic (PLEG): container finished" podID="6911c6cb-0f24-4c75-94ce-d18690dc75ad" containerID="7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4" exitCode=0 Jul 06 12:13:24.680490 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.680355 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" event={"ID":"6911c6cb-0f24-4c75-94ce-d18690dc75ad","Type":"ContainerDied","Data":"7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4"} Jul 06 12:13:24.680490 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.680371 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" Jul 06 12:13:24.680490 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.680437 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-58r7k" event={"ID":"6911c6cb-0f24-4c75-94ce-d18690dc75ad","Type":"ContainerDied","Data":"d79502c43bb962b1028ec6f86488a77c65eed0e0dff3fa8df2765d49665d8c68"} Jul 06 12:13:24.680490 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.680468 2576 scope.go:117] "RemoveContainer" containerID="7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4" Jul 06 12:13:24.691491 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.691469 2576 scope.go:117] "RemoveContainer" containerID="7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4" Jul 06 12:13:24.691752 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:13:24.691732 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4\": container with ID starting with 7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4 not found: ID does not exist" containerID="7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4" Jul 06 12:13:24.691819 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.691759 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4"} err="failed to get container status \"7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4\": rpc error: code = NotFound desc = could not find container \"7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4\": container with ID starting with 7a08ebb49d877ad05a8fb26f1dd4421b927618026b9e360a26a2ac1230555db4 not found: ID does not exist" Jul 06 12:13:24.706639 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.706604 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-58r7k"] Jul 06 12:13:24.713673 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:24.713655 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-58r7k"] Jul 06 12:13:25.362650 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.362617 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-99bww"] Jul 06 12:13:25.363085 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.363068 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6911c6cb-0f24-4c75-94ce-d18690dc75ad" containerName="limitador" Jul 06 12:13:25.363131 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.363089 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6911c6cb-0f24-4c75-94ce-d18690dc75ad" containerName="limitador" Jul 06 12:13:25.363178 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.363167 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6911c6cb-0f24-4c75-94ce-d18690dc75ad" containerName="limitador" Jul 06 12:13:25.367630 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.367613 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-99bww" Jul 06 12:13:25.370711 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.370691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zxhxt\"" Jul 06 12:13:25.370933 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.370914 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 06 12:13:25.376601 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.376580 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-99bww"] Jul 06 12:13:25.464747 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.464720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xb2k\" (UniqueName: \"kubernetes.io/projected/48a605e3-e798-439f-a293-c5ca1b5df716-kube-api-access-8xb2k\") pod \"postgres-69fb4594cf-99bww\" (UID: \"48a605e3-e798-439f-a293-c5ca1b5df716\") " pod="opendatahub/postgres-69fb4594cf-99bww" Jul 06 12:13:25.464893 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.464757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/48a605e3-e798-439f-a293-c5ca1b5df716-data\") pod \"postgres-69fb4594cf-99bww\" (UID: \"48a605e3-e798-439f-a293-c5ca1b5df716\") " pod="opendatahub/postgres-69fb4594cf-99bww" Jul 06 12:13:25.507087 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.507034 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6911c6cb-0f24-4c75-94ce-d18690dc75ad" path="/var/lib/kubelet/pods/6911c6cb-0f24-4c75-94ce-d18690dc75ad/volumes" Jul 06 12:13:25.565666 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.565643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/48a605e3-e798-439f-a293-c5ca1b5df716-data\") pod \"postgres-69fb4594cf-99bww\" (UID: \"48a605e3-e798-439f-a293-c5ca1b5df716\") " pod="opendatahub/postgres-69fb4594cf-99bww" Jul 06 12:13:25.565800 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.565713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xb2k\" (UniqueName: \"kubernetes.io/projected/48a605e3-e798-439f-a293-c5ca1b5df716-kube-api-access-8xb2k\") pod \"postgres-69fb4594cf-99bww\" (UID: \"48a605e3-e798-439f-a293-c5ca1b5df716\") " pod="opendatahub/postgres-69fb4594cf-99bww" Jul 06 12:13:25.566024 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.566004 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/48a605e3-e798-439f-a293-c5ca1b5df716-data\") pod \"postgres-69fb4594cf-99bww\" (UID: \"48a605e3-e798-439f-a293-c5ca1b5df716\") " pod="opendatahub/postgres-69fb4594cf-99bww" Jul 06 12:13:25.578620 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.578589 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xb2k\" (UniqueName: \"kubernetes.io/projected/48a605e3-e798-439f-a293-c5ca1b5df716-kube-api-access-8xb2k\") pod \"postgres-69fb4594cf-99bww\" (UID: \"48a605e3-e798-439f-a293-c5ca1b5df716\") " pod="opendatahub/postgres-69fb4594cf-99bww" Jul 06 12:13:25.677813 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:25.677760 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-99bww" Jul 06 12:13:26.013397 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:26.013311 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-99bww"] Jul 06 12:13:26.016161 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:13:26.016133 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a605e3_e798_439f_a293_c5ca1b5df716.slice/crio-68b9e217004f034597569f79ea3981a881fb39927d44f9bb13a9208553f41fae WatchSource:0}: Error finding container 68b9e217004f034597569f79ea3981a881fb39927d44f9bb13a9208553f41fae: Status 404 returned error can't find the container with id 68b9e217004f034597569f79ea3981a881fb39927d44f9bb13a9208553f41fae Jul 06 12:13:26.692862 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:26.692819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-99bww" event={"ID":"48a605e3-e798-439f-a293-c5ca1b5df716","Type":"ContainerStarted","Data":"68b9e217004f034597569f79ea3981a881fb39927d44f9bb13a9208553f41fae"} Jul 06 12:13:30.712905 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:30.712868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-99bww" event={"ID":"48a605e3-e798-439f-a293-c5ca1b5df716","Type":"ContainerStarted","Data":"e8d58e1028c786195d95fe737cb8d062233a393ab62222075c5cca5db6783ed5"} Jul 06 12:13:30.713270 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:30.712942 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-99bww" Jul 06 12:13:30.740281 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:30.740234 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-99bww" podStartSLOduration=1.194235141 podStartE2EDuration="5.740219139s" totalImagesPullingTime="4.545983998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:13:30.739498747 +0000 UTC m=+535.840655009" watchObservedRunningTime="2026-07-06 12:13:30.740219139 +0000 UTC m=+535.841375381" Jul 06 12:13:36.745176 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:36.745148 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-99bww" Jul 06 12:13:44.156434 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.156400 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fc4c66f45-mxb86"] Jul 06 12:13:44.177777 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.177745 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fc4c66f45-mxb86"] Jul 06 12:13:44.177923 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.177875 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:44.182468 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.182433 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 12:13:44.182468 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.182434 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k6psq\"" Jul 06 12:13:44.183070 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.183049 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 12:13:44.322096 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.322070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfzbd\" (UniqueName: \"kubernetes.io/projected/cda98415-055a-466b-ad19-085a387950d2-kube-api-access-dfzbd\") pod \"maas-controller-5fc4c66f45-mxb86\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:44.322096 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.322104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cda98415-055a-466b-ad19-085a387950d2-service-ca\") pod \"maas-controller-5fc4c66f45-mxb86\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:44.322291 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.322126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cda98415-055a-466b-ad19-085a387950d2-webhook-cert\") pod \"maas-controller-5fc4c66f45-mxb86\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:44.399709 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.399681 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68db85d476-gdxn8"] Jul 06 12:13:44.401934 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.401917 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:44.417278 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.417259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68db85d476-gdxn8"] Jul 06 12:13:44.422622 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.422591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfzbd\" (UniqueName: \"kubernetes.io/projected/cda98415-055a-466b-ad19-085a387950d2-kube-api-access-dfzbd\") pod \"maas-controller-5fc4c66f45-mxb86\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:44.422732 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.422636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cda98415-055a-466b-ad19-085a387950d2-service-ca\") pod \"maas-controller-5fc4c66f45-mxb86\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:44.422732 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.422725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cda98415-055a-466b-ad19-085a387950d2-webhook-cert\") pod \"maas-controller-5fc4c66f45-mxb86\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:44.423277 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.423255 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cda98415-055a-466b-ad19-085a387950d2-service-ca\") pod \"maas-controller-5fc4c66f45-mxb86\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:44.425112 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.425091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cda98415-055a-466b-ad19-085a387950d2-webhook-cert\") pod \"maas-controller-5fc4c66f45-mxb86\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:44.435574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.435551 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfzbd\" (UniqueName: \"kubernetes.io/projected/cda98415-055a-466b-ad19-085a387950d2-kube-api-access-dfzbd\") pod \"maas-controller-5fc4c66f45-mxb86\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:44.488295 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.488269 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:44.524018 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.523982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-webhook-cert\") pod \"maas-controller-68db85d476-gdxn8\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:44.524163 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.524080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-444jd\" (UniqueName: \"kubernetes.io/projected/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-kube-api-access-444jd\") pod \"maas-controller-68db85d476-gdxn8\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:44.524224 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.524187 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-service-ca\") pod \"maas-controller-68db85d476-gdxn8\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:44.615839 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.615807 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fc4c66f45-mxb86"] Jul 06 12:13:44.618460 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:13:44.618430 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda98415_055a_466b_ad19_085a387950d2.slice/crio-4aa15958f257ae0f23583bbc2ec722ddeed04d0727a61cfccf6355cae8c33a63 WatchSource:0}: Error finding container 4aa15958f257ae0f23583bbc2ec722ddeed04d0727a61cfccf6355cae8c33a63: Status 404 returned error can't find the container with id 4aa15958f257ae0f23583bbc2ec722ddeed04d0727a61cfccf6355cae8c33a63 Jul 06 12:13:44.625449 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.625425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-service-ca\") pod \"maas-controller-68db85d476-gdxn8\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:44.625897 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.625863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-webhook-cert\") pod \"maas-controller-68db85d476-gdxn8\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:44.626107 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.626062 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-service-ca\") pod \"maas-controller-68db85d476-gdxn8\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:44.626213 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.626098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-444jd\" (UniqueName: \"kubernetes.io/projected/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-kube-api-access-444jd\") pod \"maas-controller-68db85d476-gdxn8\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:44.628120 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.628075 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-webhook-cert\") pod \"maas-controller-68db85d476-gdxn8\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:44.634813 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.634793 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-444jd\" (UniqueName: \"kubernetes.io/projected/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-kube-api-access-444jd\") pod \"maas-controller-68db85d476-gdxn8\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:44.711936 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.711883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:44.769764 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.769736 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" event={"ID":"cda98415-055a-466b-ad19-085a387950d2","Type":"ContainerStarted","Data":"4aa15958f257ae0f23583bbc2ec722ddeed04d0727a61cfccf6355cae8c33a63"} Jul 06 12:13:44.841018 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:44.840991 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68db85d476-gdxn8"] Jul 06 12:13:44.843819 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:13:44.843794 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bde5ee4_5b06_4c7b_97ca_d4c4a05f7abe.slice/crio-d436b4fcac7ec9af93abee9bd1164acd14d4a542efe2ef143b102941338eeb62 WatchSource:0}: Error finding container d436b4fcac7ec9af93abee9bd1164acd14d4a542efe2ef143b102941338eeb62: Status 404 returned error can't find the container with id d436b4fcac7ec9af93abee9bd1164acd14d4a542efe2ef143b102941338eeb62 Jul 06 12:13:45.776689 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:45.776622 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68db85d476-gdxn8" event={"ID":"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe","Type":"ContainerStarted","Data":"d436b4fcac7ec9af93abee9bd1164acd14d4a542efe2ef143b102941338eeb62"} Jul 06 12:13:47.788668 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:47.788632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" event={"ID":"cda98415-055a-466b-ad19-085a387950d2","Type":"ContainerStarted","Data":"282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3"} Jul 06 12:13:47.789155 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:47.788827 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:47.790254 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:47.790231 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68db85d476-gdxn8" event={"ID":"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe","Type":"ContainerStarted","Data":"7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7"} Jul 06 12:13:47.790380 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:47.790275 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:47.812641 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:47.812595 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" podStartSLOduration=1.155830923 podStartE2EDuration="3.812582619s" totalImagesPullingTime="2.656751696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:13:47.809075886 +0000 UTC m=+552.910232141" watchObservedRunningTime="2026-07-06 12:13:47.812582619 +0000 UTC m=+552.913738852" Jul 06 12:13:47.832602 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:47.832555 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68db85d476-gdxn8" podStartSLOduration=1.397549223 podStartE2EDuration="3.832541182s" totalImagesPullingTime="2.434991959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:13:47.831286728 +0000 UTC m=+552.932442971" watchObservedRunningTime="2026-07-06 12:13:47.832541182 +0000 UTC m=+552.933697424" Jul 06 12:13:58.805454 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:58.805423 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:58.805892 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:58.805526 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:13:58.871016 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:58.870961 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fc4c66f45-mxb86"] Jul 06 12:13:58.871456 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:58.871387 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" podUID="cda98415-055a-466b-ad19-085a387950d2" containerName="manager" containerID="cri-o://282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3" gracePeriod=30 Jul 06 12:13:59.105023 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.104997 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:59.143691 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.143664 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cda98415-055a-466b-ad19-085a387950d2-service-ca\") pod \"cda98415-055a-466b-ad19-085a387950d2\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " Jul 06 12:13:59.143827 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.143708 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cda98415-055a-466b-ad19-085a387950d2-webhook-cert\") pod \"cda98415-055a-466b-ad19-085a387950d2\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " Jul 06 12:13:59.143827 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.143737 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfzbd\" (UniqueName: \"kubernetes.io/projected/cda98415-055a-466b-ad19-085a387950d2-kube-api-access-dfzbd\") pod \"cda98415-055a-466b-ad19-085a387950d2\" (UID: \"cda98415-055a-466b-ad19-085a387950d2\") " Jul 06 12:13:59.144066 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.144023 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cda98415-055a-466b-ad19-085a387950d2-service-ca" (OuterVolumeSpecName: "service-ca") pod "cda98415-055a-466b-ad19-085a387950d2" (UID: "cda98415-055a-466b-ad19-085a387950d2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:13:59.145843 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.145818 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cda98415-055a-466b-ad19-085a387950d2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cda98415-055a-466b-ad19-085a387950d2" (UID: "cda98415-055a-466b-ad19-085a387950d2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:13:59.145925 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.145818 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cda98415-055a-466b-ad19-085a387950d2-kube-api-access-dfzbd" (OuterVolumeSpecName: "kube-api-access-dfzbd") pod "cda98415-055a-466b-ad19-085a387950d2" (UID: "cda98415-055a-466b-ad19-085a387950d2"). InnerVolumeSpecName "kube-api-access-dfzbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:13:59.244503 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.244471 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cda98415-055a-466b-ad19-085a387950d2-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:13:59.244503 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.244496 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cda98415-055a-466b-ad19-085a387950d2-webhook-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:13:59.244503 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.244506 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfzbd\" (UniqueName: \"kubernetes.io/projected/cda98415-055a-466b-ad19-085a387950d2-kube-api-access-dfzbd\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:13:59.841482 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.841395 2576 generic.go:356] "Generic (PLEG): container finished" podID="cda98415-055a-466b-ad19-085a387950d2" containerID="282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3" exitCode=0 Jul 06 12:13:59.841482 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.841441 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" event={"ID":"cda98415-055a-466b-ad19-085a387950d2","Type":"ContainerDied","Data":"282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3"} Jul 06 12:13:59.841482 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.841450 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" Jul 06 12:13:59.842002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.841483 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fc4c66f45-mxb86" event={"ID":"cda98415-055a-466b-ad19-085a387950d2","Type":"ContainerDied","Data":"4aa15958f257ae0f23583bbc2ec722ddeed04d0727a61cfccf6355cae8c33a63"} Jul 06 12:13:59.842002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.841506 2576 scope.go:117] "RemoveContainer" containerID="282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3" Jul 06 12:13:59.850809 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.850790 2576 scope.go:117] "RemoveContainer" containerID="282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3" Jul 06 12:13:59.851081 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:13:59.851062 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3\": container with ID starting with 282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3 not found: ID does not exist" containerID="282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3" Jul 06 12:13:59.851166 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.851086 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3"} err="failed to get container status \"282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3\": rpc error: code = NotFound desc = could not find container \"282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3\": container with ID starting with 282cc84e30f8f169fb286a591517864626cef2198c020fa98fdc16735c1675e3 not found: ID does not exist" Jul 06 12:13:59.859481 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.859461 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fc4c66f45-mxb86"] Jul 06 12:13:59.864380 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:13:59.864360 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5fc4c66f45-mxb86"] Jul 06 12:14:01.506508 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:01.506480 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cda98415-055a-466b-ad19-085a387950d2" path="/var/lib/kubelet/pods/cda98415-055a-466b-ad19-085a387950d2/volumes" Jul 06 12:14:19.705245 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.705214 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-b66dc4564-t5rhb"] Jul 06 12:14:19.705827 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.705809 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cda98415-055a-466b-ad19-085a387950d2" containerName="manager" Jul 06 12:14:19.705872 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.705832 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cda98415-055a-466b-ad19-085a387950d2" containerName="manager" Jul 06 12:14:19.705928 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.705917 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cda98415-055a-466b-ad19-085a387950d2" containerName="manager" Jul 06 12:14:19.714016 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.713998 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:19.717835 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.717814 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lfnhn\"" Jul 06 12:14:19.718143 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.718129 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 06 12:14:19.725773 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.725753 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-b66dc4564-t5rhb"] Jul 06 12:14:19.800398 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.800371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2f61827-81ee-4623-b32b-8f88d64d7e4b-openshift-service-ca\") pod \"maas-api-b66dc4564-t5rhb\" (UID: \"f2f61827-81ee-4623-b32b-8f88d64d7e4b\") " pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:19.800566 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.800429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4xjw\" (UniqueName: \"kubernetes.io/projected/f2f61827-81ee-4623-b32b-8f88d64d7e4b-kube-api-access-w4xjw\") pod \"maas-api-b66dc4564-t5rhb\" (UID: \"f2f61827-81ee-4623-b32b-8f88d64d7e4b\") " pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:19.800566 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.800497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2f61827-81ee-4623-b32b-8f88d64d7e4b-maas-api-tls\") pod \"maas-api-b66dc4564-t5rhb\" (UID: \"f2f61827-81ee-4623-b32b-8f88d64d7e4b\") " pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:19.901665 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.901639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4xjw\" (UniqueName: \"kubernetes.io/projected/f2f61827-81ee-4623-b32b-8f88d64d7e4b-kube-api-access-w4xjw\") pod \"maas-api-b66dc4564-t5rhb\" (UID: \"f2f61827-81ee-4623-b32b-8f88d64d7e4b\") " pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:19.901808 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.901706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2f61827-81ee-4623-b32b-8f88d64d7e4b-maas-api-tls\") pod \"maas-api-b66dc4564-t5rhb\" (UID: \"f2f61827-81ee-4623-b32b-8f88d64d7e4b\") " pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:19.901808 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.901738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2f61827-81ee-4623-b32b-8f88d64d7e4b-openshift-service-ca\") pod \"maas-api-b66dc4564-t5rhb\" (UID: \"f2f61827-81ee-4623-b32b-8f88d64d7e4b\") " pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:19.902440 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.902418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2f61827-81ee-4623-b32b-8f88d64d7e4b-openshift-service-ca\") pod \"maas-api-b66dc4564-t5rhb\" (UID: \"f2f61827-81ee-4623-b32b-8f88d64d7e4b\") " pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:19.904030 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.904012 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2f61827-81ee-4623-b32b-8f88d64d7e4b-maas-api-tls\") pod \"maas-api-b66dc4564-t5rhb\" (UID: \"f2f61827-81ee-4623-b32b-8f88d64d7e4b\") " pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:19.916158 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:19.916131 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4xjw\" (UniqueName: \"kubernetes.io/projected/f2f61827-81ee-4623-b32b-8f88d64d7e4b-kube-api-access-w4xjw\") pod \"maas-api-b66dc4564-t5rhb\" (UID: \"f2f61827-81ee-4623-b32b-8f88d64d7e4b\") " pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:20.024175 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.024148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:20.185391 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.185363 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-b66dc4564-t5rhb"] Jul 06 12:14:20.188417 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:14:20.188390 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f61827_81ee_4623_b32b_8f88d64d7e4b.slice/crio-7d126f283811fe7ae352554dd0b25155ef1fc01c9a0f965a53e9b83689ec3fcc WatchSource:0}: Error finding container 7d126f283811fe7ae352554dd0b25155ef1fc01c9a0f965a53e9b83689ec3fcc: Status 404 returned error can't find the container with id 7d126f283811fe7ae352554dd0b25155ef1fc01c9a0f965a53e9b83689ec3fcc Jul 06 12:14:20.328083 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.327992 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nfs2z"] Jul 06 12:14:20.331014 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.330991 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" Jul 06 12:14:20.337524 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.337364 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7ld6m\"" Jul 06 12:14:20.337598 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.337569 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 12:14:20.362222 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.362196 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nfs2z"] Jul 06 12:14:20.386988 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.386958 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7nwdm"] Jul 06 12:14:20.389125 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.389107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" Jul 06 12:14:20.404237 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.404215 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7nwdm"] Jul 06 12:14:20.406012 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.405992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbgw9\" (UniqueName: \"kubernetes.io/projected/673144bf-bd68-46ea-bd1a-ddfc46277329-kube-api-access-jbgw9\") pod \"payload-pre-processing-7964457696-nfs2z\" (UID: \"673144bf-bd68-46ea-bd1a-ddfc46277329\") " pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" Jul 06 12:14:20.406125 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.406055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673144bf-bd68-46ea-bd1a-ddfc46277329-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nfs2z\" (UID: \"673144bf-bd68-46ea-bd1a-ddfc46277329\") " pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" Jul 06 12:14:20.507344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.507314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e531302-0728-43ff-b112-008006dfd65f-plugins-config-volume\") pod \"payload-processing-58f86c7798-7nwdm\" (UID: \"8e531302-0728-43ff-b112-008006dfd65f\") " pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" Jul 06 12:14:20.507500 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.507349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r2qt\" (UniqueName: \"kubernetes.io/projected/8e531302-0728-43ff-b112-008006dfd65f-kube-api-access-9r2qt\") pod \"payload-processing-58f86c7798-7nwdm\" (UID: \"8e531302-0728-43ff-b112-008006dfd65f\") " pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" Jul 06 12:14:20.507500 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.507376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673144bf-bd68-46ea-bd1a-ddfc46277329-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nfs2z\" (UID: \"673144bf-bd68-46ea-bd1a-ddfc46277329\") " pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" Jul 06 12:14:20.507500 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.507473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbgw9\" (UniqueName: \"kubernetes.io/projected/673144bf-bd68-46ea-bd1a-ddfc46277329-kube-api-access-jbgw9\") pod \"payload-pre-processing-7964457696-nfs2z\" (UID: \"673144bf-bd68-46ea-bd1a-ddfc46277329\") " pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" Jul 06 12:14:20.508109 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.508091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673144bf-bd68-46ea-bd1a-ddfc46277329-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nfs2z\" (UID: \"673144bf-bd68-46ea-bd1a-ddfc46277329\") " pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" Jul 06 12:14:20.516982 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.516958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbgw9\" (UniqueName: \"kubernetes.io/projected/673144bf-bd68-46ea-bd1a-ddfc46277329-kube-api-access-jbgw9\") pod \"payload-pre-processing-7964457696-nfs2z\" (UID: \"673144bf-bd68-46ea-bd1a-ddfc46277329\") " pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" Jul 06 12:14:20.608697 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.608629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e531302-0728-43ff-b112-008006dfd65f-plugins-config-volume\") pod \"payload-processing-58f86c7798-7nwdm\" (UID: \"8e531302-0728-43ff-b112-008006dfd65f\") " pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" Jul 06 12:14:20.608697 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.608678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r2qt\" (UniqueName: \"kubernetes.io/projected/8e531302-0728-43ff-b112-008006dfd65f-kube-api-access-9r2qt\") pod \"payload-processing-58f86c7798-7nwdm\" (UID: \"8e531302-0728-43ff-b112-008006dfd65f\") " pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" Jul 06 12:14:20.609273 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.609254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e531302-0728-43ff-b112-008006dfd65f-plugins-config-volume\") pod \"payload-processing-58f86c7798-7nwdm\" (UID: \"8e531302-0728-43ff-b112-008006dfd65f\") " pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" Jul 06 12:14:20.624211 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.624186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r2qt\" (UniqueName: \"kubernetes.io/projected/8e531302-0728-43ff-b112-008006dfd65f-kube-api-access-9r2qt\") pod \"payload-processing-58f86c7798-7nwdm\" (UID: \"8e531302-0728-43ff-b112-008006dfd65f\") " pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" Jul 06 12:14:20.641213 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.641190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" Jul 06 12:14:20.698874 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.698845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" Jul 06 12:14:20.790085 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.788708 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nfs2z"] Jul 06 12:14:20.793970 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:14:20.793903 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod673144bf_bd68_46ea_bd1a_ddfc46277329.slice/crio-63b22251c4b978fa0ff0b05e8980e642ea63800f0ae1fa537c0ac59fc62fea55 WatchSource:0}: Error finding container 63b22251c4b978fa0ff0b05e8980e642ea63800f0ae1fa537c0ac59fc62fea55: Status 404 returned error can't find the container with id 63b22251c4b978fa0ff0b05e8980e642ea63800f0ae1fa537c0ac59fc62fea55 Jul 06 12:14:20.847628 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.847589 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7nwdm"] Jul 06 12:14:20.851972 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:14:20.851943 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e531302_0728_43ff_b112_008006dfd65f.slice/crio-eb174f87ff0fbde895034c63b5c12729a6271cf2e3e61c6ffe3df09435aa3be8 WatchSource:0}: Error finding container eb174f87ff0fbde895034c63b5c12729a6271cf2e3e61c6ffe3df09435aa3be8: Status 404 returned error can't find the container with id eb174f87ff0fbde895034c63b5c12729a6271cf2e3e61c6ffe3df09435aa3be8 Jul 06 12:14:20.932506 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.932440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-b66dc4564-t5rhb" event={"ID":"f2f61827-81ee-4623-b32b-8f88d64d7e4b","Type":"ContainerStarted","Data":"7d126f283811fe7ae352554dd0b25155ef1fc01c9a0f965a53e9b83689ec3fcc"} Jul 06 12:14:20.933619 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.933584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" event={"ID":"8e531302-0728-43ff-b112-008006dfd65f","Type":"ContainerStarted","Data":"eb174f87ff0fbde895034c63b5c12729a6271cf2e3e61c6ffe3df09435aa3be8"} Jul 06 12:14:20.934655 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:20.934636 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" event={"ID":"673144bf-bd68-46ea-bd1a-ddfc46277329","Type":"ContainerStarted","Data":"63b22251c4b978fa0ff0b05e8980e642ea63800f0ae1fa537c0ac59fc62fea55"} Jul 06 12:14:22.945000 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:22.944967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-b66dc4564-t5rhb" event={"ID":"f2f61827-81ee-4623-b32b-8f88d64d7e4b","Type":"ContainerStarted","Data":"52aa546cf4ba79358fd3e9d8074e5c33c520bc005d2ea2ac2f6ab8bf5845b757"} Jul 06 12:14:22.945453 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:22.945139 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:22.946512 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:22.946485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" event={"ID":"8e531302-0728-43ff-b112-008006dfd65f","Type":"ContainerStarted","Data":"531519da086af2355c3ce1b7a1e6195f9b663077f580b8733415fec4516741a3"} Jul 06 12:14:22.946659 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:22.946536 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" Jul 06 12:14:22.948094 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:22.948069 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" event={"ID":"673144bf-bd68-46ea-bd1a-ddfc46277329","Type":"ContainerStarted","Data":"ae48a527947c0397e63b054b19ec0f5a537db14065e48a99ad246bfbb1702cf8"} Jul 06 12:14:22.948237 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:22.948141 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" Jul 06 12:14:22.969388 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:22.969347 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-b66dc4564-t5rhb" podStartSLOduration=2.230536819 podStartE2EDuration="3.969331879s" totalImagesPullingTime="1.73879506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:14:22.969194512 +0000 UTC m=+588.070350755" watchObservedRunningTime="2026-07-06 12:14:22.969331879 +0000 UTC m=+588.070488122" Jul 06 12:14:23.003309 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:23.003272 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" podStartSLOduration=1.464402492 podStartE2EDuration="3.003258894s" totalImagesPullingTime="1.538856402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:14:22.999509095 +0000 UTC m=+588.100665349" watchObservedRunningTime="2026-07-06 12:14:23.003258894 +0000 UTC m=+588.104415172" Jul 06 12:14:28.958431 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:28.958405 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-b66dc4564-t5rhb" Jul 06 12:14:28.981671 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:28.981621 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" podStartSLOduration=7.51197452 podStartE2EDuration="8.981607789s" totalImagesPullingTime="1.469633269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:14:23.02663701 +0000 UTC m=+588.127793252" watchObservedRunningTime="2026-07-06 12:14:28.981607789 +0000 UTC m=+594.082764031" Jul 06 12:14:33.954227 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:33.954198 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-7nwdm" Jul 06 12:14:33.954647 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:33.954479 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-nfs2z" Jul 06 12:14:58.704895 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.704828 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7"] Jul 06 12:14:58.710214 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.710200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.712636 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.712614 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 12:14:58.713308 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.713290 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 12:14:58.713427 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.713375 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 12:14:58.713427 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.713379 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d6kxf\"" Jul 06 12:14:58.725678 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.725658 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7"] Jul 06 12:14:58.729274 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.729256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.729378 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.729284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.729378 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.729302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2dde514-c210-4900-9327-48a1a8427766-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.729378 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.729319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.729378 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.729369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.729572 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.729421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4455b\" (UniqueName: \"kubernetes.io/projected/b2dde514-c210-4900-9327-48a1a8427766-kube-api-access-4455b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.830338 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.830311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.830453 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.830343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.830453 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.830360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2dde514-c210-4900-9327-48a1a8427766-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.830453 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.830403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.830587 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.830566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.830663 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.830646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4455b\" (UniqueName: \"kubernetes.io/projected/b2dde514-c210-4900-9327-48a1a8427766-kube-api-access-4455b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.830745 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.830722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.830808 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.830788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.830929 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.830905 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.832541 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.832522 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2dde514-c210-4900-9327-48a1a8427766-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.832793 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.832776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2dde514-c210-4900-9327-48a1a8427766-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:58.839780 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:58.839757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4455b\" (UniqueName: \"kubernetes.io/projected/b2dde514-c210-4900-9327-48a1a8427766-kube-api-access-4455b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tzzd7\" (UID: \"b2dde514-c210-4900-9327-48a1a8427766\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:59.020092 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:59.020064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:14:59.170654 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:14:59.170627 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7"] Jul 06 12:14:59.172848 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:14:59.172820 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2dde514_c210_4900_9327_48a1a8427766.slice/crio-2041c93389fb60b3a0605f86c7ca7184bf04f9ba7e963a2c33b7abc98d587d22 WatchSource:0}: Error finding container 2041c93389fb60b3a0605f86c7ca7184bf04f9ba7e963a2c33b7abc98d587d22: Status 404 returned error can't find the container with id 2041c93389fb60b3a0605f86c7ca7184bf04f9ba7e963a2c33b7abc98d587d22 Jul 06 12:15:00.137617 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:15:00.137522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" event={"ID":"b2dde514-c210-4900-9327-48a1a8427766","Type":"ContainerStarted","Data":"2041c93389fb60b3a0605f86c7ca7184bf04f9ba7e963a2c33b7abc98d587d22"} Jul 06 12:15:01.143909 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:15:01.143879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" event={"ID":"b2dde514-c210-4900-9327-48a1a8427766","Type":"ContainerStarted","Data":"7d6840ae0ece2bcf523306a34c6530c028a83770b62610ddd61eaa66ac9ee165"} Jul 06 12:15:01.163736 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:15:01.163689 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" podStartSLOduration=2.099965539 podStartE2EDuration="3.163674131s" totalImagesPullingTime="1.063708592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:15:01.162778971 +0000 UTC m=+626.263935213" watchObservedRunningTime="2026-07-06 12:15:01.163674131 +0000 UTC m=+626.264830372" Jul 06 12:15:09.020573 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:15:09.020531 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:15:09.022999 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:15:09.020597 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:15:09.033119 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:15:09.033093 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:15:09.192524 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:15:09.192495 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tzzd7" Jul 06 12:17:50.593948 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.593912 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68db85d476-gdxn8"] Jul 06 12:17:50.594481 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.594128 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-68db85d476-gdxn8" podUID="7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe" containerName="manager" containerID="cri-o://7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7" gracePeriod=30 Jul 06 12:17:50.843359 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.843331 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:17:50.857946 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.857889 2576 generic.go:356] "Generic (PLEG): container finished" podID="7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe" containerID="7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7" exitCode=0 Jul 06 12:17:50.857946 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.857924 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68db85d476-gdxn8" Jul 06 12:17:50.857946 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.857931 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68db85d476-gdxn8" event={"ID":"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe","Type":"ContainerDied","Data":"7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7"} Jul 06 12:17:50.858138 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.857986 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68db85d476-gdxn8" event={"ID":"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe","Type":"ContainerDied","Data":"d436b4fcac7ec9af93abee9bd1164acd14d4a542efe2ef143b102941338eeb62"} Jul 06 12:17:50.858138 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.858011 2576 scope.go:117] "RemoveContainer" containerID="7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7" Jul 06 12:17:50.866406 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.866380 2576 scope.go:117] "RemoveContainer" containerID="7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7" Jul 06 12:17:50.866706 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:17:50.866676 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7\": container with ID starting with 7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7 not found: ID does not exist" containerID="7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7" Jul 06 12:17:50.866797 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.866710 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7"} err="failed to get container status \"7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7\": rpc error: code = NotFound desc = could not find container \"7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7\": container with ID starting with 7b3649b0b8a8af84fec3c4cadc6098052620b92f736627d268a300ca14a0a6a7 not found: ID does not exist" Jul 06 12:17:50.907291 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.907268 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-webhook-cert\") pod \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " Jul 06 12:17:50.907441 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.907335 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-service-ca\") pod \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " Jul 06 12:17:50.907441 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.907360 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-444jd\" (UniqueName: \"kubernetes.io/projected/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-kube-api-access-444jd\") pod \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\" (UID: \"7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe\") " Jul 06 12:17:50.907697 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.907673 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-service-ca" (OuterVolumeSpecName: "service-ca") pod "7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe" (UID: "7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:17:50.909368 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.909337 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe" (UID: "7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:17:50.909469 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:50.909378 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-kube-api-access-444jd" (OuterVolumeSpecName: "kube-api-access-444jd") pod "7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe" (UID: "7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe"). InnerVolumeSpecName "kube-api-access-444jd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:17:51.007901 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.007873 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:17:51.007901 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.007898 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-444jd\" (UniqueName: \"kubernetes.io/projected/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-kube-api-access-444jd\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:17:51.008065 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.007912 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe-webhook-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:17:51.182097 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.182068 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68db85d476-gdxn8"] Jul 06 12:17:51.183631 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.183609 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68db85d476-gdxn8"] Jul 06 12:17:51.506449 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.506416 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe" path="/var/lib/kubelet/pods/7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe/volumes" Jul 06 12:17:51.974723 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.974694 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68db85d476-g8qmn"] Jul 06 12:17:51.975140 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.975060 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe" containerName="manager" Jul 06 12:17:51.975140 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.975072 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe" containerName="manager" Jul 06 12:17:51.975140 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.975135 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bde5ee4-5b06-4c7b-97ca-d4c4a05f7abe" containerName="manager" Jul 06 12:17:51.979260 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.979243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:51.981974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.981956 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k6psq\"" Jul 06 12:17:51.982479 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.982459 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 12:17:51.982588 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.982465 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 12:17:51.991615 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:51.991596 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68db85d476-g8qmn"] Jul 06 12:17:52.015826 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.015798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f119f275-f8b4-4991-8089-ff2f7cfc4553-service-ca\") pod \"maas-controller-68db85d476-g8qmn\" (UID: \"f119f275-f8b4-4991-8089-ff2f7cfc4553\") " pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:52.015943 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.015922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5qqr\" (UniqueName: \"kubernetes.io/projected/f119f275-f8b4-4991-8089-ff2f7cfc4553-kube-api-access-b5qqr\") pod \"maas-controller-68db85d476-g8qmn\" (UID: \"f119f275-f8b4-4991-8089-ff2f7cfc4553\") " pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:52.015997 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.015963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f119f275-f8b4-4991-8089-ff2f7cfc4553-webhook-cert\") pod \"maas-controller-68db85d476-g8qmn\" (UID: \"f119f275-f8b4-4991-8089-ff2f7cfc4553\") " pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:52.117290 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.117264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5qqr\" (UniqueName: \"kubernetes.io/projected/f119f275-f8b4-4991-8089-ff2f7cfc4553-kube-api-access-b5qqr\") pod \"maas-controller-68db85d476-g8qmn\" (UID: \"f119f275-f8b4-4991-8089-ff2f7cfc4553\") " pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:52.117394 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.117292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f119f275-f8b4-4991-8089-ff2f7cfc4553-webhook-cert\") pod \"maas-controller-68db85d476-g8qmn\" (UID: \"f119f275-f8b4-4991-8089-ff2f7cfc4553\") " pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:52.117394 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.117341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f119f275-f8b4-4991-8089-ff2f7cfc4553-service-ca\") pod \"maas-controller-68db85d476-g8qmn\" (UID: \"f119f275-f8b4-4991-8089-ff2f7cfc4553\") " pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:52.117926 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.117905 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f119f275-f8b4-4991-8089-ff2f7cfc4553-service-ca\") pod \"maas-controller-68db85d476-g8qmn\" (UID: \"f119f275-f8b4-4991-8089-ff2f7cfc4553\") " pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:52.119760 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.119738 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f119f275-f8b4-4991-8089-ff2f7cfc4553-webhook-cert\") pod \"maas-controller-68db85d476-g8qmn\" (UID: \"f119f275-f8b4-4991-8089-ff2f7cfc4553\") " pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:52.127377 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.127357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5qqr\" (UniqueName: \"kubernetes.io/projected/f119f275-f8b4-4991-8089-ff2f7cfc4553-kube-api-access-b5qqr\") pod \"maas-controller-68db85d476-g8qmn\" (UID: \"f119f275-f8b4-4991-8089-ff2f7cfc4553\") " pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:52.290404 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.290345 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:52.422665 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.422628 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68db85d476-g8qmn"] Jul 06 12:17:52.423753 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:17:52.423718 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf119f275_f8b4_4991_8089_ff2f7cfc4553.slice/crio-f6cdc5309b5af7476b388fed50bfe2768917ae35f80573c5dfac298ec290042f WatchSource:0}: Error finding container f6cdc5309b5af7476b388fed50bfe2768917ae35f80573c5dfac298ec290042f: Status 404 returned error can't find the container with id f6cdc5309b5af7476b388fed50bfe2768917ae35f80573c5dfac298ec290042f Jul 06 12:17:52.425085 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.425065 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 12:17:52.868706 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:52.868666 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68db85d476-g8qmn" event={"ID":"f119f275-f8b4-4991-8089-ff2f7cfc4553","Type":"ContainerStarted","Data":"f6cdc5309b5af7476b388fed50bfe2768917ae35f80573c5dfac298ec290042f"} Jul 06 12:17:53.874420 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:53.874391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68db85d476-g8qmn" event={"ID":"f119f275-f8b4-4991-8089-ff2f7cfc4553","Type":"ContainerStarted","Data":"a46618f18c4e30b3afb3856445a1d849ab30cada820f43b25ea696530e503848"} Jul 06 12:17:53.874801 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:53.874453 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:17:53.901174 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:17:53.901130 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68db85d476-g8qmn" podStartSLOduration=2.13117536 podStartE2EDuration="2.901115446s" totalImagesPullingTime="769.940086ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:17:53.897146834 +0000 UTC m=+798.998303076" watchObservedRunningTime="2026-07-06 12:17:53.901115446 +0000 UTC m=+799.002271688" Jul 06 12:18:04.884383 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:18:04.884307 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68db85d476-g8qmn" Jul 06 12:30:05.044967 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.044936 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6"] Jul 06 12:30:05.048469 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.048447 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:05.050693 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.050673 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-020e6184-serving-cert\"" Jul 06 12:30:05.067002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.066972 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6"] Jul 06 12:30:05.131702 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.131675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46aa2475-5254-45fe-9082-d58167eb5461-openshift-service-ca\") pod \"maas-api-e2e-ait-020e6184-5995476cbf-4zfb6\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:05.131837 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.131714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhjqk\" (UniqueName: \"kubernetes.io/projected/46aa2475-5254-45fe-9082-d58167eb5461-kube-api-access-qhjqk\") pod \"maas-api-e2e-ait-020e6184-5995476cbf-4zfb6\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:05.131837 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.131785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46aa2475-5254-45fe-9082-d58167eb5461-maas-api-tls\") pod \"maas-api-e2e-ait-020e6184-5995476cbf-4zfb6\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:05.232314 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.232281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46aa2475-5254-45fe-9082-d58167eb5461-maas-api-tls\") pod \"maas-api-e2e-ait-020e6184-5995476cbf-4zfb6\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:05.232489 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.232331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46aa2475-5254-45fe-9082-d58167eb5461-openshift-service-ca\") pod \"maas-api-e2e-ait-020e6184-5995476cbf-4zfb6\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:05.232489 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.232359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjqk\" (UniqueName: \"kubernetes.io/projected/46aa2475-5254-45fe-9082-d58167eb5461-kube-api-access-qhjqk\") pod \"maas-api-e2e-ait-020e6184-5995476cbf-4zfb6\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:05.232998 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.232975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46aa2475-5254-45fe-9082-d58167eb5461-openshift-service-ca\") pod \"maas-api-e2e-ait-020e6184-5995476cbf-4zfb6\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:05.234688 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.234663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46aa2475-5254-45fe-9082-d58167eb5461-maas-api-tls\") pod \"maas-api-e2e-ait-020e6184-5995476cbf-4zfb6\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:05.241636 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.241614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhjqk\" (UniqueName: \"kubernetes.io/projected/46aa2475-5254-45fe-9082-d58167eb5461-kube-api-access-qhjqk\") pod \"maas-api-e2e-ait-020e6184-5995476cbf-4zfb6\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:05.359795 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.359711 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:05.709635 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.709565 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6"] Jul 06 12:30:05.715187 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:30:05.715155 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46aa2475_5254_45fe_9082_d58167eb5461.slice/crio-8588474f1847cc85ab8c6bb9ed29ac4c2a4029e99f13c8d1e777d2c9f216b468 WatchSource:0}: Error finding container 8588474f1847cc85ab8c6bb9ed29ac4c2a4029e99f13c8d1e777d2c9f216b468: Status 404 returned error can't find the container with id 8588474f1847cc85ab8c6bb9ed29ac4c2a4029e99f13c8d1e777d2c9f216b468 Jul 06 12:30:05.716430 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:05.716412 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 12:30:06.003349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:06.003313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" event={"ID":"46aa2475-5254-45fe-9082-d58167eb5461","Type":"ContainerStarted","Data":"8588474f1847cc85ab8c6bb9ed29ac4c2a4029e99f13c8d1e777d2c9f216b468"} Jul 06 12:30:07.009408 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:07.009371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" event={"ID":"46aa2475-5254-45fe-9082-d58167eb5461","Type":"ContainerStarted","Data":"e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d"} Jul 06 12:30:07.009798 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:07.009558 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:07.035238 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:07.035188 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" podStartSLOduration=1.543757912 podStartE2EDuration="2.035171085s" totalImagesPullingTime="491.413173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:07.032084287 +0000 UTC m=+1532.133240543" watchObservedRunningTime="2026-07-06 12:30:07.035171085 +0000 UTC m=+1532.136327326" Jul 06 12:30:13.018591 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.018563 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:13.065099 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.065071 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6"] Jul 06 12:30:13.065276 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.065240 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" podUID="46aa2475-5254-45fe-9082-d58167eb5461" containerName="maas-api" containerID="cri-o://e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d" gracePeriod=30 Jul 06 12:30:13.100321 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:30:13.100295 2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-020e6184-serving-cert: secret "maas-api-e2e-ait-020e6184-serving-cert" not found Jul 06 12:30:13.100444 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:30:13.100378 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46aa2475-5254-45fe-9082-d58167eb5461-maas-api-tls podName:46aa2475-5254-45fe-9082-d58167eb5461 nodeName:}" failed. No retries permitted until 2026-07-06 12:30:13.60035909 +0000 UTC m=+1538.701515325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/46aa2475-5254-45fe-9082-d58167eb5461-maas-api-tls") pod "maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" (UID: "46aa2475-5254-45fe-9082-d58167eb5461") : secret "maas-api-e2e-ait-020e6184-serving-cert" not found Jul 06 12:30:13.320183 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.320160 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:13.403280 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.403250 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhjqk\" (UniqueName: \"kubernetes.io/projected/46aa2475-5254-45fe-9082-d58167eb5461-kube-api-access-qhjqk\") pod \"46aa2475-5254-45fe-9082-d58167eb5461\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " Jul 06 12:30:13.403433 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.403327 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46aa2475-5254-45fe-9082-d58167eb5461-openshift-service-ca\") pod \"46aa2475-5254-45fe-9082-d58167eb5461\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " Jul 06 12:30:13.403433 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.403376 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46aa2475-5254-45fe-9082-d58167eb5461-maas-api-tls\") pod \"46aa2475-5254-45fe-9082-d58167eb5461\" (UID: \"46aa2475-5254-45fe-9082-d58167eb5461\") " Jul 06 12:30:13.403731 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.403703 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46aa2475-5254-45fe-9082-d58167eb5461-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "46aa2475-5254-45fe-9082-d58167eb5461" (UID: "46aa2475-5254-45fe-9082-d58167eb5461"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:30:13.405450 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.405427 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46aa2475-5254-45fe-9082-d58167eb5461-kube-api-access-qhjqk" (OuterVolumeSpecName: "kube-api-access-qhjqk") pod "46aa2475-5254-45fe-9082-d58167eb5461" (UID: "46aa2475-5254-45fe-9082-d58167eb5461"). InnerVolumeSpecName "kube-api-access-qhjqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:30:13.405546 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.405478 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46aa2475-5254-45fe-9082-d58167eb5461-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "46aa2475-5254-45fe-9082-d58167eb5461" (UID: "46aa2475-5254-45fe-9082-d58167eb5461"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:30:13.504123 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.504096 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46aa2475-5254-45fe-9082-d58167eb5461-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:30:13.504123 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.504120 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhjqk\" (UniqueName: \"kubernetes.io/projected/46aa2475-5254-45fe-9082-d58167eb5461-kube-api-access-qhjqk\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:30:13.504341 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:13.504136 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46aa2475-5254-45fe-9082-d58167eb5461-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:30:14.041379 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:14.041347 2576 generic.go:356] "Generic (PLEG): container finished" podID="46aa2475-5254-45fe-9082-d58167eb5461" containerID="e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d" exitCode=0 Jul 06 12:30:14.041834 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:14.041396 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" Jul 06 12:30:14.041834 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:14.041427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" event={"ID":"46aa2475-5254-45fe-9082-d58167eb5461","Type":"ContainerDied","Data":"e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d"} Jul 06 12:30:14.041834 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:14.041477 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6" event={"ID":"46aa2475-5254-45fe-9082-d58167eb5461","Type":"ContainerDied","Data":"8588474f1847cc85ab8c6bb9ed29ac4c2a4029e99f13c8d1e777d2c9f216b468"} Jul 06 12:30:14.041834 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:14.041498 2576 scope.go:117] "RemoveContainer" containerID="e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d" Jul 06 12:30:14.049983 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:14.049965 2576 scope.go:117] "RemoveContainer" containerID="e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d" Jul 06 12:30:14.050286 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:30:14.050259 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d\": container with ID starting with e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d not found: ID does not exist" containerID="e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d" Jul 06 12:30:14.050363 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:14.050295 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d"} err="failed to get container status \"e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d\": rpc error: code = NotFound desc = could not find container \"e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d\": container with ID starting with e95f4860473360e7979cea43dace2e1f2451c12db7709e69ba53021e1486e76d not found: ID does not exist" Jul 06 12:30:14.058312 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:14.058292 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6"] Jul 06 12:30:14.062595 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:14.062566 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-020e6184-5995476cbf-4zfb6"] Jul 06 12:30:15.507567 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:15.507533 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46aa2475-5254-45fe-9082-d58167eb5461" path="/var/lib/kubelet/pods/46aa2475-5254-45fe-9082-d58167eb5461/volumes" Jul 06 12:30:22.238676 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.238649 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw"] Jul 06 12:30:22.239136 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.239007 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa2475-5254-45fe-9082-d58167eb5461" containerName="maas-api" Jul 06 12:30:22.239136 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.239019 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa2475-5254-45fe-9082-d58167eb5461" containerName="maas-api" Jul 06 12:30:22.239136 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.239116 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="46aa2475-5254-45fe-9082-d58167eb5461" containerName="maas-api" Jul 06 12:30:22.242958 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.242935 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:22.247775 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.247741 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-4ee050e5-serving-cert\"" Jul 06 12:30:22.275516 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.275491 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw"] Jul 06 12:30:22.378299 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.378274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-openshift-service-ca\") pod \"maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:22.378452 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.378310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tqk6\" (UniqueName: \"kubernetes.io/projected/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-kube-api-access-4tqk6\") pod \"maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:22.378452 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.378388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-maas-api-tls\") pod \"maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:22.479638 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.479610 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-openshift-service-ca\") pod \"maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:22.479757 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.479645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tqk6\" (UniqueName: \"kubernetes.io/projected/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-kube-api-access-4tqk6\") pod \"maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:22.479757 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.479707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-maas-api-tls\") pod \"maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:22.479851 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:30:22.479833 2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-4ee050e5-serving-cert: secret "maas-api-e2e-ait-4ee050e5-serving-cert" not found Jul 06 12:30:22.479922 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:30:22.479910 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-maas-api-tls podName:7c88bd96-8e60-488b-815b-e78aaeb0d5f7 nodeName:}" failed. No retries permitted until 2026-07-06 12:30:22.979887477 +0000 UTC m=+1548.081043708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-maas-api-tls") pod "maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" (UID: "7c88bd96-8e60-488b-815b-e78aaeb0d5f7") : secret "maas-api-e2e-ait-4ee050e5-serving-cert" not found Jul 06 12:30:22.480362 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.480345 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-openshift-service-ca\") pod \"maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:22.515653 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.515589 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tqk6\" (UniqueName: \"kubernetes.io/projected/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-kube-api-access-4tqk6\") pod \"maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:22.983486 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.983453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-maas-api-tls\") pod \"maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:22.985803 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:22.985780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-maas-api-tls\") pod \"maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:23.153863 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:23.153830 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:23.336244 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:23.336202 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw"] Jul 06 12:30:23.339136 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:30:23.339107 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c88bd96_8e60_488b_815b_e78aaeb0d5f7.slice/crio-0012daeae53208928650ebb26be10015f94ecc8bcc33c967e9d659ece00315cb WatchSource:0}: Error finding container 0012daeae53208928650ebb26be10015f94ecc8bcc33c967e9d659ece00315cb: Status 404 returned error can't find the container with id 0012daeae53208928650ebb26be10015f94ecc8bcc33c967e9d659ece00315cb Jul 06 12:30:24.085603 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:24.085567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" event={"ID":"7c88bd96-8e60-488b-815b-e78aaeb0d5f7","Type":"ContainerStarted","Data":"159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3"} Jul 06 12:30:24.085796 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:24.085661 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" event={"ID":"7c88bd96-8e60-488b-815b-e78aaeb0d5f7","Type":"ContainerStarted","Data":"0012daeae53208928650ebb26be10015f94ecc8bcc33c967e9d659ece00315cb"} Jul 06 12:30:24.085796 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:24.085701 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:24.120603 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:24.120554 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" podStartSLOduration=1.751756428 podStartE2EDuration="2.120539678s" totalImagesPullingTime="368.78325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:24.118850868 +0000 UTC m=+1549.220007111" watchObservedRunningTime="2026-07-06 12:30:24.120539678 +0000 UTC m=+1549.221695920" Jul 06 12:30:30.095454 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.095428 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:30.144691 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.144664 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw"] Jul 06 12:30:30.144864 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.144829 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" podUID="7c88bd96-8e60-488b-815b-e78aaeb0d5f7" containerName="maas-api" containerID="cri-o://159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3" gracePeriod=30 Jul 06 12:30:30.387688 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.387667 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:30.544429 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.544400 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-openshift-service-ca\") pod \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " Jul 06 12:30:30.544429 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.544430 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-maas-api-tls\") pod \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " Jul 06 12:30:30.544647 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.544462 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tqk6\" (UniqueName: \"kubernetes.io/projected/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-kube-api-access-4tqk6\") pod \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\" (UID: \"7c88bd96-8e60-488b-815b-e78aaeb0d5f7\") " Jul 06 12:30:30.544864 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.544839 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7c88bd96-8e60-488b-815b-e78aaeb0d5f7" (UID: "7c88bd96-8e60-488b-815b-e78aaeb0d5f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:30:30.546529 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.546506 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7c88bd96-8e60-488b-815b-e78aaeb0d5f7" (UID: "7c88bd96-8e60-488b-815b-e78aaeb0d5f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:30:30.546586 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.546531 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-kube-api-access-4tqk6" (OuterVolumeSpecName: "kube-api-access-4tqk6") pod "7c88bd96-8e60-488b-815b-e78aaeb0d5f7" (UID: "7c88bd96-8e60-488b-815b-e78aaeb0d5f7"). InnerVolumeSpecName "kube-api-access-4tqk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:30:30.645259 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.645209 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:30:30.645259 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.645229 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:30:30.645259 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:30.645239 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tqk6\" (UniqueName: \"kubernetes.io/projected/7c88bd96-8e60-488b-815b-e78aaeb0d5f7-kube-api-access-4tqk6\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:30:31.118328 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:31.118295 2576 generic.go:356] "Generic (PLEG): container finished" podID="7c88bd96-8e60-488b-815b-e78aaeb0d5f7" containerID="159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3" exitCode=0 Jul 06 12:30:31.118771 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:31.118337 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" Jul 06 12:30:31.118771 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:31.118358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" event={"ID":"7c88bd96-8e60-488b-815b-e78aaeb0d5f7","Type":"ContainerDied","Data":"159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3"} Jul 06 12:30:31.118771 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:31.118415 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw" event={"ID":"7c88bd96-8e60-488b-815b-e78aaeb0d5f7","Type":"ContainerDied","Data":"0012daeae53208928650ebb26be10015f94ecc8bcc33c967e9d659ece00315cb"} Jul 06 12:30:31.118771 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:31.118445 2576 scope.go:117] "RemoveContainer" containerID="159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3" Jul 06 12:30:31.127514 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:31.127496 2576 scope.go:117] "RemoveContainer" containerID="159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3" Jul 06 12:30:31.127792 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:30:31.127774 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3\": container with ID starting with 159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3 not found: ID does not exist" containerID="159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3" Jul 06 12:30:31.127847 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:31.127805 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3"} err="failed to get container status \"159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3\": rpc error: code = NotFound desc = could not find container \"159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3\": container with ID starting with 159115f7888f0baa352952a04e3acff1b4df417d97270fc2dd5060090666cdd3 not found: ID does not exist" Jul 06 12:30:31.144378 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:31.144359 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw"] Jul 06 12:30:31.150033 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:31.150012 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-4ee050e5-6fb9fdb9cd-7ldgw"] Jul 06 12:30:31.507563 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:31.507536 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c88bd96-8e60-488b-815b-e78aaeb0d5f7" path="/var/lib/kubelet/pods/7c88bd96-8e60-488b-815b-e78aaeb0d5f7/volumes" Jul 06 12:30:40.532589 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.532557 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x"] Jul 06 12:30:40.533076 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.533060 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c88bd96-8e60-488b-815b-e78aaeb0d5f7" containerName="maas-api" Jul 06 12:30:40.533139 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.533079 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c88bd96-8e60-488b-815b-e78aaeb0d5f7" containerName="maas-api" Jul 06 12:30:40.533187 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.533176 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c88bd96-8e60-488b-815b-e78aaeb0d5f7" containerName="maas-api" Jul 06 12:30:40.536393 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.536373 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:40.541600 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.541575 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-7a005a82-serving-cert\"" Jul 06 12:30:40.570831 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.570802 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x"] Jul 06 12:30:40.622520 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.622491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61556271-c6ea-4c09-914d-7e52eb08dba3-maas-api-tls\") pod \"maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:40.622651 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.622539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdmm6\" (UniqueName: \"kubernetes.io/projected/61556271-c6ea-4c09-914d-7e52eb08dba3-kube-api-access-fdmm6\") pod \"maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:40.622692 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.622651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61556271-c6ea-4c09-914d-7e52eb08dba3-openshift-service-ca\") pod \"maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:40.723395 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.723369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61556271-c6ea-4c09-914d-7e52eb08dba3-openshift-service-ca\") pod \"maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:40.723530 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.723402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61556271-c6ea-4c09-914d-7e52eb08dba3-maas-api-tls\") pod \"maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:40.723530 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.723428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdmm6\" (UniqueName: \"kubernetes.io/projected/61556271-c6ea-4c09-914d-7e52eb08dba3-kube-api-access-fdmm6\") pod \"maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:40.724068 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.724029 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61556271-c6ea-4c09-914d-7e52eb08dba3-openshift-service-ca\") pod \"maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:40.725810 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.725785 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61556271-c6ea-4c09-914d-7e52eb08dba3-maas-api-tls\") pod \"maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:40.741705 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.741681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdmm6\" (UniqueName: \"kubernetes.io/projected/61556271-c6ea-4c09-914d-7e52eb08dba3-kube-api-access-fdmm6\") pod \"maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:40.847488 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.847431 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:40.983675 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:40.983646 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x"] Jul 06 12:30:40.986788 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:30:40.986758 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61556271_c6ea_4c09_914d_7e52eb08dba3.slice/crio-0459d7c891cb35f8db305eeaaa420e0a20a8964c28a59df5c833ceba4ae82b8a WatchSource:0}: Error finding container 0459d7c891cb35f8db305eeaaa420e0a20a8964c28a59df5c833ceba4ae82b8a: Status 404 returned error can't find the container with id 0459d7c891cb35f8db305eeaaa420e0a20a8964c28a59df5c833ceba4ae82b8a Jul 06 12:30:41.162847 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:41.162776 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" event={"ID":"61556271-c6ea-4c09-914d-7e52eb08dba3","Type":"ContainerStarted","Data":"0459d7c891cb35f8db305eeaaa420e0a20a8964c28a59df5c833ceba4ae82b8a"} Jul 06 12:30:42.168965 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:42.168917 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" event={"ID":"61556271-c6ea-4c09-914d-7e52eb08dba3","Type":"ContainerStarted","Data":"b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7"} Jul 06 12:30:42.169413 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:42.169080 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:42.193436 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:42.193388 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" podStartSLOduration=1.7444099259999999 podStartE2EDuration="2.193373926s" totalImagesPullingTime="448.964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:42.191542438 +0000 UTC m=+1567.292698700" watchObservedRunningTime="2026-07-06 12:30:42.193373926 +0000 UTC m=+1567.294530168" Jul 06 12:30:47.923193 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:47.923157 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x"] Jul 06 12:30:47.923620 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:47.923369 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" podUID="61556271-c6ea-4c09-914d-7e52eb08dba3" containerName="maas-api" containerID="cri-o://b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7" gracePeriod=30 Jul 06 12:30:47.928381 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:47.928361 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:48.171946 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.171920 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:48.195382 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.195315 2576 generic.go:356] "Generic (PLEG): container finished" podID="61556271-c6ea-4c09-914d-7e52eb08dba3" containerID="b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7" exitCode=0 Jul 06 12:30:48.195382 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.195362 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" Jul 06 12:30:48.195518 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.195411 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" event={"ID":"61556271-c6ea-4c09-914d-7e52eb08dba3","Type":"ContainerDied","Data":"b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7"} Jul 06 12:30:48.195518 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.195472 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x" event={"ID":"61556271-c6ea-4c09-914d-7e52eb08dba3","Type":"ContainerDied","Data":"0459d7c891cb35f8db305eeaaa420e0a20a8964c28a59df5c833ceba4ae82b8a"} Jul 06 12:30:48.195518 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.195504 2576 scope.go:117] "RemoveContainer" containerID="b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7" Jul 06 12:30:48.203090 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.203075 2576 scope.go:117] "RemoveContainer" containerID="b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7" Jul 06 12:30:48.203330 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:30:48.203310 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7\": container with ID starting with b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7 not found: ID does not exist" containerID="b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7" Jul 06 12:30:48.203390 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.203341 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7"} err="failed to get container status \"b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7\": rpc error: code = NotFound desc = could not find container \"b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7\": container with ID starting with b550931a6bb4967be329fdc777f65c916c968e10314c0986147416b1af1e26b7 not found: ID does not exist" Jul 06 12:30:48.293885 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.293861 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdmm6\" (UniqueName: \"kubernetes.io/projected/61556271-c6ea-4c09-914d-7e52eb08dba3-kube-api-access-fdmm6\") pod \"61556271-c6ea-4c09-914d-7e52eb08dba3\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " Jul 06 12:30:48.294062 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.293924 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61556271-c6ea-4c09-914d-7e52eb08dba3-maas-api-tls\") pod \"61556271-c6ea-4c09-914d-7e52eb08dba3\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " Jul 06 12:30:48.294148 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.294062 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61556271-c6ea-4c09-914d-7e52eb08dba3-openshift-service-ca\") pod \"61556271-c6ea-4c09-914d-7e52eb08dba3\" (UID: \"61556271-c6ea-4c09-914d-7e52eb08dba3\") " Jul 06 12:30:48.294390 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.294358 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61556271-c6ea-4c09-914d-7e52eb08dba3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "61556271-c6ea-4c09-914d-7e52eb08dba3" (UID: "61556271-c6ea-4c09-914d-7e52eb08dba3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:30:48.295868 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.295846 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61556271-c6ea-4c09-914d-7e52eb08dba3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "61556271-c6ea-4c09-914d-7e52eb08dba3" (UID: "61556271-c6ea-4c09-914d-7e52eb08dba3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:30:48.295951 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.295889 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61556271-c6ea-4c09-914d-7e52eb08dba3-kube-api-access-fdmm6" (OuterVolumeSpecName: "kube-api-access-fdmm6") pod "61556271-c6ea-4c09-914d-7e52eb08dba3" (UID: "61556271-c6ea-4c09-914d-7e52eb08dba3"). InnerVolumeSpecName "kube-api-access-fdmm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:30:48.395075 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.395027 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61556271-c6ea-4c09-914d-7e52eb08dba3-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:30:48.395075 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.395075 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdmm6\" (UniqueName: \"kubernetes.io/projected/61556271-c6ea-4c09-914d-7e52eb08dba3-kube-api-access-fdmm6\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:30:48.395227 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.395086 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61556271-c6ea-4c09-914d-7e52eb08dba3-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:30:48.522205 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.522176 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x"] Jul 06 12:30:48.534616 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:48.534594 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-7a005a82-7cb577578d-6lt9x"] Jul 06 12:30:49.507676 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:30:49.507645 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61556271-c6ea-4c09-914d-7e52eb08dba3" path="/var/lib/kubelet/pods/61556271-c6ea-4c09-914d-7e52eb08dba3/volumes" Jul 06 12:32:39.848519 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:39.848483 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52"] Jul 06 12:32:39.848940 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:39.848840 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61556271-c6ea-4c09-914d-7e52eb08dba3" containerName="maas-api" Jul 06 12:32:39.848940 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:39.848852 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="61556271-c6ea-4c09-914d-7e52eb08dba3" containerName="maas-api" Jul 06 12:32:39.848940 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:39.848907 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="61556271-c6ea-4c09-914d-7e52eb08dba3" containerName="maas-api" Jul 06 12:32:39.851590 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:39.851574 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:39.855832 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:39.855811 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-5931b72e-serving-cert\"" Jul 06 12:32:39.874482 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:39.874462 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52"] Jul 06 12:32:39.919712 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:39.919690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dbfd149-a9c7-43ef-a627-bef5a9263f20-maas-api-tls\") pod \"maas-api-e2e-mt-5931b72e-77985b6d74-d5g52\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:39.919864 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:39.919737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbfd149-a9c7-43ef-a627-bef5a9263f20-openshift-service-ca\") pod \"maas-api-e2e-mt-5931b72e-77985b6d74-d5g52\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:39.919864 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:39.919770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/3dbfd149-a9c7-43ef-a627-bef5a9263f20-kube-api-access-fzz6t\") pod \"maas-api-e2e-mt-5931b72e-77985b6d74-d5g52\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:40.020142 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:40.020116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/3dbfd149-a9c7-43ef-a627-bef5a9263f20-kube-api-access-fzz6t\") pod \"maas-api-e2e-mt-5931b72e-77985b6d74-d5g52\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:40.020255 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:40.020175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dbfd149-a9c7-43ef-a627-bef5a9263f20-maas-api-tls\") pod \"maas-api-e2e-mt-5931b72e-77985b6d74-d5g52\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:40.020255 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:40.020224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbfd149-a9c7-43ef-a627-bef5a9263f20-openshift-service-ca\") pod \"maas-api-e2e-mt-5931b72e-77985b6d74-d5g52\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:40.020355 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:32:40.020336 2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-5931b72e-serving-cert: secret "maas-api-e2e-mt-5931b72e-serving-cert" not found Jul 06 12:32:40.020430 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:32:40.020419 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dbfd149-a9c7-43ef-a627-bef5a9263f20-maas-api-tls podName:3dbfd149-a9c7-43ef-a627-bef5a9263f20 nodeName:}" failed. No retries permitted until 2026-07-06 12:32:40.520395829 +0000 UTC m=+1685.621552049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3dbfd149-a9c7-43ef-a627-bef5a9263f20-maas-api-tls") pod "maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" (UID: "3dbfd149-a9c7-43ef-a627-bef5a9263f20") : secret "maas-api-e2e-mt-5931b72e-serving-cert" not found Jul 06 12:32:40.020864 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:40.020847 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbfd149-a9c7-43ef-a627-bef5a9263f20-openshift-service-ca\") pod \"maas-api-e2e-mt-5931b72e-77985b6d74-d5g52\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:40.031401 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:40.031371 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/3dbfd149-a9c7-43ef-a627-bef5a9263f20-kube-api-access-fzz6t\") pod \"maas-api-e2e-mt-5931b72e-77985b6d74-d5g52\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:40.523571 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:40.523531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dbfd149-a9c7-43ef-a627-bef5a9263f20-maas-api-tls\") pod \"maas-api-e2e-mt-5931b72e-77985b6d74-d5g52\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:40.526031 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:40.526005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dbfd149-a9c7-43ef-a627-bef5a9263f20-maas-api-tls\") pod \"maas-api-e2e-mt-5931b72e-77985b6d74-d5g52\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:40.762092 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:40.762058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:40.906769 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:40.906729 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52"] Jul 06 12:32:40.911110 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:32:40.911077 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dbfd149_a9c7_43ef_a627_bef5a9263f20.slice/crio-3d031f171408d4d466ee68265b5bc5c941adaee4c823412414cdc76c083208a7 WatchSource:0}: Error finding container 3d031f171408d4d466ee68265b5bc5c941adaee4c823412414cdc76c083208a7: Status 404 returned error can't find the container with id 3d031f171408d4d466ee68265b5bc5c941adaee4c823412414cdc76c083208a7 Jul 06 12:32:41.672875 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:41.672799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" event={"ID":"3dbfd149-a9c7-43ef-a627-bef5a9263f20","Type":"ContainerStarted","Data":"017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa"} Jul 06 12:32:41.672875 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:41.672852 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" event={"ID":"3dbfd149-a9c7-43ef-a627-bef5a9263f20","Type":"ContainerStarted","Data":"3d031f171408d4d466ee68265b5bc5c941adaee4c823412414cdc76c083208a7"} Jul 06 12:32:41.673073 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:41.672896 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:41.709865 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:41.709804 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" podStartSLOduration=2.267529173 podStartE2EDuration="2.709783609s" totalImagesPullingTime="442.254436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:32:41.707640713 +0000 UTC m=+1686.808796953" watchObservedRunningTime="2026-07-06 12:32:41.709783609 +0000 UTC m=+1686.810939852" Jul 06 12:32:47.682880 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:47.682851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:53.255748 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.255717 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52"] Jul 06 12:32:53.256206 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.255899 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" podUID="3dbfd149-a9c7-43ef-a627-bef5a9263f20" containerName="maas-api" containerID="cri-o://017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa" gracePeriod=30 Jul 06 12:32:53.498390 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.498364 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:53.629397 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.629329 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbfd149-a9c7-43ef-a627-bef5a9263f20-openshift-service-ca\") pod \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " Jul 06 12:32:53.629534 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.629396 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dbfd149-a9c7-43ef-a627-bef5a9263f20-maas-api-tls\") pod \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " Jul 06 12:32:53.629534 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.629418 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/3dbfd149-a9c7-43ef-a627-bef5a9263f20-kube-api-access-fzz6t\") pod \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\" (UID: \"3dbfd149-a9c7-43ef-a627-bef5a9263f20\") " Jul 06 12:32:53.629738 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.629711 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dbfd149-a9c7-43ef-a627-bef5a9263f20-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3dbfd149-a9c7-43ef-a627-bef5a9263f20" (UID: "3dbfd149-a9c7-43ef-a627-bef5a9263f20"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:32:53.631493 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.631470 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dbfd149-a9c7-43ef-a627-bef5a9263f20-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3dbfd149-a9c7-43ef-a627-bef5a9263f20" (UID: "3dbfd149-a9c7-43ef-a627-bef5a9263f20"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:32:53.631637 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.631614 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dbfd149-a9c7-43ef-a627-bef5a9263f20-kube-api-access-fzz6t" (OuterVolumeSpecName: "kube-api-access-fzz6t") pod "3dbfd149-a9c7-43ef-a627-bef5a9263f20" (UID: "3dbfd149-a9c7-43ef-a627-bef5a9263f20"). InnerVolumeSpecName "kube-api-access-fzz6t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:32:53.726522 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.726492 2576 generic.go:356] "Generic (PLEG): container finished" podID="3dbfd149-a9c7-43ef-a627-bef5a9263f20" containerID="017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa" exitCode=0 Jul 06 12:32:53.726636 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.726538 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" Jul 06 12:32:53.726636 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.726555 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" event={"ID":"3dbfd149-a9c7-43ef-a627-bef5a9263f20","Type":"ContainerDied","Data":"017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa"} Jul 06 12:32:53.726636 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.726606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52" event={"ID":"3dbfd149-a9c7-43ef-a627-bef5a9263f20","Type":"ContainerDied","Data":"3d031f171408d4d466ee68265b5bc5c941adaee4c823412414cdc76c083208a7"} Jul 06 12:32:53.726636 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.726634 2576 scope.go:117] "RemoveContainer" containerID="017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa" Jul 06 12:32:53.730014 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.729992 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbfd149-a9c7-43ef-a627-bef5a9263f20-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:32:53.730137 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.730018 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dbfd149-a9c7-43ef-a627-bef5a9263f20-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:32:53.730137 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.730032 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/3dbfd149-a9c7-43ef-a627-bef5a9263f20-kube-api-access-fzz6t\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:32:53.736052 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.735978 2576 scope.go:117] "RemoveContainer" containerID="017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa" Jul 06 12:32:53.736409 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:32:53.736387 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa\": container with ID starting with 017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa not found: ID does not exist" containerID="017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa" Jul 06 12:32:53.736517 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.736421 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa"} err="failed to get container status \"017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa\": rpc error: code = NotFound desc = could not find container \"017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa\": container with ID starting with 017dfb5e3b8f9dfe282b9a6f11c71201fd9c6ddf287766b7f36ce94e9c2fc3fa not found: ID does not exist" Jul 06 12:32:53.755064 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.754491 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52"] Jul 06 12:32:53.760308 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:53.760285 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-5931b72e-77985b6d74-d5g52"] Jul 06 12:32:55.507665 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:32:55.507628 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dbfd149-a9c7-43ef-a627-bef5a9263f20" path="/var/lib/kubelet/pods/3dbfd149-a9c7-43ef-a627-bef5a9263f20/volumes" Jul 06 12:33:24.988174 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:24.988144 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7"] Jul 06 12:33:24.988618 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:24.988495 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dbfd149-a9c7-43ef-a627-bef5a9263f20" containerName="maas-api" Jul 06 12:33:24.988618 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:24.988507 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dbfd149-a9c7-43ef-a627-bef5a9263f20" containerName="maas-api" Jul 06 12:33:24.988618 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:24.988561 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dbfd149-a9c7-43ef-a627-bef5a9263f20" containerName="maas-api" Jul 06 12:33:24.991169 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:24.991154 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:24.997432 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:24.997412 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-acc0dc0f-serving-cert\"" Jul 06 12:33:25.011476 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.011452 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7"] Jul 06 12:33:25.077720 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.077695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvltj\" (UniqueName: \"kubernetes.io/projected/55f230bb-5c02-4e1b-b992-f15f1a0a9316-kube-api-access-vvltj\") pod \"maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:25.077846 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.077807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f230bb-5c02-4e1b-b992-f15f1a0a9316-maas-api-tls\") pod \"maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:25.077888 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.077847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f230bb-5c02-4e1b-b992-f15f1a0a9316-openshift-service-ca\") pod \"maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:25.179033 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.179004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f230bb-5c02-4e1b-b992-f15f1a0a9316-openshift-service-ca\") pod \"maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:25.179203 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.179065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvltj\" (UniqueName: \"kubernetes.io/projected/55f230bb-5c02-4e1b-b992-f15f1a0a9316-kube-api-access-vvltj\") pod \"maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:25.179203 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.179127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f230bb-5c02-4e1b-b992-f15f1a0a9316-maas-api-tls\") pod \"maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:25.179677 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.179648 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f230bb-5c02-4e1b-b992-f15f1a0a9316-openshift-service-ca\") pod \"maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:25.181374 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.181354 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f230bb-5c02-4e1b-b992-f15f1a0a9316-maas-api-tls\") pod \"maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:25.191214 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.191188 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvltj\" (UniqueName: \"kubernetes.io/projected/55f230bb-5c02-4e1b-b992-f15f1a0a9316-kube-api-access-vvltj\") pod \"maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:25.300671 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.300611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:25.452776 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:33:25.452743 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f230bb_5c02_4e1b_b992_f15f1a0a9316.slice/crio-c719f97baad4f58cb0cf9e96085c5e42bd9a7273e306c3b9a2f0d6d6078ee166 WatchSource:0}: Error finding container c719f97baad4f58cb0cf9e96085c5e42bd9a7273e306c3b9a2f0d6d6078ee166: Status 404 returned error can't find the container with id c719f97baad4f58cb0cf9e96085c5e42bd9a7273e306c3b9a2f0d6d6078ee166 Jul 06 12:33:25.454150 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.454123 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7"] Jul 06 12:33:25.862515 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:25.862483 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" event={"ID":"55f230bb-5c02-4e1b-b992-f15f1a0a9316","Type":"ContainerStarted","Data":"c719f97baad4f58cb0cf9e96085c5e42bd9a7273e306c3b9a2f0d6d6078ee166"} Jul 06 12:33:26.868154 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:26.868116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" event={"ID":"55f230bb-5c02-4e1b-b992-f15f1a0a9316","Type":"ContainerStarted","Data":"00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5"} Jul 06 12:33:26.868576 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:26.868202 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:32.878687 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:32.878657 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:32.907430 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:32.907382 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" podStartSLOduration=8.434849995 podStartE2EDuration="8.907367696s" totalImagesPullingTime="472.517701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:33:26.910575169 +0000 UTC m=+1732.011731411" watchObservedRunningTime="2026-07-06 12:33:32.907367696 +0000 UTC m=+1738.008523939" Jul 06 12:33:57.177348 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.177318 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7"] Jul 06 12:33:57.177906 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.177497 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" podUID="55f230bb-5c02-4e1b-b992-f15f1a0a9316" containerName="maas-api" containerID="cri-o://00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5" gracePeriod=30 Jul 06 12:33:57.414904 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.414880 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:57.528936 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.528911 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f230bb-5c02-4e1b-b992-f15f1a0a9316-openshift-service-ca\") pod \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " Jul 06 12:33:57.529091 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.528944 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvltj\" (UniqueName: \"kubernetes.io/projected/55f230bb-5c02-4e1b-b992-f15f1a0a9316-kube-api-access-vvltj\") pod \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " Jul 06 12:33:57.529091 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.528989 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f230bb-5c02-4e1b-b992-f15f1a0a9316-maas-api-tls\") pod \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\" (UID: \"55f230bb-5c02-4e1b-b992-f15f1a0a9316\") " Jul 06 12:33:57.529280 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.529260 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55f230bb-5c02-4e1b-b992-f15f1a0a9316-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55f230bb-5c02-4e1b-b992-f15f1a0a9316" (UID: "55f230bb-5c02-4e1b-b992-f15f1a0a9316"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:33:57.530867 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.530845 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55f230bb-5c02-4e1b-b992-f15f1a0a9316-kube-api-access-vvltj" (OuterVolumeSpecName: "kube-api-access-vvltj") pod "55f230bb-5c02-4e1b-b992-f15f1a0a9316" (UID: "55f230bb-5c02-4e1b-b992-f15f1a0a9316"). InnerVolumeSpecName "kube-api-access-vvltj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:33:57.531016 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.530996 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55f230bb-5c02-4e1b-b992-f15f1a0a9316-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55f230bb-5c02-4e1b-b992-f15f1a0a9316" (UID: "55f230bb-5c02-4e1b-b992-f15f1a0a9316"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:33:57.629805 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.629784 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f230bb-5c02-4e1b-b992-f15f1a0a9316-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:33:57.629805 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.629805 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvltj\" (UniqueName: \"kubernetes.io/projected/55f230bb-5c02-4e1b-b992-f15f1a0a9316-kube-api-access-vvltj\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:33:57.629953 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:57.629814 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f230bb-5c02-4e1b-b992-f15f1a0a9316-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:33:58.007013 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:58.006977 2576 generic.go:356] "Generic (PLEG): container finished" podID="55f230bb-5c02-4e1b-b992-f15f1a0a9316" containerID="00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5" exitCode=0 Jul 06 12:33:58.007194 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:58.007035 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" Jul 06 12:33:58.007194 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:58.007066 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" event={"ID":"55f230bb-5c02-4e1b-b992-f15f1a0a9316","Type":"ContainerDied","Data":"00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5"} Jul 06 12:33:58.007194 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:58.007145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7" event={"ID":"55f230bb-5c02-4e1b-b992-f15f1a0a9316","Type":"ContainerDied","Data":"c719f97baad4f58cb0cf9e96085c5e42bd9a7273e306c3b9a2f0d6d6078ee166"} Jul 06 12:33:58.007194 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:58.007168 2576 scope.go:117] "RemoveContainer" containerID="00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5" Jul 06 12:33:58.016335 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:58.016317 2576 scope.go:117] "RemoveContainer" containerID="00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5" Jul 06 12:33:58.016561 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:33:58.016547 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5\": container with ID starting with 00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5 not found: ID does not exist" containerID="00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5" Jul 06 12:33:58.016648 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:58.016567 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5"} err="failed to get container status \"00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5\": rpc error: code = NotFound desc = could not find container \"00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5\": container with ID starting with 00c824b55655263b045a3611f1af9f69b9e30ded32184d3de4f91837208737d5 not found: ID does not exist" Jul 06 12:33:58.031464 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:58.031442 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7"] Jul 06 12:33:58.034125 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:58.034107 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-acc0dc0f-7f97fb7686-wmkp7"] Jul 06 12:33:59.507322 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:33:59.507288 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55f230bb-5c02-4e1b-b992-f15f1a0a9316" path="/var/lib/kubelet/pods/55f230bb-5c02-4e1b-b992-f15f1a0a9316/volumes" Jul 06 12:35:54.816234 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.816200 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk"] Jul 06 12:35:54.816694 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.816548 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55f230bb-5c02-4e1b-b992-f15f1a0a9316" containerName="maas-api" Jul 06 12:35:54.816694 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.816561 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="55f230bb-5c02-4e1b-b992-f15f1a0a9316" containerName="maas-api" Jul 06 12:35:54.816694 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.816649 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="55f230bb-5c02-4e1b-b992-f15f1a0a9316" containerName="maas-api" Jul 06 12:35:54.819696 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.819678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:54.822173 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.822153 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-91636e-serving-cert\"" Jul 06 12:35:54.831323 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.831303 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk"] Jul 06 12:35:54.866780 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.866755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25t42\" (UniqueName: \"kubernetes.io/projected/65c2912c-8509-433a-848a-3392c3fb270d-kube-api-access-25t42\") pod \"maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:54.866878 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.866785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c2912c-8509-433a-848a-3392c3fb270d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:54.866878 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.866868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65c2912c-8509-433a-848a-3392c3fb270d-maas-api-tls\") pod \"maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:54.967869 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.967833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25t42\" (UniqueName: \"kubernetes.io/projected/65c2912c-8509-433a-848a-3392c3fb270d-kube-api-access-25t42\") pod \"maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:54.967869 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.967874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c2912c-8509-433a-848a-3392c3fb270d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:54.968067 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.967922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65c2912c-8509-433a-848a-3392c3fb270d-maas-api-tls\") pod \"maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:54.968124 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:35:54.968109 2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-91636e-serving-cert: secret "maas-api-e2e-inf-a-91636e-serving-cert" not found Jul 06 12:35:54.968188 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:35:54.968179 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c2912c-8509-433a-848a-3392c3fb270d-maas-api-tls podName:65c2912c-8509-433a-848a-3392c3fb270d nodeName:}" failed. No retries permitted until 2026-07-06 12:35:55.468156244 +0000 UTC m=+1880.569312467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/65c2912c-8509-433a-848a-3392c3fb270d-maas-api-tls") pod "maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" (UID: "65c2912c-8509-433a-848a-3392c3fb270d") : secret "maas-api-e2e-inf-a-91636e-serving-cert" not found Jul 06 12:35:54.968626 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.968606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c2912c-8509-433a-848a-3392c3fb270d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:54.978273 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:54.978253 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25t42\" (UniqueName: \"kubernetes.io/projected/65c2912c-8509-433a-848a-3392c3fb270d-kube-api-access-25t42\") pod \"maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:55.471684 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:55.471652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65c2912c-8509-433a-848a-3392c3fb270d-maas-api-tls\") pod \"maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:55.473996 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:55.473973 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65c2912c-8509-433a-848a-3392c3fb270d-maas-api-tls\") pod \"maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:55.730974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:55.730896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:55.872177 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:55.872151 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk"] Jul 06 12:35:55.873466 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:35:55.873419 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c2912c_8509_433a_848a_3392c3fb270d.slice/crio-c6727ff31c0b4fc122f03ef105a4cc9208e40189d779467d88fb787c9a145292 WatchSource:0}: Error finding container c6727ff31c0b4fc122f03ef105a4cc9208e40189d779467d88fb787c9a145292: Status 404 returned error can't find the container with id c6727ff31c0b4fc122f03ef105a4cc9208e40189d779467d88fb787c9a145292 Jul 06 12:35:55.874893 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:55.874870 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 12:35:56.511021 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:56.510979 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" event={"ID":"65c2912c-8509-433a-848a-3392c3fb270d","Type":"ContainerStarted","Data":"7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6"} Jul 06 12:35:56.511212 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:56.511052 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:35:56.511212 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:56.511071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" event={"ID":"65c2912c-8509-433a-848a-3392c3fb270d","Type":"ContainerStarted","Data":"c6727ff31c0b4fc122f03ef105a4cc9208e40189d779467d88fb787c9a145292"} Jul 06 12:35:56.544451 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:35:56.544400 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" podStartSLOduration=2.11584392 podStartE2EDuration="2.54438658s" totalImagesPullingTime="428.54266ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:35:56.544338501 +0000 UTC m=+1881.645494748" watchObservedRunningTime="2026-07-06 12:35:56.54438658 +0000 UTC m=+1881.645542821" Jul 06 12:36:02.520683 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:02.520610 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:36:02.952504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:02.952431 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb"] Jul 06 12:36:02.955891 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:02.955874 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:02.958551 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:02.958525 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-77bda8-serving-cert\"" Jul 06 12:36:02.971619 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:02.971585 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb"] Jul 06 12:36:03.032241 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.032213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-maas-api-tls\") pod \"maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:03.032349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.032280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:03.032349 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.032306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb5gh\" (UniqueName: \"kubernetes.io/projected/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-kube-api-access-kb5gh\") pod \"maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:03.132795 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.132770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:03.132921 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.132804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb5gh\" (UniqueName: \"kubernetes.io/projected/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-kube-api-access-kb5gh\") pod \"maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:03.132921 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.132861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-maas-api-tls\") pod \"maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:03.133433 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.133414 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:03.135218 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.135198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-maas-api-tls\") pod \"maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:03.149495 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.149468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb5gh\" (UniqueName: \"kubernetes.io/projected/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-kube-api-access-kb5gh\") pod \"maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:03.266557 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.266523 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:03.409496 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.409469 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb"] Jul 06 12:36:03.411833 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:36:03.411799 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fec8ef7_dd43_4762_8d9b_3a2f5da5c3fd.slice/crio-62c23631961d2e11f250afd60266657a611503f7517b0835061c0f8401b7b9f3 WatchSource:0}: Error finding container 62c23631961d2e11f250afd60266657a611503f7517b0835061c0f8401b7b9f3: Status 404 returned error can't find the container with id 62c23631961d2e11f250afd60266657a611503f7517b0835061c0f8401b7b9f3 Jul 06 12:36:03.540486 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:03.540418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" event={"ID":"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd","Type":"ContainerStarted","Data":"62c23631961d2e11f250afd60266657a611503f7517b0835061c0f8401b7b9f3"} Jul 06 12:36:04.546275 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:04.546196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" event={"ID":"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd","Type":"ContainerStarted","Data":"45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629"} Jul 06 12:36:04.546275 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:04.546253 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:10.556298 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:10.556270 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:36:10.594751 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:36:10.594697 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" podStartSLOduration=7.787753161 podStartE2EDuration="8.594679821s" totalImagesPullingTime="806.92666ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:36:04.574403838 +0000 UTC m=+1889.675560104" watchObservedRunningTime="2026-07-06 12:36:10.594679821 +0000 UTC m=+1895.695836063" Jul 06 12:37:05.209528 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.209496 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr"] Jul 06 12:37:05.212996 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.212980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:05.221410 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.221386 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-reuse-f7711f-serving-cert\"" Jul 06 12:37:05.232969 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.232946 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr"] Jul 06 12:37:05.340023 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.339990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/241dde31-25ea-4dbc-af00-ac5b5578aa66-maas-api-tls\") pod \"maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:05.340196 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.340036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/241dde31-25ea-4dbc-af00-ac5b5578aa66-openshift-service-ca\") pod \"maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:05.340196 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.340143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmgnm\" (UniqueName: \"kubernetes.io/projected/241dde31-25ea-4dbc-af00-ac5b5578aa66-kube-api-access-bmgnm\") pod \"maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:05.441257 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.441227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmgnm\" (UniqueName: \"kubernetes.io/projected/241dde31-25ea-4dbc-af00-ac5b5578aa66-kube-api-access-bmgnm\") pod \"maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:05.441432 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.441298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/241dde31-25ea-4dbc-af00-ac5b5578aa66-maas-api-tls\") pod \"maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:05.441432 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.441334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/241dde31-25ea-4dbc-af00-ac5b5578aa66-openshift-service-ca\") pod \"maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:05.442061 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.442022 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/241dde31-25ea-4dbc-af00-ac5b5578aa66-openshift-service-ca\") pod \"maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:05.443869 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.443847 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/241dde31-25ea-4dbc-af00-ac5b5578aa66-maas-api-tls\") pod \"maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:05.452682 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.452659 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmgnm\" (UniqueName: \"kubernetes.io/projected/241dde31-25ea-4dbc-af00-ac5b5578aa66-kube-api-access-bmgnm\") pod \"maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:05.522594 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.522572 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:05.661400 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.661371 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr"] Jul 06 12:37:05.664735 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:37:05.664706 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241dde31_25ea_4dbc_af00_ac5b5578aa66.slice/crio-87cc085b98ac4e685af37ea4deadb3ba278a9ff43bb2add1e2202220975746de WatchSource:0}: Error finding container 87cc085b98ac4e685af37ea4deadb3ba278a9ff43bb2add1e2202220975746de: Status 404 returned error can't find the container with id 87cc085b98ac4e685af37ea4deadb3ba278a9ff43bb2add1e2202220975746de Jul 06 12:37:05.811628 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:05.811554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" event={"ID":"241dde31-25ea-4dbc-af00-ac5b5578aa66","Type":"ContainerStarted","Data":"87cc085b98ac4e685af37ea4deadb3ba278a9ff43bb2add1e2202220975746de"} Jul 06 12:37:06.823516 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:06.823475 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" event={"ID":"241dde31-25ea-4dbc-af00-ac5b5578aa66","Type":"ContainerStarted","Data":"4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941"} Jul 06 12:37:06.823900 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:06.823663 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:06.885187 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:06.885141 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" podStartSLOduration=1.491969941 podStartE2EDuration="1.885127934s" totalImagesPullingTime="393.157993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:37:06.882388374 +0000 UTC m=+1951.983544617" watchObservedRunningTime="2026-07-06 12:37:06.885127934 +0000 UTC m=+1951.986284176" Jul 06 12:37:12.832954 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:12.832924 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:42.168140 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.168063 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr"] Jul 06 12:37:42.168646 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.168276 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" podUID="241dde31-25ea-4dbc-af00-ac5b5578aa66" containerName="maas-api" containerID="cri-o://4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941" gracePeriod=30 Jul 06 12:37:42.421912 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.421851 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:42.550299 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.550273 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/241dde31-25ea-4dbc-af00-ac5b5578aa66-maas-api-tls\") pod \"241dde31-25ea-4dbc-af00-ac5b5578aa66\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " Jul 06 12:37:42.550455 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.550327 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/241dde31-25ea-4dbc-af00-ac5b5578aa66-openshift-service-ca\") pod \"241dde31-25ea-4dbc-af00-ac5b5578aa66\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " Jul 06 12:37:42.550455 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.550374 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmgnm\" (UniqueName: \"kubernetes.io/projected/241dde31-25ea-4dbc-af00-ac5b5578aa66-kube-api-access-bmgnm\") pod \"241dde31-25ea-4dbc-af00-ac5b5578aa66\" (UID: \"241dde31-25ea-4dbc-af00-ac5b5578aa66\") " Jul 06 12:37:42.550747 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.550708 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/241dde31-25ea-4dbc-af00-ac5b5578aa66-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "241dde31-25ea-4dbc-af00-ac5b5578aa66" (UID: "241dde31-25ea-4dbc-af00-ac5b5578aa66"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:37:42.552331 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.552300 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/241dde31-25ea-4dbc-af00-ac5b5578aa66-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "241dde31-25ea-4dbc-af00-ac5b5578aa66" (UID: "241dde31-25ea-4dbc-af00-ac5b5578aa66"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:37:42.552514 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.552488 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/241dde31-25ea-4dbc-af00-ac5b5578aa66-kube-api-access-bmgnm" (OuterVolumeSpecName: "kube-api-access-bmgnm") pod "241dde31-25ea-4dbc-af00-ac5b5578aa66" (UID: "241dde31-25ea-4dbc-af00-ac5b5578aa66"). InnerVolumeSpecName "kube-api-access-bmgnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:37:42.650952 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.650925 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/241dde31-25ea-4dbc-af00-ac5b5578aa66-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:37:42.650952 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.650947 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmgnm\" (UniqueName: \"kubernetes.io/projected/241dde31-25ea-4dbc-af00-ac5b5578aa66-kube-api-access-bmgnm\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:37:42.650952 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.650956 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/241dde31-25ea-4dbc-af00-ac5b5578aa66-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:37:42.982124 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.982086 2576 generic.go:356] "Generic (PLEG): container finished" podID="241dde31-25ea-4dbc-af00-ac5b5578aa66" containerID="4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941" exitCode=0 Jul 06 12:37:42.982294 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.982132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" event={"ID":"241dde31-25ea-4dbc-af00-ac5b5578aa66","Type":"ContainerDied","Data":"4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941"} Jul 06 12:37:42.982294 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.982173 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" event={"ID":"241dde31-25ea-4dbc-af00-ac5b5578aa66","Type":"ContainerDied","Data":"87cc085b98ac4e685af37ea4deadb3ba278a9ff43bb2add1e2202220975746de"} Jul 06 12:37:42.982294 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.982197 2576 scope.go:117] "RemoveContainer" containerID="4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941" Jul 06 12:37:42.982294 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.982138 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr" Jul 06 12:37:42.990790 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.990772 2576 scope.go:117] "RemoveContainer" containerID="4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941" Jul 06 12:37:42.991051 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:37:42.991015 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941\": container with ID starting with 4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941 not found: ID does not exist" containerID="4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941" Jul 06 12:37:42.991104 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:42.991067 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941"} err="failed to get container status \"4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941\": rpc error: code = NotFound desc = could not find container \"4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941\": container with ID starting with 4314af2699ba795f8ae6fbf675620e06d2ae51b66b80b94e1faac8899af99941 not found: ID does not exist" Jul 06 12:37:43.024905 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:43.024883 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr"] Jul 06 12:37:43.048648 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:43.048627 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-reuse-f7711f-56f7fb6859-qb4fr"] Jul 06 12:37:43.508022 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:37:43.507990 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241dde31-25ea-4dbc-af00-ac5b5578aa66" path="/var/lib/kubelet/pods/241dde31-25ea-4dbc-af00-ac5b5578aa66/volumes" Jul 06 12:38:35.433094 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.433054 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk"] Jul 06 12:38:35.433512 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.433286 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" podUID="65c2912c-8509-433a-848a-3392c3fb270d" containerName="maas-api" containerID="cri-o://7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6" gracePeriod=30 Jul 06 12:38:35.686745 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.686682 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:38:35.792899 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.792871 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65c2912c-8509-433a-848a-3392c3fb270d-maas-api-tls\") pod \"65c2912c-8509-433a-848a-3392c3fb270d\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " Jul 06 12:38:35.793082 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.792959 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25t42\" (UniqueName: \"kubernetes.io/projected/65c2912c-8509-433a-848a-3392c3fb270d-kube-api-access-25t42\") pod \"65c2912c-8509-433a-848a-3392c3fb270d\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " Jul 06 12:38:35.793082 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.792976 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c2912c-8509-433a-848a-3392c3fb270d-openshift-service-ca\") pod \"65c2912c-8509-433a-848a-3392c3fb270d\" (UID: \"65c2912c-8509-433a-848a-3392c3fb270d\") " Jul 06 12:38:35.793339 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.793319 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65c2912c-8509-433a-848a-3392c3fb270d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65c2912c-8509-433a-848a-3392c3fb270d" (UID: "65c2912c-8509-433a-848a-3392c3fb270d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:38:35.794709 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.794681 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65c2912c-8509-433a-848a-3392c3fb270d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65c2912c-8509-433a-848a-3392c3fb270d" (UID: "65c2912c-8509-433a-848a-3392c3fb270d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:38:35.794876 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.794855 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65c2912c-8509-433a-848a-3392c3fb270d-kube-api-access-25t42" (OuterVolumeSpecName: "kube-api-access-25t42") pod "65c2912c-8509-433a-848a-3392c3fb270d" (UID: "65c2912c-8509-433a-848a-3392c3fb270d"). InnerVolumeSpecName "kube-api-access-25t42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:38:35.894379 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.894352 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25t42\" (UniqueName: \"kubernetes.io/projected/65c2912c-8509-433a-848a-3392c3fb270d-kube-api-access-25t42\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:38:35.894379 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.894373 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c2912c-8509-433a-848a-3392c3fb270d-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:38:35.894379 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:35.894383 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65c2912c-8509-433a-848a-3392c3fb270d-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:38:36.211606 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:36.211578 2576 generic.go:356] "Generic (PLEG): container finished" podID="65c2912c-8509-433a-848a-3392c3fb270d" containerID="7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6" exitCode=0 Jul 06 12:38:36.211755 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:36.211629 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" Jul 06 12:38:36.211755 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:36.211643 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" event={"ID":"65c2912c-8509-433a-848a-3392c3fb270d","Type":"ContainerDied","Data":"7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6"} Jul 06 12:38:36.211755 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:36.211684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk" event={"ID":"65c2912c-8509-433a-848a-3392c3fb270d","Type":"ContainerDied","Data":"c6727ff31c0b4fc122f03ef105a4cc9208e40189d779467d88fb787c9a145292"} Jul 06 12:38:36.211755 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:36.211706 2576 scope.go:117] "RemoveContainer" containerID="7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6" Jul 06 12:38:36.220525 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:36.220509 2576 scope.go:117] "RemoveContainer" containerID="7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6" Jul 06 12:38:36.220762 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:38:36.220742 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6\": container with ID starting with 7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6 not found: ID does not exist" containerID="7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6" Jul 06 12:38:36.220814 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:36.220770 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6"} err="failed to get container status \"7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6\": rpc error: code = NotFound desc = could not find container \"7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6\": container with ID starting with 7a70132a962790a38186d7bf74da17651b4a8122ef229f66985ed7e6a82235a6 not found: ID does not exist" Jul 06 12:38:36.234169 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:36.234147 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk"] Jul 06 12:38:36.238142 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:36.238122 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-91636e-6dcc869546-d2cjk"] Jul 06 12:38:37.506846 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:38:37.506813 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65c2912c-8509-433a-848a-3392c3fb270d" path="/var/lib/kubelet/pods/65c2912c-8509-433a-848a-3392c3fb270d/volumes" Jul 06 12:39:20.855755 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:20.855723 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb"] Jul 06 12:39:20.856222 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:20.855931 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" podUID="9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd" containerName="maas-api" containerID="cri-o://45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629" gracePeriod=30 Jul 06 12:39:21.103278 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.103255 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:39:21.268523 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.268491 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb5gh\" (UniqueName: \"kubernetes.io/projected/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-kube-api-access-kb5gh\") pod \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " Jul 06 12:39:21.268663 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.268530 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-maas-api-tls\") pod \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " Jul 06 12:39:21.268663 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.268555 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-openshift-service-ca\") pod \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\" (UID: \"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd\") " Jul 06 12:39:21.268962 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.268934 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd" (UID: "9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:39:21.270564 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.270536 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-kube-api-access-kb5gh" (OuterVolumeSpecName: "kube-api-access-kb5gh") pod "9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd" (UID: "9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd"). InnerVolumeSpecName "kube-api-access-kb5gh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:39:21.270645 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.270571 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd" (UID: "9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:39:21.369821 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.369794 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb5gh\" (UniqueName: \"kubernetes.io/projected/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-kube-api-access-kb5gh\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:39:21.369821 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.369816 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:39:21.369821 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.369826 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:39:21.406987 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.406957 2576 generic.go:356] "Generic (PLEG): container finished" podID="9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd" containerID="45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629" exitCode=0 Jul 06 12:39:21.407138 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.406999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" event={"ID":"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd","Type":"ContainerDied","Data":"45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629"} Jul 06 12:39:21.407138 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.407009 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" Jul 06 12:39:21.407138 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.407034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb" event={"ID":"9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd","Type":"ContainerDied","Data":"62c23631961d2e11f250afd60266657a611503f7517b0835061c0f8401b7b9f3"} Jul 06 12:39:21.407138 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.407073 2576 scope.go:117] "RemoveContainer" containerID="45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629" Jul 06 12:39:21.415236 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.415219 2576 scope.go:117] "RemoveContainer" containerID="45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629" Jul 06 12:39:21.415487 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:39:21.415469 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629\": container with ID starting with 45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629 not found: ID does not exist" containerID="45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629" Jul 06 12:39:21.415539 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.415496 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629"} err="failed to get container status \"45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629\": rpc error: code = NotFound desc = could not find container \"45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629\": container with ID starting with 45a7a7148f483f0d02b53971558c559f2bc017b46874fd19f4a812d86d88d629 not found: ID does not exist" Jul 06 12:39:21.433517 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.433495 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb"] Jul 06 12:39:21.443332 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.443313 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-77bda8-7488f6956-nr7zb"] Jul 06 12:39:21.506616 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:21.506582 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd" path="/var/lib/kubelet/pods/9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd/volumes" Jul 06 12:39:31.249599 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.249561 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr"] Jul 06 12:39:31.250099 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.250081 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c2912c-8509-433a-848a-3392c3fb270d" containerName="maas-api" Jul 06 12:39:31.250152 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.250103 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c2912c-8509-433a-848a-3392c3fb270d" containerName="maas-api" Jul 06 12:39:31.250152 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.250131 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241dde31-25ea-4dbc-af00-ac5b5578aa66" containerName="maas-api" Jul 06 12:39:31.250152 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.250140 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="241dde31-25ea-4dbc-af00-ac5b5578aa66" containerName="maas-api" Jul 06 12:39:31.250272 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.250168 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd" containerName="maas-api" Jul 06 12:39:31.250272 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.250177 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd" containerName="maas-api" Jul 06 12:39:31.250272 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.250265 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="241dde31-25ea-4dbc-af00-ac5b5578aa66" containerName="maas-api" Jul 06 12:39:31.250399 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.250280 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fec8ef7-dd43-4762-8d9b-3a2f5da5c3fd" containerName="maas-api" Jul 06 12:39:31.250399 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.250290 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="65c2912c-8509-433a-848a-3392c3fb270d" containerName="maas-api" Jul 06 12:39:31.255114 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.255090 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:31.259408 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.259386 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-e65f56-serving-cert\"" Jul 06 12:39:31.274967 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.274942 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr"] Jul 06 12:39:31.347437 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.347414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnmmq\" (UniqueName: \"kubernetes.io/projected/01ee8415-096e-4e75-a448-76df8135d1e4-kube-api-access-xnmmq\") pod \"maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:31.347568 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.347462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ee8415-096e-4e75-a448-76df8135d1e4-maas-api-tls\") pod \"maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:31.347568 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.347549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ee8415-096e-4e75-a448-76df8135d1e4-openshift-service-ca\") pod \"maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:31.448553 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.448526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnmmq\" (UniqueName: \"kubernetes.io/projected/01ee8415-096e-4e75-a448-76df8135d1e4-kube-api-access-xnmmq\") pod \"maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:31.448690 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.448577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ee8415-096e-4e75-a448-76df8135d1e4-maas-api-tls\") pod \"maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:31.448690 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.448628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ee8415-096e-4e75-a448-76df8135d1e4-openshift-service-ca\") pod \"maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:31.449319 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.449301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ee8415-096e-4e75-a448-76df8135d1e4-openshift-service-ca\") pod \"maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:31.451091 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.451063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ee8415-096e-4e75-a448-76df8135d1e4-maas-api-tls\") pod \"maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:31.476433 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.476406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnmmq\" (UniqueName: \"kubernetes.io/projected/01ee8415-096e-4e75-a448-76df8135d1e4-kube-api-access-xnmmq\") pod \"maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:31.567482 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.567416 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:31.727269 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:31.727247 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr"] Jul 06 12:39:31.728910 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:39:31.728885 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ee8415_096e_4e75_a448_76df8135d1e4.slice/crio-2a260fb6bad7a591455b962c57beb239839fcad38f291fc8a03ca33dc981be24 WatchSource:0}: Error finding container 2a260fb6bad7a591455b962c57beb239839fcad38f291fc8a03ca33dc981be24: Status 404 returned error can't find the container with id 2a260fb6bad7a591455b962c57beb239839fcad38f291fc8a03ca33dc981be24 Jul 06 12:39:32.460616 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:32.460582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" event={"ID":"01ee8415-096e-4e75-a448-76df8135d1e4","Type":"ContainerStarted","Data":"1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada"} Jul 06 12:39:32.460949 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:32.460640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" event={"ID":"01ee8415-096e-4e75-a448-76df8135d1e4","Type":"ContainerStarted","Data":"2a260fb6bad7a591455b962c57beb239839fcad38f291fc8a03ca33dc981be24"} Jul 06 12:39:32.460949 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:32.460687 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:32.486461 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:32.486419 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" podStartSLOduration=0.912749609 podStartE2EDuration="1.486404893s" totalImagesPullingTime="573.655284ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:39:32.485611596 +0000 UTC m=+2097.586767850" watchObservedRunningTime="2026-07-06 12:39:32.486404893 +0000 UTC m=+2097.587561134" Jul 06 12:39:38.470160 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:38.470125 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:40.163455 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.163420 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq"] Jul 06 12:39:40.166589 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.166574 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:40.169930 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.169907 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-e76514-serving-cert\"" Jul 06 12:39:40.188709 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.188687 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq"] Jul 06 12:39:40.218404 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.218382 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cdd92c-0a88-4a61-8b95-43b277b382b9-maas-api-tls\") pod \"maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:40.218547 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.218457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cdd92c-0a88-4a61-8b95-43b277b382b9-openshift-service-ca\") pod \"maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:40.218547 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.218513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljsc\" (UniqueName: \"kubernetes.io/projected/f7cdd92c-0a88-4a61-8b95-43b277b382b9-kube-api-access-jljsc\") pod \"maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:40.319442 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.319417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cdd92c-0a88-4a61-8b95-43b277b382b9-openshift-service-ca\") pod \"maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:40.319615 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.319469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jljsc\" (UniqueName: \"kubernetes.io/projected/f7cdd92c-0a88-4a61-8b95-43b277b382b9-kube-api-access-jljsc\") pod \"maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:40.319684 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.319635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cdd92c-0a88-4a61-8b95-43b277b382b9-maas-api-tls\") pod \"maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:40.319748 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:39:40.319730 2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-e76514-serving-cert: secret "maas-api-e2e-api-b-e76514-serving-cert" not found Jul 06 12:39:40.320185 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:39:40.320162 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7cdd92c-0a88-4a61-8b95-43b277b382b9-maas-api-tls podName:f7cdd92c-0a88-4a61-8b95-43b277b382b9 nodeName:}" failed. No retries permitted until 2026-07-06 12:39:40.819992856 +0000 UTC m=+2105.921149080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f7cdd92c-0a88-4a61-8b95-43b277b382b9-maas-api-tls") pod "maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" (UID: "f7cdd92c-0a88-4a61-8b95-43b277b382b9") : secret "maas-api-e2e-api-b-e76514-serving-cert" not found Jul 06 12:39:40.320787 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.320760 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cdd92c-0a88-4a61-8b95-43b277b382b9-openshift-service-ca\") pod \"maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:40.330197 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.330171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljsc\" (UniqueName: \"kubernetes.io/projected/f7cdd92c-0a88-4a61-8b95-43b277b382b9-kube-api-access-jljsc\") pod \"maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:40.824357 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.824321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cdd92c-0a88-4a61-8b95-43b277b382b9-maas-api-tls\") pod \"maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:40.826601 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:40.826574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cdd92c-0a88-4a61-8b95-43b277b382b9-maas-api-tls\") pod \"maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:41.078298 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:41.078223 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:41.219944 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:41.219829 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq"] Jul 06 12:39:41.222803 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:39:41.222771 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cdd92c_0a88_4a61_8b95_43b277b382b9.slice/crio-bac9c8468c1f5ea92a5463fd78a106d9eb7f2d48c471899344ed183543279c55 WatchSource:0}: Error finding container bac9c8468c1f5ea92a5463fd78a106d9eb7f2d48c471899344ed183543279c55: Status 404 returned error can't find the container with id bac9c8468c1f5ea92a5463fd78a106d9eb7f2d48c471899344ed183543279c55 Jul 06 12:39:41.500629 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:41.500594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" event={"ID":"f7cdd92c-0a88-4a61-8b95-43b277b382b9","Type":"ContainerStarted","Data":"bac9c8468c1f5ea92a5463fd78a106d9eb7f2d48c471899344ed183543279c55"} Jul 06 12:39:42.506580 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:42.506548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" event={"ID":"f7cdd92c-0a88-4a61-8b95-43b277b382b9","Type":"ContainerStarted","Data":"b309c3a770c54146c17538750154a2b44d2c04a80083b51a25c0a35335f3264d"} Jul 06 12:39:42.506998 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:42.506681 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:42.529839 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:42.529792 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" podStartSLOduration=2.160795844 podStartE2EDuration="2.529778365s" totalImagesPullingTime="368.982521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:39:42.527454998 +0000 UTC m=+2107.628611240" watchObservedRunningTime="2026-07-06 12:39:42.529778365 +0000 UTC m=+2107.630934608" Jul 06 12:39:48.515736 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:48.515710 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:39:53.279940 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.279910 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr"] Jul 06 12:39:53.280363 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.280162 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" podUID="01ee8415-096e-4e75-a448-76df8135d1e4" containerName="maas-api" containerID="cri-o://1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada" gracePeriod=30 Jul 06 12:39:53.527989 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.527963 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:53.554278 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.554201 2576 generic.go:356] "Generic (PLEG): container finished" podID="01ee8415-096e-4e75-a448-76df8135d1e4" containerID="1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada" exitCode=0 Jul 06 12:39:53.554278 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.554240 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" Jul 06 12:39:53.554460 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.554282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" event={"ID":"01ee8415-096e-4e75-a448-76df8135d1e4","Type":"ContainerDied","Data":"1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada"} Jul 06 12:39:53.554460 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.554350 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" event={"ID":"01ee8415-096e-4e75-a448-76df8135d1e4","Type":"ContainerDied","Data":"2a260fb6bad7a591455b962c57beb239839fcad38f291fc8a03ca33dc981be24"} Jul 06 12:39:53.554460 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.554384 2576 scope.go:117] "RemoveContainer" containerID="1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada" Jul 06 12:39:53.562662 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.562645 2576 scope.go:117] "RemoveContainer" containerID="1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada" Jul 06 12:39:53.562910 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:39:53.562889 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada\": container with ID starting with 1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada not found: ID does not exist" containerID="1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada" Jul 06 12:39:53.562988 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.562917 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada"} err="failed to get container status \"1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada\": rpc error: code = NotFound desc = could not find container \"1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada\": container with ID starting with 1dc01da12574fa3e72229182961e36d8cb0f1ed2a521faadf865f4bab7a97ada not found: ID does not exist" Jul 06 12:39:53.626430 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.626406 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ee8415-096e-4e75-a448-76df8135d1e4-openshift-service-ca\") pod \"01ee8415-096e-4e75-a448-76df8135d1e4\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " Jul 06 12:39:53.626545 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.626468 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ee8415-096e-4e75-a448-76df8135d1e4-maas-api-tls\") pod \"01ee8415-096e-4e75-a448-76df8135d1e4\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " Jul 06 12:39:53.626545 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.626498 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnmmq\" (UniqueName: \"kubernetes.io/projected/01ee8415-096e-4e75-a448-76df8135d1e4-kube-api-access-xnmmq\") pod \"01ee8415-096e-4e75-a448-76df8135d1e4\" (UID: \"01ee8415-096e-4e75-a448-76df8135d1e4\") " Jul 06 12:39:53.626829 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.626805 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ee8415-096e-4e75-a448-76df8135d1e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01ee8415-096e-4e75-a448-76df8135d1e4" (UID: "01ee8415-096e-4e75-a448-76df8135d1e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:39:53.628474 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.628451 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ee8415-096e-4e75-a448-76df8135d1e4-kube-api-access-xnmmq" (OuterVolumeSpecName: "kube-api-access-xnmmq") pod "01ee8415-096e-4e75-a448-76df8135d1e4" (UID: "01ee8415-096e-4e75-a448-76df8135d1e4"). InnerVolumeSpecName "kube-api-access-xnmmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:39:53.628541 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.628513 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ee8415-096e-4e75-a448-76df8135d1e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01ee8415-096e-4e75-a448-76df8135d1e4" (UID: "01ee8415-096e-4e75-a448-76df8135d1e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:39:53.728121 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.728094 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ee8415-096e-4e75-a448-76df8135d1e4-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:39:53.728227 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.728125 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ee8415-096e-4e75-a448-76df8135d1e4-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:39:53.728227 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.728139 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnmmq\" (UniqueName: \"kubernetes.io/projected/01ee8415-096e-4e75-a448-76df8135d1e4-kube-api-access-xnmmq\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:39:53.878071 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.878029 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr"] Jul 06 12:39:53.883055 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:53.883024 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr"] Jul 06 12:39:55.507895 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:55.507853 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01ee8415-096e-4e75-a448-76df8135d1e4" path="/var/lib/kubelet/pods/01ee8415-096e-4e75-a448-76df8135d1e4/volumes" Jul 06 12:39:56.465963 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:39:56.465924 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-api-a-e65f56-56c4999d44-nvbsr" podUID="01ee8415-096e-4e75-a448-76df8135d1e4" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 06 12:40:01.453066 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.453012 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq"] Jul 06 12:40:01.453497 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.453271 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" podUID="f7cdd92c-0a88-4a61-8b95-43b277b382b9" containerName="maas-api" containerID="cri-o://b309c3a770c54146c17538750154a2b44d2c04a80083b51a25c0a35335f3264d" gracePeriod=30 Jul 06 12:40:01.590708 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.590674 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7cdd92c-0a88-4a61-8b95-43b277b382b9" containerID="b309c3a770c54146c17538750154a2b44d2c04a80083b51a25c0a35335f3264d" exitCode=0 Jul 06 12:40:01.590873 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.590757 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" event={"ID":"f7cdd92c-0a88-4a61-8b95-43b277b382b9","Type":"ContainerDied","Data":"b309c3a770c54146c17538750154a2b44d2c04a80083b51a25c0a35335f3264d"} Jul 06 12:40:01.701783 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.701753 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:40:01.799882 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.799854 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cdd92c-0a88-4a61-8b95-43b277b382b9-maas-api-tls\") pod \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " Jul 06 12:40:01.800068 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.799898 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jljsc\" (UniqueName: \"kubernetes.io/projected/f7cdd92c-0a88-4a61-8b95-43b277b382b9-kube-api-access-jljsc\") pod \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " Jul 06 12:40:01.800068 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.799934 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cdd92c-0a88-4a61-8b95-43b277b382b9-openshift-service-ca\") pod \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\" (UID: \"f7cdd92c-0a88-4a61-8b95-43b277b382b9\") " Jul 06 12:40:01.800360 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.800333 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7cdd92c-0a88-4a61-8b95-43b277b382b9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f7cdd92c-0a88-4a61-8b95-43b277b382b9" (UID: "f7cdd92c-0a88-4a61-8b95-43b277b382b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:40:01.801817 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.801790 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7cdd92c-0a88-4a61-8b95-43b277b382b9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f7cdd92c-0a88-4a61-8b95-43b277b382b9" (UID: "f7cdd92c-0a88-4a61-8b95-43b277b382b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:40:01.801919 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.801896 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7cdd92c-0a88-4a61-8b95-43b277b382b9-kube-api-access-jljsc" (OuterVolumeSpecName: "kube-api-access-jljsc") pod "f7cdd92c-0a88-4a61-8b95-43b277b382b9" (UID: "f7cdd92c-0a88-4a61-8b95-43b277b382b9"). InnerVolumeSpecName "kube-api-access-jljsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:40:01.901064 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.901019 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cdd92c-0a88-4a61-8b95-43b277b382b9-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:40:01.901064 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.901063 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jljsc\" (UniqueName: \"kubernetes.io/projected/f7cdd92c-0a88-4a61-8b95-43b277b382b9-kube-api-access-jljsc\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:40:01.901197 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:01.901079 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cdd92c-0a88-4a61-8b95-43b277b382b9-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:40:02.595970 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:02.595936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" event={"ID":"f7cdd92c-0a88-4a61-8b95-43b277b382b9","Type":"ContainerDied","Data":"bac9c8468c1f5ea92a5463fd78a106d9eb7f2d48c471899344ed183543279c55"} Jul 06 12:40:02.596393 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:02.595979 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq" Jul 06 12:40:02.596393 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:02.595998 2576 scope.go:117] "RemoveContainer" containerID="b309c3a770c54146c17538750154a2b44d2c04a80083b51a25c0a35335f3264d" Jul 06 12:40:02.618198 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:02.618174 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq"] Jul 06 12:40:02.622245 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:02.622214 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e76514-587d4dfbfb-2tnwq"] Jul 06 12:40:03.506948 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:03.506915 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7cdd92c-0a88-4a61-8b95-43b277b382b9" path="/var/lib/kubelet/pods/f7cdd92c-0a88-4a61-8b95-43b277b382b9/volumes" Jul 06 12:40:12.532775 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.532745 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9"] Jul 06 12:40:12.533177 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.533101 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7cdd92c-0a88-4a61-8b95-43b277b382b9" containerName="maas-api" Jul 06 12:40:12.533177 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.533114 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7cdd92c-0a88-4a61-8b95-43b277b382b9" containerName="maas-api" Jul 06 12:40:12.533177 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.533128 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ee8415-096e-4e75-a448-76df8135d1e4" containerName="maas-api" Jul 06 12:40:12.533177 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.533133 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ee8415-096e-4e75-a448-76df8135d1e4" containerName="maas-api" Jul 06 12:40:12.533319 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.533189 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ee8415-096e-4e75-a448-76df8135d1e4" containerName="maas-api" Jul 06 12:40:12.533319 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.533201 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7cdd92c-0a88-4a61-8b95-43b277b382b9" containerName="maas-api" Jul 06 12:40:12.536005 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.535989 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:12.539293 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.539257 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-4e06f6-serving-cert\"" Jul 06 12:40:12.554775 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.554755 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9"] Jul 06 12:40:12.697819 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.697785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f012a57a-6e26-4365-92e2-68bb0f58a3d4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:12.697980 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.697856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt62p\" (UniqueName: \"kubernetes.io/projected/f012a57a-6e26-4365-92e2-68bb0f58a3d4-kube-api-access-jt62p\") pod \"maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:12.697980 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.697907 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f012a57a-6e26-4365-92e2-68bb0f58a3d4-maas-api-tls\") pod \"maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:12.798790 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.798702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt62p\" (UniqueName: \"kubernetes.io/projected/f012a57a-6e26-4365-92e2-68bb0f58a3d4-kube-api-access-jt62p\") pod \"maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:12.798790 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.798776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f012a57a-6e26-4365-92e2-68bb0f58a3d4-maas-api-tls\") pod \"maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:12.799014 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.798841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f012a57a-6e26-4365-92e2-68bb0f58a3d4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:12.799447 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.799424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f012a57a-6e26-4365-92e2-68bb0f58a3d4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:12.801206 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.801186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f012a57a-6e26-4365-92e2-68bb0f58a3d4-maas-api-tls\") pod \"maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:12.812734 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.812713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt62p\" (UniqueName: \"kubernetes.io/projected/f012a57a-6e26-4365-92e2-68bb0f58a3d4-kube-api-access-jt62p\") pod \"maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:12.846750 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.846729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:12.979514 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:12.979477 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9"] Jul 06 12:40:12.982552 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:40:12.982526 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf012a57a_6e26_4365_92e2_68bb0f58a3d4.slice/crio-733c36e1dab424d0b3f0ce594cd1d2ad4b16b0010d76667bd399ade7ee554896 WatchSource:0}: Error finding container 733c36e1dab424d0b3f0ce594cd1d2ad4b16b0010d76667bd399ade7ee554896: Status 404 returned error can't find the container with id 733c36e1dab424d0b3f0ce594cd1d2ad4b16b0010d76667bd399ade7ee554896 Jul 06 12:40:13.644628 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:13.644541 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" event={"ID":"f012a57a-6e26-4365-92e2-68bb0f58a3d4","Type":"ContainerStarted","Data":"f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556"} Jul 06 12:40:13.644628 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:13.644591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" event={"ID":"f012a57a-6e26-4365-92e2-68bb0f58a3d4","Type":"ContainerStarted","Data":"733c36e1dab424d0b3f0ce594cd1d2ad4b16b0010d76667bd399ade7ee554896"} Jul 06 12:40:13.645156 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:13.644679 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:13.679504 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:13.679457 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" podStartSLOduration=1.328588147 podStartE2EDuration="1.679441482s" totalImagesPullingTime="350.853335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:40:13.675922061 +0000 UTC m=+2138.777078303" watchObservedRunningTime="2026-07-06 12:40:13.679441482 +0000 UTC m=+2138.780597723" Jul 06 12:40:19.654931 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:19.654901 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:40:21.538334 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.538305 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr"] Jul 06 12:40:21.542099 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.542074 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:21.545572 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.545549 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-b8c37f-serving-cert\"" Jul 06 12:40:21.563695 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.563668 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr"] Jul 06 12:40:21.674348 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.674317 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68b91ae-a407-4c9f-b2a2-1dc51e861483-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:21.674532 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.674362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k29dm\" (UniqueName: \"kubernetes.io/projected/d68b91ae-a407-4c9f-b2a2-1dc51e861483-kube-api-access-k29dm\") pod \"maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:21.674603 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.674557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d68b91ae-a407-4c9f-b2a2-1dc51e861483-maas-api-tls\") pod \"maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:21.775564 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.775533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d68b91ae-a407-4c9f-b2a2-1dc51e861483-maas-api-tls\") pod \"maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:21.775716 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.775578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68b91ae-a407-4c9f-b2a2-1dc51e861483-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:21.775716 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.775607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k29dm\" (UniqueName: \"kubernetes.io/projected/d68b91ae-a407-4c9f-b2a2-1dc51e861483-kube-api-access-k29dm\") pod \"maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:21.776287 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.776267 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68b91ae-a407-4c9f-b2a2-1dc51e861483-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:21.777723 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.777701 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d68b91ae-a407-4c9f-b2a2-1dc51e861483-maas-api-tls\") pod \"maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:21.789436 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.789388 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k29dm\" (UniqueName: \"kubernetes.io/projected/d68b91ae-a407-4c9f-b2a2-1dc51e861483-kube-api-access-k29dm\") pod \"maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:21.855389 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.855367 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:21.995452 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:21.995432 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr"] Jul 06 12:40:21.998135 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:40:21.998102 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68b91ae_a407_4c9f_b2a2_1dc51e861483.slice/crio-f00631a9df61dfa9504f5846135f9b8c2b59361a51489dde4ae616a7800581cd WatchSource:0}: Error finding container f00631a9df61dfa9504f5846135f9b8c2b59361a51489dde4ae616a7800581cd: Status 404 returned error can't find the container with id f00631a9df61dfa9504f5846135f9b8c2b59361a51489dde4ae616a7800581cd Jul 06 12:40:22.684750 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:22.684724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" event={"ID":"d68b91ae-a407-4c9f-b2a2-1dc51e861483","Type":"ContainerStarted","Data":"93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef"} Jul 06 12:40:22.685100 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:22.684802 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" event={"ID":"d68b91ae-a407-4c9f-b2a2-1dc51e861483","Type":"ContainerStarted","Data":"f00631a9df61dfa9504f5846135f9b8c2b59361a51489dde4ae616a7800581cd"} Jul 06 12:40:22.685100 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:22.684823 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:40:22.710919 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:22.710868 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" podStartSLOduration=1.082415116 podStartE2EDuration="1.710854271s" totalImagesPullingTime="628.439155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:40:22.708681734 +0000 UTC m=+2147.809837996" watchObservedRunningTime="2026-07-06 12:40:22.710854271 +0000 UTC m=+2147.812010514" Jul 06 12:40:28.694510 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:40:28.694422 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:43:11.102688 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.102657 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99"] Jul 06 12:43:11.105805 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.105790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.108530 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.108511 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"kube-root-ca.crt\"" Jul 06 12:43:11.108700 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.108682 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"default-dockercfg-74hqg\"" Jul 06 12:43:11.109408 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.109386 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"sub-test-model-4e06f6-kserve-self-signed-certs\"" Jul 06 12:43:11.109408 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.109404 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"openshift-service-ca.crt\"" Jul 06 12:43:11.118727 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.118700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99"] Jul 06 12:43:11.258496 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.258467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-tmp-dir\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.258641 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.258514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-dshm\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.258641 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.258573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-home\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.258641 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.258628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30433bd7-2754-47b8-b098-953eb9747e1a-tls-certs\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.258812 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.258658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-model-cache\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.258812 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.258702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7l8r\" (UniqueName: \"kubernetes.io/projected/30433bd7-2754-47b8-b098-953eb9747e1a-kube-api-access-n7l8r\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.359979 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.359909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7l8r\" (UniqueName: \"kubernetes.io/projected/30433bd7-2754-47b8-b098-953eb9747e1a-kube-api-access-n7l8r\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.359979 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.359959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-tmp-dir\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.360171 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.359987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-dshm\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.360171 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.360015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-home\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.360171 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.360058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30433bd7-2754-47b8-b098-953eb9747e1a-tls-certs\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.360171 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.360138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-model-cache\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.360396 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.360379 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-tmp-dir\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.360506 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.360485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-home\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.360567 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.360550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-model-cache\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.362054 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.362024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-dshm\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.362452 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.362437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30433bd7-2754-47b8-b098-953eb9747e1a-tls-certs\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.368788 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.368768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7l8r\" (UniqueName: \"kubernetes.io/projected/30433bd7-2754-47b8-b098-953eb9747e1a-kube-api-access-n7l8r\") pod \"sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.414835 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.414810 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:11.547582 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:11.547558 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99"] Jul 06 12:43:11.549768 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:43:11.549741 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30433bd7_2754_47b8_b098_953eb9747e1a.slice/crio-d7b459fb62a2b0652663cb761e649c004de589bc96db89bbf2df4b3dcbb4ee7f WatchSource:0}: Error finding container d7b459fb62a2b0652663cb761e649c004de589bc96db89bbf2df4b3dcbb4ee7f: Status 404 returned error can't find the container with id d7b459fb62a2b0652663cb761e649c004de589bc96db89bbf2df4b3dcbb4ee7f Jul 06 12:43:12.426764 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:12.426726 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" event={"ID":"30433bd7-2754-47b8-b098-953eb9747e1a","Type":"ContainerStarted","Data":"e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183"} Jul 06 12:43:12.427246 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:12.426774 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" event={"ID":"30433bd7-2754-47b8-b098-953eb9747e1a","Type":"ContainerStarted","Data":"d7b459fb62a2b0652663cb761e649c004de589bc96db89bbf2df4b3dcbb4ee7f"} Jul 06 12:43:12.447593 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:12.447542 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" podStartSLOduration=1.447529331 podStartE2EDuration="1.447529331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:43:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:43:12.446427223 +0000 UTC m=+2317.547583465" watchObservedRunningTime="2026-07-06 12:43:12.447529331 +0000 UTC m=+2317.548685572" Jul 06 12:43:21.414989 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:21.414960 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:21.415444 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:21.415055 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:21.427608 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:21.427582 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:43:21.476183 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:43:21.476162 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:44:24.529904 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:24.529869 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99"] Jul 06 12:44:39.549356 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.549296 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" podUID="30433bd7-2754-47b8-b098-953eb9747e1a" containerName="main" containerID="cri-o://e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183" gracePeriod=45 Jul 06 12:44:39.787309 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.787287 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:44:39.823292 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.823226 2576 generic.go:356] "Generic (PLEG): container finished" podID="30433bd7-2754-47b8-b098-953eb9747e1a" containerID="e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183" exitCode=0 Jul 06 12:44:39.823292 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.823260 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" Jul 06 12:44:39.823435 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.823298 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" event={"ID":"30433bd7-2754-47b8-b098-953eb9747e1a","Type":"ContainerDied","Data":"e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183"} Jul 06 12:44:39.823435 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.823349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99" event={"ID":"30433bd7-2754-47b8-b098-953eb9747e1a","Type":"ContainerDied","Data":"d7b459fb62a2b0652663cb761e649c004de589bc96db89bbf2df4b3dcbb4ee7f"} Jul 06 12:44:39.823435 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.823373 2576 scope.go:117] "RemoveContainer" containerID="e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183" Jul 06 12:44:39.833830 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.833804 2576 scope.go:117] "RemoveContainer" containerID="e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183" Jul 06 12:44:39.834113 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:44:39.834089 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183\": container with ID starting with e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183 not found: ID does not exist" containerID="e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183" Jul 06 12:44:39.834192 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.834126 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183"} err="failed to get container status \"e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183\": rpc error: code = NotFound desc = could not find container \"e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183\": container with ID starting with e7c8f0887d8c35701d4b3b66aaf1ac2c816a8a44754852457f2625f8de19f183 not found: ID does not exist" Jul 06 12:44:39.901911 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.901887 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-dshm\") pod \"30433bd7-2754-47b8-b098-953eb9747e1a\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " Jul 06 12:44:39.902023 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.901979 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-tmp-dir\") pod \"30433bd7-2754-47b8-b098-953eb9747e1a\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " Jul 06 12:44:39.902023 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.901998 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-model-cache\") pod \"30433bd7-2754-47b8-b098-953eb9747e1a\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " Jul 06 12:44:39.902147 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.902030 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30433bd7-2754-47b8-b098-953eb9747e1a-tls-certs\") pod \"30433bd7-2754-47b8-b098-953eb9747e1a\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " Jul 06 12:44:39.902147 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.902088 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-home\") pod \"30433bd7-2754-47b8-b098-953eb9747e1a\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " Jul 06 12:44:39.902147 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.902117 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7l8r\" (UniqueName: \"kubernetes.io/projected/30433bd7-2754-47b8-b098-953eb9747e1a-kube-api-access-n7l8r\") pod \"30433bd7-2754-47b8-b098-953eb9747e1a\" (UID: \"30433bd7-2754-47b8-b098-953eb9747e1a\") " Jul 06 12:44:39.902299 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.902282 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "30433bd7-2754-47b8-b098-953eb9747e1a" (UID: "30433bd7-2754-47b8-b098-953eb9747e1a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:44:39.902353 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.902297 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-model-cache" (OuterVolumeSpecName: "model-cache") pod "30433bd7-2754-47b8-b098-953eb9747e1a" (UID: "30433bd7-2754-47b8-b098-953eb9747e1a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:44:39.902434 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.902409 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-home" (OuterVolumeSpecName: "home") pod "30433bd7-2754-47b8-b098-953eb9747e1a" (UID: "30433bd7-2754-47b8-b098-953eb9747e1a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:44:39.902478 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.902455 2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-tmp-dir\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:44:39.902528 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.902475 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-model-cache\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:44:39.904013 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.903993 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-dshm" (OuterVolumeSpecName: "dshm") pod "30433bd7-2754-47b8-b098-953eb9747e1a" (UID: "30433bd7-2754-47b8-b098-953eb9747e1a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:44:39.904168 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.904143 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30433bd7-2754-47b8-b098-953eb9747e1a-kube-api-access-n7l8r" (OuterVolumeSpecName: "kube-api-access-n7l8r") pod "30433bd7-2754-47b8-b098-953eb9747e1a" (UID: "30433bd7-2754-47b8-b098-953eb9747e1a"). InnerVolumeSpecName "kube-api-access-n7l8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:44:39.904227 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:39.904208 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30433bd7-2754-47b8-b098-953eb9747e1a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "30433bd7-2754-47b8-b098-953eb9747e1a" (UID: "30433bd7-2754-47b8-b098-953eb9747e1a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:44:40.003344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:40.003302 2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30433bd7-2754-47b8-b098-953eb9747e1a-tls-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:44:40.003344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:40.003339 2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-home\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:44:40.003344 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:40.003352 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7l8r\" (UniqueName: \"kubernetes.io/projected/30433bd7-2754-47b8-b098-953eb9747e1a-kube-api-access-n7l8r\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:44:40.003539 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:40.003364 2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30433bd7-2754-47b8-b098-953eb9747e1a-dshm\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:44:40.153262 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:40.153231 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99"] Jul 06 12:44:40.156668 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:40.156637 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/sub-test-model-4e06f6-kserve-7cb4c98d7c-jkq99"] Jul 06 12:44:41.508177 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:44:41.508141 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30433bd7-2754-47b8-b098-953eb9747e1a" path="/var/lib/kubelet/pods/30433bd7-2754-47b8-b098-953eb9747e1a/volumes" Jul 06 12:45:00.145828 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.145750 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph"] Jul 06 12:45:00.146291 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.146156 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30433bd7-2754-47b8-b098-953eb9747e1a" containerName="main" Jul 06 12:45:00.146291 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.146169 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="30433bd7-2754-47b8-b098-953eb9747e1a" containerName="main" Jul 06 12:45:00.146291 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.146227 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="30433bd7-2754-47b8-b098-953eb9747e1a" containerName="main" Jul 06 12:45:00.149193 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.149178 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph" Jul 06 12:45:00.152414 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.152390 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68"] Jul 06 12:45:00.155414 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.155399 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722365-s5p6k"] Jul 06 12:45:00.155537 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.155516 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" Jul 06 12:45:00.158762 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.158741 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph"] Jul 06 12:45:00.158889 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.158823 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" Jul 06 12:45:00.167851 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.167824 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68"] Jul 06 12:45:00.169721 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.169686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr5zd\" (UniqueName: \"kubernetes.io/projected/32e95245-0da9-4118-9282-366f0265b8f9-kube-api-access-pr5zd\") pod \"maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph\" (UID: \"32e95245-0da9-4118-9282-366f0265b8f9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph" Jul 06 12:45:00.169974 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.169952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2gn\" (UniqueName: \"kubernetes.io/projected/accad275-a3a8-4a6e-b73b-82595d4a2dd2-kube-api-access-gr2gn\") pod \"maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68\" (UID: \"accad275-a3a8-4a6e-b73b-82595d4a2dd2\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" Jul 06 12:45:00.173105 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.173085 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722365-s5p6k"] Jul 06 12:45:00.270778 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.270736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr5zd\" (UniqueName: \"kubernetes.io/projected/32e95245-0da9-4118-9282-366f0265b8f9-kube-api-access-pr5zd\") pod \"maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph\" (UID: \"32e95245-0da9-4118-9282-366f0265b8f9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph" Jul 06 12:45:00.270932 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.270800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2gn\" (UniqueName: \"kubernetes.io/projected/accad275-a3a8-4a6e-b73b-82595d4a2dd2-kube-api-access-gr2gn\") pod \"maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68\" (UID: \"accad275-a3a8-4a6e-b73b-82595d4a2dd2\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" Jul 06 12:45:00.270932 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.270856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccpnl\" (UniqueName: \"kubernetes.io/projected/d7d1917f-5b05-4dfe-990e-73e1e4e17793-kube-api-access-ccpnl\") pod \"maas-api-key-cleanup-29722365-s5p6k\" (UID: \"d7d1917f-5b05-4dfe-990e-73e1e4e17793\") " pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" Jul 06 12:45:00.281810 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.281778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2gn\" (UniqueName: \"kubernetes.io/projected/accad275-a3a8-4a6e-b73b-82595d4a2dd2-kube-api-access-gr2gn\") pod \"maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68\" (UID: \"accad275-a3a8-4a6e-b73b-82595d4a2dd2\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" Jul 06 12:45:00.281915 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.281838 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr5zd\" (UniqueName: \"kubernetes.io/projected/32e95245-0da9-4118-9282-366f0265b8f9-kube-api-access-pr5zd\") pod \"maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph\" (UID: \"32e95245-0da9-4118-9282-366f0265b8f9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph" Jul 06 12:45:00.371823 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.371785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccpnl\" (UniqueName: \"kubernetes.io/projected/d7d1917f-5b05-4dfe-990e-73e1e4e17793-kube-api-access-ccpnl\") pod \"maas-api-key-cleanup-29722365-s5p6k\" (UID: \"d7d1917f-5b05-4dfe-990e-73e1e4e17793\") " pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" Jul 06 12:45:00.382852 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.382824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccpnl\" (UniqueName: \"kubernetes.io/projected/d7d1917f-5b05-4dfe-990e-73e1e4e17793-kube-api-access-ccpnl\") pod \"maas-api-key-cleanup-29722365-s5p6k\" (UID: \"d7d1917f-5b05-4dfe-990e-73e1e4e17793\") " pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" Jul 06 12:45:00.461771 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.461698 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph" Jul 06 12:45:00.473032 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.472871 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" Jul 06 12:45:00.480651 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.480632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" Jul 06 12:45:00.617283 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.617191 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph"] Jul 06 12:45:00.617946 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:45:00.617915 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e95245_0da9_4118_9282_366f0265b8f9.slice/crio-75c019f646c55fabaab3acbb6ee60110624b939ec1d64ffbe9874f6f101a72d3 WatchSource:0}: Error finding container 75c019f646c55fabaab3acbb6ee60110624b939ec1d64ffbe9874f6f101a72d3: Status 404 returned error can't find the container with id 75c019f646c55fabaab3acbb6ee60110624b939ec1d64ffbe9874f6f101a72d3 Jul 06 12:45:00.620013 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.619993 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 12:45:00.859454 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:45:00.859424 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaccad275_a3a8_4a6e_b73b_82595d4a2dd2.slice/crio-9b8d57775e34888da3a96da0f8088ec4d5f5c57fe502ae84c92a33dae9ce5eb7 WatchSource:0}: Error finding container 9b8d57775e34888da3a96da0f8088ec4d5f5c57fe502ae84c92a33dae9ce5eb7: Status 404 returned error can't find the container with id 9b8d57775e34888da3a96da0f8088ec4d5f5c57fe502ae84c92a33dae9ce5eb7 Jul 06 12:45:00.862954 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:45:00.862925 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d1917f_5b05_4dfe_990e_73e1e4e17793.slice/crio-34df1c7367b8af52a4c41fef7c2330a743831534b17333356c9b38584b93bea2 WatchSource:0}: Error finding container 34df1c7367b8af52a4c41fef7c2330a743831534b17333356c9b38584b93bea2: Status 404 returned error can't find the container with id 34df1c7367b8af52a4c41fef7c2330a743831534b17333356c9b38584b93bea2 Jul 06 12:45:00.863610 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.863452 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68"] Jul 06 12:45:00.865818 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.865797 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722365-s5p6k"] Jul 06 12:45:00.916254 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.916220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" event={"ID":"d7d1917f-5b05-4dfe-990e-73e1e4e17793","Type":"ContainerStarted","Data":"34df1c7367b8af52a4c41fef7c2330a743831534b17333356c9b38584b93bea2"} Jul 06 12:45:00.917376 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.917351 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" event={"ID":"accad275-a3a8-4a6e-b73b-82595d4a2dd2","Type":"ContainerStarted","Data":"9b8d57775e34888da3a96da0f8088ec4d5f5c57fe502ae84c92a33dae9ce5eb7"} Jul 06 12:45:00.918398 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:00.918377 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph" event={"ID":"32e95245-0da9-4118-9282-366f0265b8f9","Type":"ContainerStarted","Data":"75c019f646c55fabaab3acbb6ee60110624b939ec1d64ffbe9874f6f101a72d3"} Jul 06 12:45:03.934653 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:03.934627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" event={"ID":"d7d1917f-5b05-4dfe-990e-73e1e4e17793","Type":"ContainerStarted","Data":"fb5203a5b1e675224bb51ae861ff07c1fd3af861279c6a2e24114538ec946531"} Jul 06 12:45:03.936369 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:03.936336 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" event={"ID":"accad275-a3a8-4a6e-b73b-82595d4a2dd2","Type":"ContainerStarted","Data":"ae52b5d74242967275e8b176d1bfc85dddcefa7bf44a5144e8645408af0389d2"} Jul 06 12:45:03.938104 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:03.938079 2576 generic.go:356] "Generic (PLEG): container finished" podID="32e95245-0da9-4118-9282-366f0265b8f9" containerID="ea38d8a2d66154cfb6b2d0b7404b4496dcd814b69d89f33e1f3ea26abc69e4d4" exitCode=0 Jul 06 12:45:03.938211 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:03.938115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph" event={"ID":"32e95245-0da9-4118-9282-366f0265b8f9","Type":"ContainerDied","Data":"ea38d8a2d66154cfb6b2d0b7404b4496dcd814b69d89f33e1f3ea26abc69e4d4"} Jul 06 12:45:03.951524 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:03.951483 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" podStartSLOduration=1.955960602 podStartE2EDuration="3.951468812s" totalImagesPullingTime="1.99550821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:45:03.949534484 +0000 UTC m=+2429.050690745" watchObservedRunningTime="2026-07-06 12:45:03.951468812 +0000 UTC m=+2429.052625032" Jul 06 12:45:03.981863 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:03.981816 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" podStartSLOduration=1.9868156959999999 podStartE2EDuration="3.981802407s" totalImagesPullingTime="1.994986711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:45:03.981174766 +0000 UTC m=+2429.082331008" watchObservedRunningTime="2026-07-06 12:45:03.981802407 +0000 UTC m=+2429.082958649" Jul 06 12:45:04.944618 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:04.944584 2576 generic.go:356] "Generic (PLEG): container finished" podID="d7d1917f-5b05-4dfe-990e-73e1e4e17793" containerID="fb5203a5b1e675224bb51ae861ff07c1fd3af861279c6a2e24114538ec946531" exitCode=0 Jul 06 12:45:04.945035 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:04.944669 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" event={"ID":"d7d1917f-5b05-4dfe-990e-73e1e4e17793","Type":"ContainerDied","Data":"fb5203a5b1e675224bb51ae861ff07c1fd3af861279c6a2e24114538ec946531"} Jul 06 12:45:04.946137 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:04.946106 2576 generic.go:356] "Generic (PLEG): container finished" podID="accad275-a3a8-4a6e-b73b-82595d4a2dd2" containerID="ae52b5d74242967275e8b176d1bfc85dddcefa7bf44a5144e8645408af0389d2" exitCode=0 Jul 06 12:45:04.946227 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:04.946147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" event={"ID":"accad275-a3a8-4a6e-b73b-82595d4a2dd2","Type":"ContainerDied","Data":"ae52b5d74242967275e8b176d1bfc85dddcefa7bf44a5144e8645408af0389d2"} Jul 06 12:45:05.080907 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:05.080884 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph" Jul 06 12:45:05.118958 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:05.118927 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr5zd\" (UniqueName: \"kubernetes.io/projected/32e95245-0da9-4118-9282-366f0265b8f9-kube-api-access-pr5zd\") pod \"32e95245-0da9-4118-9282-366f0265b8f9\" (UID: \"32e95245-0da9-4118-9282-366f0265b8f9\") " Jul 06 12:45:05.120874 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:05.120844 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e95245-0da9-4118-9282-366f0265b8f9-kube-api-access-pr5zd" (OuterVolumeSpecName: "kube-api-access-pr5zd") pod "32e95245-0da9-4118-9282-366f0265b8f9" (UID: "32e95245-0da9-4118-9282-366f0265b8f9"). InnerVolumeSpecName "kube-api-access-pr5zd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:45:05.220357 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:05.220334 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr5zd\" (UniqueName: \"kubernetes.io/projected/32e95245-0da9-4118-9282-366f0265b8f9-kube-api-access-pr5zd\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:45:05.956783 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:05.956708 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph" Jul 06 12:45:05.956783 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:05.956744 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph" event={"ID":"32e95245-0da9-4118-9282-366f0265b8f9","Type":"ContainerDied","Data":"75c019f646c55fabaab3acbb6ee60110624b939ec1d64ffbe9874f6f101a72d3"} Jul 06 12:45:05.957259 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:05.956820 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75c019f646c55fabaab3acbb6ee60110624b939ec1d64ffbe9874f6f101a72d3" Jul 06 12:45:06.097405 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.097379 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" Jul 06 12:45:06.128468 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.128444 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" Jul 06 12:45:06.229249 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.229225 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr2gn\" (UniqueName: \"kubernetes.io/projected/accad275-a3a8-4a6e-b73b-82595d4a2dd2-kube-api-access-gr2gn\") pod \"accad275-a3a8-4a6e-b73b-82595d4a2dd2\" (UID: \"accad275-a3a8-4a6e-b73b-82595d4a2dd2\") " Jul 06 12:45:06.229385 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.229321 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccpnl\" (UniqueName: \"kubernetes.io/projected/d7d1917f-5b05-4dfe-990e-73e1e4e17793-kube-api-access-ccpnl\") pod \"d7d1917f-5b05-4dfe-990e-73e1e4e17793\" (UID: \"d7d1917f-5b05-4dfe-990e-73e1e4e17793\") " Jul 06 12:45:06.231269 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.231241 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7d1917f-5b05-4dfe-990e-73e1e4e17793-kube-api-access-ccpnl" (OuterVolumeSpecName: "kube-api-access-ccpnl") pod "d7d1917f-5b05-4dfe-990e-73e1e4e17793" (UID: "d7d1917f-5b05-4dfe-990e-73e1e4e17793"). InnerVolumeSpecName "kube-api-access-ccpnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:45:06.231373 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.231310 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/accad275-a3a8-4a6e-b73b-82595d4a2dd2-kube-api-access-gr2gn" (OuterVolumeSpecName: "kube-api-access-gr2gn") pod "accad275-a3a8-4a6e-b73b-82595d4a2dd2" (UID: "accad275-a3a8-4a6e-b73b-82595d4a2dd2"). InnerVolumeSpecName "kube-api-access-gr2gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:45:06.330397 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.330372 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr2gn\" (UniqueName: \"kubernetes.io/projected/accad275-a3a8-4a6e-b73b-82595d4a2dd2-kube-api-access-gr2gn\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:45:06.330397 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.330395 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccpnl\" (UniqueName: \"kubernetes.io/projected/d7d1917f-5b05-4dfe-990e-73e1e4e17793-kube-api-access-ccpnl\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:45:06.962849 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.962822 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" Jul 06 12:45:06.962849 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.962838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722365-s5p6k" event={"ID":"d7d1917f-5b05-4dfe-990e-73e1e4e17793","Type":"ContainerDied","Data":"34df1c7367b8af52a4c41fef7c2330a743831534b17333356c9b38584b93bea2"} Jul 06 12:45:06.963334 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.962878 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34df1c7367b8af52a4c41fef7c2330a743831534b17333356c9b38584b93bea2" Jul 06 12:45:06.964255 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.964241 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" Jul 06 12:45:06.964255 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.964247 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68" event={"ID":"accad275-a3a8-4a6e-b73b-82595d4a2dd2","Type":"ContainerDied","Data":"9b8d57775e34888da3a96da0f8088ec4d5f5c57fe502ae84c92a33dae9ce5eb7"} Jul 06 12:45:06.964389 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:06.964281 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b8d57775e34888da3a96da0f8088ec4d5f5c57fe502ae84c92a33dae9ce5eb7" Jul 06 12:45:54.916209 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:54.916171 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9"] Jul 06 12:45:54.916691 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:54.916448 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" podUID="f012a57a-6e26-4365-92e2-68bb0f58a3d4" containerName="maas-api" containerID="cri-o://f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556" gracePeriod=30 Jul 06 12:45:54.949700 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:54.949675 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph"] Jul 06 12:45:54.954496 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:54.954476 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-4e06f6-29722365-hrsph"] Jul 06 12:45:55.161437 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.161411 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:45:55.186551 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.186484 2576 generic.go:356] "Generic (PLEG): container finished" podID="f012a57a-6e26-4365-92e2-68bb0f58a3d4" containerID="f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556" exitCode=0 Jul 06 12:45:55.186551 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.186529 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" Jul 06 12:45:55.186704 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.186578 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" event={"ID":"f012a57a-6e26-4365-92e2-68bb0f58a3d4","Type":"ContainerDied","Data":"f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556"} Jul 06 12:45:55.186704 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.186618 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9" event={"ID":"f012a57a-6e26-4365-92e2-68bb0f58a3d4","Type":"ContainerDied","Data":"733c36e1dab424d0b3f0ce594cd1d2ad4b16b0010d76667bd399ade7ee554896"} Jul 06 12:45:55.186704 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.186637 2576 scope.go:117] "RemoveContainer" containerID="f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556" Jul 06 12:45:55.195136 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.195117 2576 scope.go:117] "RemoveContainer" containerID="f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556" Jul 06 12:45:55.195401 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:45:55.195384 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556\": container with ID starting with f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556 not found: ID does not exist" containerID="f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556" Jul 06 12:45:55.195460 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.195410 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556"} err="failed to get container status \"f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556\": rpc error: code = NotFound desc = could not find container \"f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556\": container with ID starting with f14a94753e8624725c3e9d9b51e6968564acbb40623e5d7a2b96c6ad21974556 not found: ID does not exist" Jul 06 12:45:55.224056 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.224023 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt62p\" (UniqueName: \"kubernetes.io/projected/f012a57a-6e26-4365-92e2-68bb0f58a3d4-kube-api-access-jt62p\") pod \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " Jul 06 12:45:55.224161 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.224112 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f012a57a-6e26-4365-92e2-68bb0f58a3d4-openshift-service-ca\") pod \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " Jul 06 12:45:55.224161 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.224134 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f012a57a-6e26-4365-92e2-68bb0f58a3d4-maas-api-tls\") pod \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\" (UID: \"f012a57a-6e26-4365-92e2-68bb0f58a3d4\") " Jul 06 12:45:55.224439 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.224420 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f012a57a-6e26-4365-92e2-68bb0f58a3d4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f012a57a-6e26-4365-92e2-68bb0f58a3d4" (UID: "f012a57a-6e26-4365-92e2-68bb0f58a3d4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:45:55.225967 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.225947 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f012a57a-6e26-4365-92e2-68bb0f58a3d4-kube-api-access-jt62p" (OuterVolumeSpecName: "kube-api-access-jt62p") pod "f012a57a-6e26-4365-92e2-68bb0f58a3d4" (UID: "f012a57a-6e26-4365-92e2-68bb0f58a3d4"). InnerVolumeSpecName "kube-api-access-jt62p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:45:55.226081 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.225969 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f012a57a-6e26-4365-92e2-68bb0f58a3d4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f012a57a-6e26-4365-92e2-68bb0f58a3d4" (UID: "f012a57a-6e26-4365-92e2-68bb0f58a3d4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:45:55.325600 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.325582 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f012a57a-6e26-4365-92e2-68bb0f58a3d4-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:45:55.325600 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.325601 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f012a57a-6e26-4365-92e2-68bb0f58a3d4-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:45:55.325729 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.325610 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt62p\" (UniqueName: \"kubernetes.io/projected/f012a57a-6e26-4365-92e2-68bb0f58a3d4-kube-api-access-jt62p\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:45:55.507231 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.507206 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32e95245-0da9-4118-9282-366f0265b8f9" path="/var/lib/kubelet/pods/32e95245-0da9-4118-9282-366f0265b8f9/volumes" Jul 06 12:45:55.507463 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.507451 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9"] Jul 06 12:45:55.512510 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:55.512488 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e06f6-75c5c7d87f-hxgw9"] Jul 06 12:45:57.507574 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:45:57.507545 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f012a57a-6e26-4365-92e2-68bb0f58a3d4" path="/var/lib/kubelet/pods/f012a57a-6e26-4365-92e2-68bb0f58a3d4/volumes" Jul 06 12:46:08.567164 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.567135 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr"] Jul 06 12:46:08.567621 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.567335 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" podUID="d68b91ae-a407-4c9f-b2a2-1dc51e861483" containerName="maas-api" containerID="cri-o://93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef" gracePeriod=30 Jul 06 12:46:08.636211 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.636181 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68"] Jul 06 12:46:08.640362 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.640341 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-b8c37f-29722365-snn68"] Jul 06 12:46:08.690002 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.689962 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" podUID="d68b91ae-a407-4c9f-b2a2-1dc51e861483" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.42:8443/health\": dial tcp 10.134.0.42:8443: connect: connection refused" Jul 06 12:46:08.808613 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.808588 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:46:08.946254 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.946184 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68b91ae-a407-4c9f-b2a2-1dc51e861483-openshift-service-ca\") pod \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " Jul 06 12:46:08.946254 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.946221 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d68b91ae-a407-4c9f-b2a2-1dc51e861483-maas-api-tls\") pod \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " Jul 06 12:46:08.946413 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.946263 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k29dm\" (UniqueName: \"kubernetes.io/projected/d68b91ae-a407-4c9f-b2a2-1dc51e861483-kube-api-access-k29dm\") pod \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\" (UID: \"d68b91ae-a407-4c9f-b2a2-1dc51e861483\") " Jul 06 12:46:08.946534 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.946501 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68b91ae-a407-4c9f-b2a2-1dc51e861483-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d68b91ae-a407-4c9f-b2a2-1dc51e861483" (UID: "d68b91ae-a407-4c9f-b2a2-1dc51e861483"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:46:08.948305 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.948282 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d68b91ae-a407-4c9f-b2a2-1dc51e861483-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d68b91ae-a407-4c9f-b2a2-1dc51e861483" (UID: "d68b91ae-a407-4c9f-b2a2-1dc51e861483"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:46:08.948305 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:08.948293 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68b91ae-a407-4c9f-b2a2-1dc51e861483-kube-api-access-k29dm" (OuterVolumeSpecName: "kube-api-access-k29dm") pod "d68b91ae-a407-4c9f-b2a2-1dc51e861483" (UID: "d68b91ae-a407-4c9f-b2a2-1dc51e861483"). InnerVolumeSpecName "kube-api-access-k29dm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:46:09.047182 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.047155 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k29dm\" (UniqueName: \"kubernetes.io/projected/d68b91ae-a407-4c9f-b2a2-1dc51e861483-kube-api-access-k29dm\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:46:09.047182 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.047177 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68b91ae-a407-4c9f-b2a2-1dc51e861483-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:46:09.047305 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.047187 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d68b91ae-a407-4c9f-b2a2-1dc51e861483-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\"" Jul 06 12:46:09.251685 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.251654 2576 generic.go:356] "Generic (PLEG): container finished" podID="d68b91ae-a407-4c9f-b2a2-1dc51e861483" containerID="93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef" exitCode=0 Jul 06 12:46:09.251847 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.251706 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" Jul 06 12:46:09.251847 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.251716 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" event={"ID":"d68b91ae-a407-4c9f-b2a2-1dc51e861483","Type":"ContainerDied","Data":"93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef"} Jul 06 12:46:09.251847 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.251782 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr" event={"ID":"d68b91ae-a407-4c9f-b2a2-1dc51e861483","Type":"ContainerDied","Data":"f00631a9df61dfa9504f5846135f9b8c2b59361a51489dde4ae616a7800581cd"} Jul 06 12:46:09.251847 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.251805 2576 scope.go:117] "RemoveContainer" containerID="93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef" Jul 06 12:46:09.261119 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.261103 2576 scope.go:117] "RemoveContainer" containerID="93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef" Jul 06 12:46:09.261388 ip-10-0-131-197 kubenswrapper[2576]: E0706 12:46:09.261368 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef\": container with ID starting with 93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef not found: ID does not exist" containerID="93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef" Jul 06 12:46:09.261432 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.261395 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef"} err="failed to get container status \"93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef\": rpc error: code = NotFound desc = could not find container \"93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef\": container with ID starting with 93ce9d03441d8b695cdb90a8c877560c99e443179dcb7079379406d22f2531ef not found: ID does not exist" Jul 06 12:46:09.279322 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.279301 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr"] Jul 06 12:46:09.283490 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.283469 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b8c37f-7789c69c7d-ln5qr"] Jul 06 12:46:09.506876 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.506801 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="accad275-a3a8-4a6e-b73b-82595d4a2dd2" path="/var/lib/kubelet/pods/accad275-a3a8-4a6e-b73b-82595d4a2dd2/volumes" Jul 06 12:46:09.507205 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:09.507192 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68b91ae-a407-4c9f-b2a2-1dc51e861483" path="/var/lib/kubelet/pods/d68b91ae-a407-4c9f-b2a2-1dc51e861483/volumes" Jul 06 12:46:20.548343 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:20.548312 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-b66dc4564-t5rhb_f2f61827-81ee-4623-b32b-8f88d64d7e4b/maas-api/0.log" Jul 06 12:46:20.937151 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:20.937080 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722365-s5p6k_d7d1917f-5b05-4dfe-990e-73e1e4e17793/cleanup/0.log" Jul 06 12:46:21.058662 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:21.058618 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68db85d476-g8qmn_f119f275-f8b4-4991-8089-ff2f7cfc4553/manager/0.log" Jul 06 12:46:21.714805 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:21.714779 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-zxnzl_b7acd82e-3605-49ac-9783-fa9077a78d99/copy-manifests/0.log" Jul 06 12:46:21.723905 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:21.723886 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-zxnzl_b7acd82e-3605-49ac-9783-fa9077a78d99/manager/0.log" Jul 06 12:46:21.870894 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:21.870867 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-99bww_48a605e3-e798-439f-a293-c5ca1b5df716/postgres/0.log" Jul 06 12:46:24.599148 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:24.599120 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ckd2t_fdb6e5e8-125e-4298-a6bb-edf9994466eb/discovery/0.log" Jul 06 12:46:25.122600 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:25.122569 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nfs2z_673144bf-bd68-46ea-bd1a-ddfc46277329/payload-pre-processing/0.log" Jul 06 12:46:25.247934 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:25.247906 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7nwdm_8e531302-0728-43ff-b112-008006dfd65f/payload-processing/0.log" Jul 06 12:46:25.836962 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:25.836933 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-tzzd7_b2dde514-c210-4900-9327-48a1a8427766/main/0.log" Jul 06 12:46:33.603053 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:33.602960 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2j8wm_e142fd3b-253b-4bd7-ad85-8899b6fd1a6e/global-pull-secret-syncer/0.log" Jul 06 12:46:33.844805 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:33.844780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xz98j_23b776be-2e40-4be4-88a9-f8425351069f/konnectivity-agent/0.log" Jul 06 12:46:33.910633 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:33.910564 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-197.ec2.internal_ff989a6f978fee52ada7de3499ed5674/haproxy/0.log" Jul 06 12:46:43.172593 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.172564 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv"] Jul 06 12:46:43.172958 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.172905 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e95245-0da9-4118-9282-366f0265b8f9" containerName="cleanup" Jul 06 12:46:43.172958 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.172915 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e95245-0da9-4118-9282-366f0265b8f9" containerName="cleanup" Jul 06 12:46:43.172958 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.172927 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7d1917f-5b05-4dfe-990e-73e1e4e17793" containerName="cleanup" Jul 06 12:46:43.172958 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.172933 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7d1917f-5b05-4dfe-990e-73e1e4e17793" containerName="cleanup" Jul 06 12:46:43.172958 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.172947 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68b91ae-a407-4c9f-b2a2-1dc51e861483" containerName="maas-api" Jul 06 12:46:43.172958 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.172953 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68b91ae-a407-4c9f-b2a2-1dc51e861483" containerName="maas-api" Jul 06 12:46:43.172958 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.172958 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="accad275-a3a8-4a6e-b73b-82595d4a2dd2" containerName="cleanup" Jul 06 12:46:43.173198 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.172963 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="accad275-a3a8-4a6e-b73b-82595d4a2dd2" containerName="cleanup" Jul 06 12:46:43.173198 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.172976 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f012a57a-6e26-4365-92e2-68bb0f58a3d4" containerName="maas-api" Jul 06 12:46:43.173198 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.172981 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f012a57a-6e26-4365-92e2-68bb0f58a3d4" containerName="maas-api" Jul 06 12:46:43.173198 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.173029 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f012a57a-6e26-4365-92e2-68bb0f58a3d4" containerName="maas-api" Jul 06 12:46:43.173198 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.173054 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68b91ae-a407-4c9f-b2a2-1dc51e861483" containerName="maas-api" Jul 06 12:46:43.173198 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.173062 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="32e95245-0da9-4118-9282-366f0265b8f9" containerName="cleanup" Jul 06 12:46:43.173198 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.173067 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7d1917f-5b05-4dfe-990e-73e1e4e17793" containerName="cleanup" Jul 06 12:46:43.173198 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.173075 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="accad275-a3a8-4a6e-b73b-82595d4a2dd2" containerName="cleanup" Jul 06 12:46:43.175940 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.175924 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.186416 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.186396 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26xd8\"/\"openshift-service-ca.crt\"" Jul 06 12:46:43.189838 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.189819 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26xd8\"/\"kube-root-ca.crt\"" Jul 06 12:46:43.189995 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.189984 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-26xd8\"/\"default-dockercfg-49n4q\"" Jul 06 12:46:43.198566 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.198545 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv"] Jul 06 12:46:43.217704 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.217678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-podres\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.217818 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.217738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdl75\" (UniqueName: \"kubernetes.io/projected/266be7e4-f08d-46c2-92a3-7b509c2ab617-kube-api-access-xdl75\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.217871 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.217815 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-proc\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.217871 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.217860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-sys\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.217957 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.217889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-lib-modules\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.318751 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.318717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-podres\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.318892 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.318785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdl75\" (UniqueName: \"kubernetes.io/projected/266be7e4-f08d-46c2-92a3-7b509c2ab617-kube-api-access-xdl75\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.318892 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.318816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-proc\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.318892 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.318828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-podres\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.318892 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.318832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-sys\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.318892 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.318864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-lib-modules\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.318892 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.318881 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-sys\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.319253 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.318908 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-proc\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.319253 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.318967 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/266be7e4-f08d-46c2-92a3-7b509c2ab617-lib-modules\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.330523 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.330497 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdl75\" (UniqueName: \"kubernetes.io/projected/266be7e4-f08d-46c2-92a3-7b509c2ab617-kube-api-access-xdl75\") pod \"perf-node-gather-daemonset-4sqnv\" (UID: \"266be7e4-f08d-46c2-92a3-7b509c2ab617\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.484978 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.484954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:43.650658 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:43.650633 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv"] Jul 06 12:46:43.652415 ip-10-0-131-197 kubenswrapper[2576]: W0706 12:46:43.652388 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod266be7e4_f08d_46c2_92a3_7b509c2ab617.slice/crio-9d328798a2ed94ad97c88e46bb6f93fc8470d67cd797c4cb3ae315dc87fac53f WatchSource:0}: Error finding container 9d328798a2ed94ad97c88e46bb6f93fc8470d67cd797c4cb3ae315dc87fac53f: Status 404 returned error can't find the container with id 9d328798a2ed94ad97c88e46bb6f93fc8470d67cd797c4cb3ae315dc87fac53f Jul 06 12:46:44.304746 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:44.304723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l2jrf_ddb54b24-1ea0-4334-89c3-26100e5a1086/node-exporter/0.log" Jul 06 12:46:44.407108 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:44.407083 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l2jrf_ddb54b24-1ea0-4334-89c3-26100e5a1086/kube-rbac-proxy/0.log" Jul 06 12:46:44.423239 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:44.423216 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" event={"ID":"266be7e4-f08d-46c2-92a3-7b509c2ab617","Type":"ContainerStarted","Data":"0f654d393826972360ca6a8f94210dc44dc6ac5848144e620dd5307aa546a649"} Jul 06 12:46:44.423379 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:44.423267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" event={"ID":"266be7e4-f08d-46c2-92a3-7b509c2ab617","Type":"ContainerStarted","Data":"9d328798a2ed94ad97c88e46bb6f93fc8470d67cd797c4cb3ae315dc87fac53f"} Jul 06 12:46:44.423379 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:44.423334 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:44.456731 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:44.456684 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" podStartSLOduration=1.45666728 podStartE2EDuration="1.45666728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:46:44.452416972 +0000 UTC m=+2529.553573214" watchObservedRunningTime="2026-07-06 12:46:44.45666728 +0000 UTC m=+2529.557823522" Jul 06 12:46:44.485595 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:44.485577 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l2jrf_ddb54b24-1ea0-4334-89c3-26100e5a1086/init-textfile/0.log" Jul 06 12:46:44.859031 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:44.859002 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_304b73a3-b34b-4aab-a87d-6fdca905ff26/prometheus/0.log" Jul 06 12:46:44.915871 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:44.915851 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_304b73a3-b34b-4aab-a87d-6fdca905ff26/config-reloader/0.log" Jul 06 12:46:44.970840 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:44.970822 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_304b73a3-b34b-4aab-a87d-6fdca905ff26/thanos-sidecar/0.log" Jul 06 12:46:45.011083 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:45.011062 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_304b73a3-b34b-4aab-a87d-6fdca905ff26/kube-rbac-proxy-web/0.log" Jul 06 12:46:45.056789 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:45.056773 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_304b73a3-b34b-4aab-a87d-6fdca905ff26/kube-rbac-proxy/0.log" Jul 06 12:46:45.124634 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:45.124569 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_304b73a3-b34b-4aab-a87d-6fdca905ff26/kube-rbac-proxy-thanos/0.log" Jul 06 12:46:45.184284 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:45.184262 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_304b73a3-b34b-4aab-a87d-6fdca905ff26/init-config-reloader/0.log" Jul 06 12:46:49.732592 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:49.732564 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-rp4sl_2a67dd30-bfd4-4b2c-ba58-e2b736d4d5ae/volume-data-source-validator/0.log" Jul 06 12:46:50.437559 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:50.437531 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-4sqnv" Jul 06 12:46:51.250492 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:51.250465 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6pwsb_6df8d581-a737-47d1-bdfb-d66b252e8962/dns/0.log" Jul 06 12:46:51.300775 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:51.300746 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6pwsb_6df8d581-a737-47d1-bdfb-d66b252e8962/kube-rbac-proxy/0.log" Jul 06 12:46:51.591546 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:51.591474 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wrjzt_f42190ea-4133-4159-adc1-5992a2419e48/dns-node-resolver/0.log" Jul 06 12:46:52.241990 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:52.241962 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-658c7f4dd8-fltx8_1823a516-57b5-458f-9d17-9fe71ef04052/registry/0.log" Jul 06 12:46:52.307062 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:52.307022 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-52t5f_6260540c-39d5-488b-bf5d-10a9355bd58d/node-ca/0.log" Jul 06 12:46:54.012209 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:54.012180 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ckd2t_fdb6e5e8-125e-4298-a6bb-edf9994466eb/discovery/0.log" Jul 06 12:46:54.027789 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:54.027766 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ckd2t_fdb6e5e8-125e-4298-a6bb-edf9994466eb/discovery/0.log" Jul 06 12:46:54.319970 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:54.319901 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nfs2z_673144bf-bd68-46ea-bd1a-ddfc46277329/payload-pre-processing/0.log" Jul 06 12:46:54.421969 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:54.421944 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7nwdm_8e531302-0728-43ff-b112-008006dfd65f/payload-processing/0.log" Jul 06 12:46:54.537281 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:54.537260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nfs2z_673144bf-bd68-46ea-bd1a-ddfc46277329/payload-pre-processing/0.log" Jul 06 12:46:54.639114 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:54.639027 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7nwdm_8e531302-0728-43ff-b112-008006dfd65f/payload-processing/0.log" Jul 06 12:46:55.627848 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:55.627826 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jwpzh_3d855740-d3f8-4a00-9af9-a41335fbac36/serve-healthcheck-canary/0.log" Jul 06 12:46:55.870322 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:55.870294 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ckd2t_fdb6e5e8-125e-4298-a6bb-edf9994466eb/discovery/0.log" Jul 06 12:46:56.081822 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:56.081800 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nfs2z_673144bf-bd68-46ea-bd1a-ddfc46277329/payload-pre-processing/0.log" Jul 06 12:46:56.131913 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:56.131885 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7nwdm_8e531302-0728-43ff-b112-008006dfd65f/payload-processing/0.log" Jul 06 12:46:56.432929 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:56.432841 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-xk7q2_4e1e7d93-35c0-4131-8aa8-353de71428f5/insights-operator/0.log" Jul 06 12:46:56.433953 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:56.433938 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-xk7q2_4e1e7d93-35c0-4131-8aa8-353de71428f5/insights-operator/1.log" Jul 06 12:46:56.462601 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:56.462578 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4zpf7_3e7c6152-e958-4d73-a0b8-22765417cf9d/kube-rbac-proxy/0.log" Jul 06 12:46:56.495029 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:56.495006 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4zpf7_3e7c6152-e958-4d73-a0b8-22765417cf9d/exporter/0.log" Jul 06 12:46:56.528200 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:56.528183 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4zpf7_3e7c6152-e958-4d73-a0b8-22765417cf9d/extractor/0.log" Jul 06 12:46:59.414202 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:59.414178 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-b66dc4564-t5rhb_f2f61827-81ee-4623-b32b-8f88d64d7e4b/maas-api/0.log" Jul 06 12:46:59.532085 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:59.532058 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722365-s5p6k_d7d1917f-5b05-4dfe-990e-73e1e4e17793/cleanup/0.log" Jul 06 12:46:59.644420 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:46:59.644390 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68db85d476-g8qmn_f119f275-f8b4-4991-8089-ff2f7cfc4553/manager/0.log" Jul 06 12:47:00.145431 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:47:00.145400 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-zxnzl_b7acd82e-3605-49ac-9783-fa9077a78d99/manager/0.log" Jul 06 12:47:00.207139 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:47:00.207111 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-zxnzl_b7acd82e-3605-49ac-9783-fa9077a78d99/copy-manifests/0.log" Jul 06 12:47:00.261250 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:47:00.261220 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-99bww_48a605e3-e798-439f-a293-c5ca1b5df716/postgres/0.log" Jul 06 12:47:01.600118 ip-10-0-131-197 kubenswrapper[2576]: I0706 12:47:01.600092 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d8dd6c8b8-tf8hz_70998b15-a1bf-46f8-a054-fb48977d338b/manager/0.log"